# 8-bit quantized inference

Qwen3 30B A3B is a large language model that has undergone 8-bit quantization using the GPTQ method, suitable for efficient inference scenarios.

An optimized 8-bit quantized version of Qwen3-8B, designed for efficient inference on the MLX framework

An 8-bit quantized version of Stable Diffusion 3.5 Large Turbo, converted to OpenVINO format for efficient text-to-image generation tasks.

The 8-bit quantized version of Meta Llama 3 - 8B Instruct large language model, reducing model size and improving inference speed, suitable for deployment on resource-constrained devices.

Pinokio_v1.0 is a text generation model supporting English and Turkish, released under the Apache-2.0 license.