# Multilingual instruction model

This is the Llamacpp imatrix quantized version of the Mistral-Small-3.2-24B-Instruct-2506 model, offering various quantization types to meet different hardware requirements.

The fastest and most flexible model for self-hosting scenarios, allowing free adjustment of model size, inference latency, and quality balance via a sliding control bar

This is a GGUF format model converted from mistralai/Mistral-Small-3.1-24B-Instruct-2503, supporting multilingual text generation tasks.

Llama-4-Scout-17B-16E-Instruct is a multilingual instruction fine-tuning model that supports multiple languages and can be run through LlamaEdge.

The Mistral-7B-Instruct-v0.3 quantized model developed by IST Austria, utilizing GPTQ technology for 8-bit quantization, suitable for multilingual text generation tasks.