# Multi-round Dialogue

This is a 4-bit quantized version converted from the Qwen3-30B model, suitable for text generation tasks on the MLX framework.

Qwen3-30B-A3B-8bit is an MLX format conversion version of the Qwen/Qwen3-30B-A3B model, supporting efficient operation on Apple chips.

This model is a 4-bit quantized version of Qwen3-32B in MLX format, optimized for efficient operation on Apple Silicon devices.

This is a large language model with 70B parameters based on the Llama architecture, which has undergone 6-bit quantization and is suitable for text generation tasks.

Gemma 3 12B is a large language model that provides a quantized version in GGUF format, suitable for local deployment and use.

The GGUF format version of Llama 3 70B Instruct, providing a more efficient local running experience