Gemma 3 12b It 4bit DWQ

🚀 mlx-community/gemma3-12b-it-4bit-DWQ

This model is converted to MLX format, enabling efficient text generation.

🚀 Quick Start

This model mlx-community/gemma3-12b-it-4bit-DWQ was converted to MLX format from google/gemma-3-12b-it using mlx-lm version 0.24.0.

✨ Features

• Converted to MLX format for efficient processing.
• Compatible with mlx-lm library for easy integration.

📦 Installation

pip install mlx-lm

💻 Usage Examples

Basic Usage

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/gemma-3-12b-it-4bit-DWQ")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

📄 License

The license for this model is Gemma.

⚠️ Important Note

To access Gemma on Hugging Face, you’re required to review and agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging Face and click below. Requests are processed immediately.

💡 Usage Tip

When using the model, make sure to follow the Google's usage license.