Gemma 3 27b It 4bit DWQ

🚀 mlx-community/gemma-3-27b-it-4bit-DWQ

This model converts google/gemma-3-27b-it to MLX format, facilitating efficient text generation.

🚀 Quick Start

This model mlx-community/gemma-3-27b-it-4bit-DWQ was converted to MLX format from google/gemma-3-27b-it using mlx-lm version 0.24.0.

📦 Installation

pip install mlx-lm

💻 Usage Examples

Basic Usage

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/gemma-3-27b-it-4bit-DWQ")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

📄 License

The license for this model is Gemma.

⚠️ Important Note

To access Gemma on Hugging Face, you’re required to review and agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging Face and click below. Requests are processed immediately.

💡 Usage Tip

Click the button below to acknowledge the license: [Acknowledge license]