Gemma 3 27b It Abliterated Mlx Vlm 4Bit

🚀 aimeri/gemma-3-27b-it-abliterated-mlx-vlm-4Bit

The aimeri/gemma-3-27b-it-abliterated-mlx-vlm-4Bit model is converted to MLX format, enabling efficient multimodal processing.

🚀 Quick Start

The Model aimeri/gemma-3-27b-it-abliterated-mlx-vlm-4Bit was converted to MLX format from huihui-ai/gemma-3-27b-it-abliterated using mlx-vlm version 0.1.21.

📦 Installation

pip install mlx-vlm

💻 Usage Examples

Basic Usage

import mlx.core as mx
from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model_path = "aimeri/gemma-3-27b-it-abliterated-mlx-vlm-4Bit"
model, processor = load(model_path)
config = load_config(model_path)

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=len(image)
)

# Generate output
output = generate(model, processor, formatted_prompt, image, verbose=False)
print(output)

⚠️ Important Note

To access Gemma on Hugging Face, you’re required to review and agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging Face and click below. Requests are processed immediately.