Medgemma 27b Text It 4bit

🚀 mlx-community/medgemma-27b-text-it-4bit

This project converts the model from the original format to MLX format, facilitating its use in MLX-related environments.

🚀 Quick Start

This model mlx-community/medgemma-27b-text-it-4bit was converted to MLX format from google/medgemma-27b-text-it using mlx-lm version 0.24.1.

📦 Installation

pip install mlx-lm

💻 Usage Examples

Basic Usage

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/medgemma-27b-text-it-4bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

📄 License

⚠️ Important Note

To access MedGemma on Hugging Face, you're required to review and agree to Health AI Developer Foundation's terms of use. To do this, please ensure you're logged in to Hugging Face and click below. Requests are processed immediately.

💡 Usage Tip

Click the button below to acknowledge the license and access the model.

[Access MedGemma on Hugging Face](https://huggingface.co/mlx-community/medgemma-27b-text-it-4bit)