Medgemma 27b Text It 8bit

🚀 mlx-community/medgemma-27b-text-it-8bit

This model is converted to MLX format, enabling text - generation tasks in the medical field.

🚀 Quick Start

This model mlx-community/medgemma-27b-text-it-8bit was converted to MLX format from google/medgemma-27b-text-it using mlx-lm version 0.24.1.

📦 Installation

pip install mlx-lm

💻 Usage Examples

Basic Usage

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/medgemma-27b-text-it-8bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

📄 License

• License Name: health-ai-developer-foundations
• License Link: https://developers.google.com/health-ai-developer-foundations/terms

⚠️ Important Note

To access MedGemma on Hugging Face, you're required to review and agree to Health AI Developer Foundation's terms of use. To do this, please ensure you're logged in to Hugging Face and click below. Requests are processed immediately.