MedGemma-4B-it-Q8_0-GGUF Open-source Model - Empowering Image-text Conversion Tasks in the Medical Field

Medgemma 4b It Q8 0 GGUF

Developed by NikolayKozloff

MedGemma-4B-it-Q8_0-GGUF is a GGUF format model converted from google/medgemma-4b-it, specifically designed for image-to-text tasks in the medical field.

Image-to-Text

Transformers

Open Source License:Other #Medical Image Analysis #Clinical Decision Support #Multi-Specialty Adaptation

Downloads 142

Release Time : 5/20/2025

Model Overview

This model is a medical-specific multimodal model capable of handling image-to-text tasks in various medical fields such as radiology, clinical reasoning, dermatology, pathology, ophthalmology, and chest X-rays.

Model Features

Medical-Specific Multimodal

Designed for the medical field, capable of handling multimodal tasks involving both images and text.

High-Performance Inference

Optimized through the GGUF format, supporting efficient local inference.

Broad Medical Applications

Supports various medical subfields such as radiology, clinical reasoning, dermatology, pathology, ophthalmology, and chest X-rays.

Model Capabilities

Medical Image Analysis

Medical Text Generation

Clinical Reasoning

Multimodal Task Processing

Use Cases

Radiology

Chest X-ray Analysis

Analyze chest X-ray images and generate diagnostic reports.

Dermatology

Skin Disease Diagnosis

Generate possible diagnostic suggestions based on skin lesion images.

Pathology

Pathology Slide Analysis

Analyze pathology slide images and generate descriptive text.

🚀 NikolayKozloff/medgemma-4b-it-Q8_0-GGUF

This model is a conversion to the GGUF format from google/medgemma-4b-it using llama.cpp via the ggml.ai's GGUF-my-repo space. For more detailed information about the model, please refer to the original model card.

🚀 Quick Start

📦 Installation

Install llama.cpp through brew (works on Mac and Linux):

brew install llama.cpp

💻 Usage Examples

Basic Usage

You can invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo NikolayKozloff/medgemma-4b-it-Q8_0-GGUF --hf-file medgemma-4b-it-q8_0.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo NikolayKozloff/medgemma-4b-it-Q8_0-GGUF --hf-file medgemma-4b-it-q8_0.gguf -c 2048

Advanced Usage

You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo NikolayKozloff/medgemma-4b-it-Q8_0-GGUF --hf-file medgemma-4b-it-q8_0.gguf -p "The meaning to life and the universe is"

./llama-server --hf-repo NikolayKozloff/medgemma-4b-it-Q8_0-GGUF --hf-file medgemma-4b-it-q8_0.gguf -c 2048

📄 License

This model is under the Health AI Developer Foundation's terms of use. To access MedGemma on Hugging Face, you're required to review and agree to these terms. To do this, please ensure you're logged in to Hugging Face and click the "Acknowledge license" button. Requests are processed immediately.

Information Table

Property	Details
Library Name	transformers
Pipeline Tag	image-text-to-text
Base Model	google/medgemma-4b-it
Tags	medical, radiology, clinical-reasoning, dermatology, pathology, ophthalmology, chest-x-ray, llama-cpp, gguf-my-repo
License	other
License Name	health-ai-developer-foundations
License Link	Health AI Developer Foundation's terms of use

⚠️ Important Note

To access MedGemma on Hugging Face, you're required to review and agree to Health AI Developer Foundation's terms of use. To do this, please ensure you're logged in to Hugging Face and click below. Requests are processed immediately.

💡 Usage Tip

You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご