G

Gemma 3 27b It Qat Autoawq

Developed by gaunernst
Gemma 3 is a lightweight, cutting-edge open model series from Google, built on the same technology as Gemini, supporting multimodal input (text/image) and text output. The 27B version significantly reduces memory requirements through quantization-aware training.
Downloads 789
Release Time : 4/6/2025

Model Overview

A multimodal open-weight model supporting 128K context windows and 140+ languages, suitable for tasks like Q&A, summarization, and reasoning, with special optimizations for deployment in resource-constrained environments.

Model Features

Quantization-Aware Training
Uses QAT for 4-bit quantization, significantly reducing memory requirements while maintaining near-bfloat16 model quality.
Multimodal Support
Processes both text and image inputs (896x896 resolution) for cross-modal understanding and generation.
Extended Context
Supports 128K token input context windows, ideal for long documents and complex tasks.
Multilingual Capabilities
Training data covers 140+ languages, enabling cross-lingual understanding and generation.

Model Capabilities

Text Generation
Image Content Analysis
Multilingual Processing
Code Understanding & Generation
Mathematical Reasoning
Document Summarization
Visual Question Answering

Use Cases

Content Generation
Creative Writing
Generates creative texts like poetry and stories
Examples show coherent theme-aligned poetry generation
Technical Document Summarization
Automatically generates concise summaries of long documents
Effectively extracts key information within 128K context windows
Visual Understanding
Image Captioning
Generates natural language descriptions for input images
Scores 116 on COCOcap benchmark (27B model)
Document Visual Q&A
Answers questions based on scanned document content
85.6% accuracy on DocVQA validation set
Educational Assistance
Math Problem Solving
Solves math word problems step-by-step
82.6% 8-shot accuracy on GSM8K benchmark
Programming Instruction
Explains code snippets or generates example code
48.8% 0-shot pass rate on HumanEval benchmark
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase