G

Gemma 3 12b It GGUF

Developed by MaziyarPanahi
GGUF quantized version of Gemma 3 12B, suitable for text generation tasks.
Downloads 641.41k
Release Time : 3/12/2025

Model Overview

Gemma 3 12B is a quantized large language model based on the GGUF format, supporting multiple quantization levels (2-bit to 8-bit), suitable for local deployment and text generation tasks.

Model Features

Multi-quantization Level Support
Offers multiple quantization levels from 2-bit to 8-bit to meet different hardware requirements.
GGUF Format
Uses the GGUF format, compatible with various clients and libraries such as llama.cpp and LM Studio.
Local Deployment
Supports running on local hardware without relying on cloud services.

Model Capabilities

Text Generation
Dialogue Systems
Code Generation

Use Cases

Text Generation
Creative Writing
Generate creative content such as stories and poems.
Technical Documentation Generation
Automatically generate technical documentation or code comments.
Dialogue Systems
Chatbot
Build locally deployed chatbots.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
Š 2025AIbase