gemma-3-4b-persian-v0-GGUF Open-source Model - Effortlessly Complete Persian Text Generation Tasks for Free

Gemma 3 4b Persian V0 GGUF

Developed by mradermacher

This is a statically quantized version of the mshojaei77/gemma-3-4b-persian-v0 model, specifically optimized for Persian text generation tasks.

Large Language Model

Transformers

OtherOpen Source License:Apache-2.0 #Persian language generation #4-bit quantization #Lightweight and efficient

Downloads 162

Release Time : 3/17/2025

Model Overview

Provides Persian text generation models in multiple quantization versions, suitable for efficient inference under different hardware configurations.

Model Features

Multiple quantization options

Provides model files with 12 different quantization levels from Q2_K to f16 to meet the performance requirements under different hardware conditions.

Persian language optimization

Trained on the mshojaei77/Persian_sft dataset and specifically optimized for Persian text generation tasks.

Efficient inference

The quantized version significantly reduces memory usage and computational resource requirements while maintaining good generation quality.

Model Capabilities

Persian text generation

Efficient inference

Multiple quantization support

Use Cases

Content creation

Persian article generation

Automatically generate Persian articles, blogs and other content

Dialogue system

Persian chatbot

Build a Persian dialogue system

🚀 Gemma-3-4B Persian V0 Quantized Model

This is a static quantization of the Gemma-3-4B Persian V0 model, providing various quantized versions for efficient use.

🚀 Quick Start

If you're new to using this quantized model, the following sections will guide you through its details and usage.

✨ Features

Base Model: mshojaei77/gemma-3-4b-persian-v0
Datasets: Trained on mshojaei77/Persian_sft
Language: Persian (fa)
Library Name: transformers
License: apache-2.0
Quantized By: mradermacher
Tags: persian, text-generation, qlora, 4-bit-quantization

Property	Details
Model Type	mshojaei77/gemma-3-4b-persian-v0
Training Data	mshojaei77/Persian_sft

📚 Documentation

🔍 About

This is a static quantization of the model from mshojaei77/gemma-3-4b-persian-v0. The weighted/imatrix quants are available at mradermacher/gemma-3-4b-persian-v0-i1-GGUF.

💻 Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

📦 Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link	Type	Size/GB	Notes
GGUF	Q2_K	1.8
GGUF	Q3_K_S	2.0
GGUF	Q3_K_M	2.2	lower quality
GGUF	Q3_K_L	2.3
GGUF	IQ4_XS	2.4
GGUF	Q4_K_S	2.5	fast, recommended
GGUF	Q4_K_M	2.6	fast, recommended
GGUF	Q5_K_S	2.9
GGUF	Q5_K_M	2.9
GGUF	Q6_K	3.3	very good quality
GGUF	Q8_0	4.2	fast, best quality
GGUF	f16	7.9	16 bpw, overkill

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

❓ FAQ / Model Request

See mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

🙏 Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

📄 License

This project is licensed under the apache-2.0 license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご