Qwen3-1.7B-GGUF Open-Source Large Language Model - Freely Implement Inference, Multilingual Support and Other Functions

Qwen3 1.7B GGUF

Developed by prithivMLmods

Qwen3 is the latest version of the Tongyi Qianwen series of large language models, offering a range of dense and mixture of experts (MoE) models. Based on large-scale training, Qwen3 has achieved breakthrough progress in reasoning, instruction following, agent capabilities, and multilingual support.

Large Language Model EnglishOpen Source License:Apache-2.0 #Multilingual Text Generation #Mixture of Experts Architecture #Lightweight Inference

Downloads 357

Release Time : 5/13/2025

Model Overview

Qwen3-1.7B-GGUF is the GGUF quantized version of the Qwen3-1.7B model, suitable for text generation tasks and supporting various quantization methods to meet different hardware requirements.

Model Features

Multiple Quantization Versions

Offers quantization versions from 3-bit to 8-bit to accommodate different hardware and performance needs.

High-Performance Inference

Excels in reasoning, instruction following, and agent capabilities.

Multilingual Support

Supports multiple languages including English.

Model Capabilities

Text Generation

Instruction Following

Multilingual Support

Use Cases

Text Generation

Content Creation

Generate articles, stories, or other textual content.

Dialogue Systems

Used to build intelligent chatbots.

File Name	Size	Quantization	Format	Description
`Qwen3_1.7B.F32.gguf`	6.89 GB	FP32	GGUF	Full precision (float32) version
`Qwen3_1.7B.BF16.gguf`	3.45 GB	BF16	GGUF	BFloat16 precision version
`Qwen3_1.7B.F16.gguf`	3.45 GB	FP16	GGUF	Float16 precision version
`Qwen3_1.7B.Q3_K_M.gguf`	940 MB	Q3_K_M	GGUF	3 - bit quantized (K M variant)
`Qwen3_1.7B.Q3_K_S.gguf`	867 MB	Q3_K_S	GGUF	3 - bit quantized (K S variant)
`Qwen3_1.7B.Q4_K_M.gguf`	1.11 GB	Q4_K_M	GGUF	4 - bit quantized (K M variant)
`Qwen3_1.7B.Q4_K_S.gguf`	1.06 GB	Q4_K_S	GGUF	4 - bit quantized (K S variant)
`Qwen3_1.7B.Q5_K_M.gguf`	1.26 GB	Q5_K_M	GGUF	5 - bit quantized (K M variant)
`Qwen3_1.7B.Q8_0.gguf`	1.83 GB	Q8_0	GGUF	8 - bit quantized
`.gitattributes`	2.04 kB	—	—	Git LFS tracking file
`config.json`	31 B	—	—	Configuration placeholder
`README.md`	3.63 kB	—	—	Model documentation

Link	Type	Size/GB	Notes
GGUF	Q2_K	0.4
GGUF	Q3_K_S	0.5
GGUF	Q3_K_M	0.5	lower quality
GGUF	Q3_K_L	0.5
GGUF	IQ4_XS	0.6
GGUF	Q4_K_S	0.6	fast, recommended
GGUF	Q4_K_M	0.6	fast, recommended
GGUF	Q5_K_S	0.6
GGUF	Q5_K_M	0.7
GGUF	Q6_K	0.7	very good quality
GGUF	Q8_0	0.9	fast, best quality
GGUF	f16	1.6	16 bpw, overkill

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Qwen3 1.7B GGUF

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 Qwen3-1.7B-GGUF

📚 Documentation

📦 Model Files

💻 Quants Usage

📄 License