DeepSeek-R1-Distill-Qwen-14B Open-Source Large Language Model - Multi-GGUF Quantized Version Boosts Performance

Deepseek Ai DeepSeek R1 Distill Qwen 14B GGUF

Developed by featherless-ai-quants

DeepSeek-R1-Distill-Qwen-14B is an optimized large language model with a parameter scale of 14B, released by DeepSeek AI. It is distilled from the Qwen architecture and offers multiple GGUF quantization versions to improve performance.

Large Language Model #Lightweight Inference #Efficient Quantization #Multi-task Adaptation

Downloads 237

Release Time : 6/4/2025

Model Overview

This model is a large language model optimized through distillation, supporting various tasks such as text generation and question answering. It is suitable for scenarios requiring efficient inference.

Model Features

Efficient Quantization

Provides multiple GGUF quantization versions, significantly reducing the resource requirements during model operation.

High-performance Inference

Optimized through distillation, it reduces computational overhead while maintaining high performance.

Wide Compatibility

Supports multiple quantization types to adapt to different hardware and performance requirements.

Model Capabilities

Text Generation

Question Answering

Language Understanding

Use Cases

Content Generation

Automatic Text Creation

Generate articles, stories, or other text content.

Intelligent Question Answering

Knowledge Q&A

Answer various questions raised by users.

Property	Details
Base Model	deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
Pipeline Tag	text-generation
Quantized By	featherless-ai-quants

Quantization Type	File	Size
IQ4_XS	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-IQ4_XS.gguf	7806.96 MB
Q2_K	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q2_K.gguf	5503.17 MB
Q3_K_L	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q3_K_L.gguf	7557.65 MB
Q3_K_M	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q3_K_M.gguf	6999.21 MB
Q3_K_S	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q3_K_S.gguf	6351.09 MB
Q4_K_M	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf	8571.73 MB
Q4_K_S	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q4_K_S.gguf	8176.26 MB
Q5_K_M	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q5_K_M.gguf	10022.04 MB
Q5_K_S	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q5_K_S.gguf	9790.95 MB
Q6_K	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q6_K.gguf	11563.00 MB
Q8_0	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B-Q8_0.gguf	14974.21 MB

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Deepseek Ai DeepSeek R1 Distill Qwen 14B GGUF

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 deepseek-ai/DeepSeek-R1-Distill-Qwen-14B GGUF Quantizations

✨ Features

Available Quantizations

Powered by Featherless AI

Key Features

🚀 Quick Start