Deepseek-r1-0528-distilled-qwen3-gguf Open-source Model - Fine-tuned based on Qwen 3, enhancing reasoning and problem-solving abilities

Deepseek R1 0528 Distilled Qwen3 Gguf

Developed by ertghiu256

Fine-tuned based on the Qwen 3 model with 4B parameters to improve inference and problem-solving abilities

EnglishOpen Source License:Apache-2.0 #Efficient fine-tuning and inference #Logical problem solving #Non-HTML code generation

Downloads 142

Release Time : 6/16/2025

Model Overview

This model is fine-tuned on a specific dataset based on the Qwen 3 model with 4B parameters. It is mainly used for text generation tasks and enhances inference and problem-solving abilities.

Model Features

Training acceleration

Using Unsloth and Huggingface's TRL library, the training speed is doubled.

Multi-purpose capabilities

Supports various tasks such as general inference, code generation, and problem solving.

Model Capabilities

Text generation

Logical reasoning

Code generation

Problem solving

Use Cases

Inference and problem solving

General inference

Perform general logical inference tasks

Code generation

Generate programming code (Note: Not specifically trained for HTML code)

The generated HTML code may not perform well.

Property	Details
Base Model	ertghiu256/deepseek - r1 - 0528 - distilled - qwen3
Model Type	Qwen 3 with 4b parameters, finetuned on 18k samples from sequelbox/Celestia3 - DeepSeek - R1 - 0528 dataset distilled from Deepseek R1 0528
Tags	text - generation - inference, transformers, unsloth, qwen3, reasoning, think, deepseek
License	apache - 2.0
Language	en
Training Data	sequelbox/Celestia3 - DeepSeek - R1 - 0528, LuyiCui/Mixture - of - Thoughts - processed
Developed by	ertghiu256
Finetuned from model	unsloth/qwen3 - 4b - unsloth - bnb - 4bit

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Deepseek R1 0528 Distilled Qwen3 Gguf

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 Uploaded Finetuned Model

🚀 Quick Start

Model Details

Training Advantages

✨ Features

📄 License