Deepseek R1 Llama 8B F32 GGUF

🚀 DeepSeek-R1-Llama-8B-F32-GGUF

DeepSeek-R1-Llama-8B-F32-GGUF is a quantized model based on DeepSeek-R1-Distill-Llama-8B. It uses reinforcement learning directly on the base model, enabling chain-of-thought reasoning for complex problem-solving and leading to the development of DeepSeek-R1-Zero, which has self-verification, reflection, and extended chain-of-thought generation capabilities.

🚀 Quick Start

This section provides an overview of the DeepSeek-R1-Llama-8B-F32-GGUF model, including its features and related file information.

✨ Features

DeepSeek-R1-Llama-8B-F32-GGUF is a quantized version of DeepSeek-R1-Distill-Llama-8B. It is trained using reinforcement learning (RL) directly on the base model without relying on supervised fine - tuning (SFT) as a preliminary step. This approach allows the model to explore chain - of - thought (CoT) reasoning for solving complex problems, leading to the development of DeepSeek-R1-Zero. DeepSeek-R1-Zero demonstrates capabilities such as self - verification, reflection, and generating extended chains of thought.

📚 Documentation

Model File

Quants Usage

(sorted by size, not necessarily quality. IQ - quants are often preferable over similar sized non - IQ quants)

Here is a handy graph by ikawrakow comparing some lower - quality quant types (lower is better):

📄 License

This project is licensed under the Apache-2.0 license.