Deepseek R1 14b Cot Math Reasoning Full GGUF

🚀 Jianyuan1/deepseek-r1-14b-cot-math-reasoning-full - GGUF

This repository provides GGUF format model files for Jianyuan1/deepseek-r1-14b-cot-math-reasoning-full. These files are quantized using machines from TensorBlock, and are compatible with llama.cpp as of commit b4882.

✨ Features

• Contains GGUF format model files for Jianyuan1/deepseek-r1-14b-cot-math-reasoning-full.
• Quantized using machines provided by TensorBlock.
• Compatible with llama.cpp as of commit b4882.

📦 Our projects

Project	Description	Image	Link
Awesome MCP Servers	A comprehensive collection of Model Context Protocol (MCP) servers.		👀 See what we built 👀
TensorBlock Studio	A lightweight, open, and extensible multi-LLM interaction studio.		👀 See what we built 👀

📚 Documentation

Prompt template

<｜begin▁of▁sentence｜>{system_prompt}<｜User｜>{prompt}<｜Assistant｜>

Model file specification

📦 Installation

Command line

Firstly, install Huggingface Client

pip install -U "huggingface_hub[cli]"

Then, download the individual model file to a local directory

huggingface-cli download tensorblock/deepseek-r1-14b-cot-math-reasoning-full-GGUF --include "deepseek-r1-14b-cot-math-reasoning-full-Q2_K.gguf" --local-dir MY_LOCAL_DIR

If you want to download multiple model files with a pattern (e.g., *Q4_K*gguf), you can try:

huggingface-cli download tensorblock/deepseek-r1-14b-cot-math-reasoning-full-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'

📄 License

This project is licensed under the MIT license.