Voicelab_trurl-2-13b-GGUF Open-source Large Language Model - Free Deployment to Solve Natural Language Processing Tasks

Voicelab Trurl 2 13b GGUF

Developed by tensorblock

trurl-2-13b is a large language model with a parameter scale of 13B, providing a quantized version in GGUF format, suitable for various natural language processing tasks.

Large Language Model Supports Multiple Languages#13B parameter count #GGUF quantization #Multilingual support

Downloads 190

Release Time : 5/8/2025

Model Overview

This model is a large language model with 13B parameters, offering multiple quantized versions, suitable for natural language processing tasks such as text generation and dialogue systems.

Model Features

Multiple quantized versions

Provide multiple quantized versions from Q2_K to Q8_0 to meet different hardware and performance requirements.

High-performance inference

The optimized GGUF format supports efficient inference performance.

Wide compatibility

Compatible with llama.cpp and supports multiple hardware platforms.

Model Capabilities

Text generation

Dialogue systems

Natural language understanding

Use Cases

Text generation

Creative writing

Generate creative texts such as stories and poems.

Content summarization

Automatically generate summaries of articles or documents.

Dialogue systems

Intelligent customer service

Used to build an automatically - replying customer service system.

Virtual assistant

Build a personalized virtual assistant.

🚀 Voicelab/trurl-2-13b - GGUF

This repository offers GGUF format model files for Voicelab/trurl-2-13b. The files were quantized using machines provided by TensorBlock, and they are compatible with llama.cpp as of commit b5165.

Feedback and support: TensorBlock's Twitter/X, Telegram Group and Discord server

✨ Features

Our projects

Project	Description	Image	Link
Awesome MCP Servers	A comprehensive collection of Model Context Protocol (MCP) servers.		👀 See what we built 👀
TensorBlock Studio	A lightweight, open, and extensible multi-LLM interaction studio.		👀 See what we built 👀

📚 Documentation

Prompt template

Unable to determine prompt format automatically. Please check the original model repository for the correct prompt format.

Model file specification

Property	Details
Model Type	Voicelab/trurl-2-13b - GGUF
Training Data	Not provided

Filename	Quant type	File Size	Description
trurl-2-13b-Q2_K.gguf	Q2_K	4.854 GB	smallest, significant quality loss - not recommended for most purposes
trurl-2-13b-Q3_K_S.gguf	Q3_K_S	5.659 GB	very small, high quality loss
trurl-2-13b-Q3_K_M.gguf	Q3_K_M	6.338 GB	very small, high quality loss
trurl-2-13b-Q3_K_L.gguf	Q3_K_L	6.930 GB	small, substantial quality loss
trurl-2-13b-Q4_0.gguf	Q4_0	7.366 GB	legacy; small, very high quality loss - prefer using Q3_K_M
trurl-2-13b-Q4_K_S.gguf	Q4_K_S	7.423 GB	small, greater quality loss
trurl-2-13b-Q4_K_M.gguf	Q4_K_M	7.866 GB	medium, balanced quality - recommended
trurl-2-13b-Q5_0.gguf	Q5_0	8.972 GB	legacy; medium, balanced quality - prefer using Q4_K_M
trurl-2-13b-Q5_K_S.gguf	Q5_K_S	8.972 GB	large, low quality loss - recommended
trurl-2-13b-Q5_K_M.gguf	Q5_K_M	9.230 GB	large, very low quality loss - recommended
trurl-2-13b-Q6_K.gguf	Q6_K	10.679 GB	very large, extremely low quality loss
trurl-2-13b-Q8_0.gguf	Q8_0	13.831 GB	very large, extremely low quality loss - not recommended

📦 Installation

Downloading instruction

Command line

Firstly, install Huggingface Client

pip install -U "huggingface_hub[cli]"

Then, download the individual model file to a local directory

huggingface-cli download tensorblock/Voicelab_trurl-2-13b-GGUF --include "trurl-2-13b-Q2_K.gguf" --local-dir MY_LOCAL_DIR

If you want to download multiple model files with a pattern (e.g., *Q4_K*gguf), you can try:

huggingface-cli download tensorblock/Voicelab_trurl-2-13b-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご