LongWriter-Zero-32B-GGUF Open-source Multilingual Model - Free Deployment to Support Long-text Writing and Reinforcement Learning

Longwriter Zero 32B GGUF

Developed by mradermacher

The LongWriter-Zero-32B Quantized Model is a multilingual model that undergoes static quantization based on the original model. It is suitable for long context scenarios such as reinforcement learning and writing.

Large Language Model

Transformers

Supports Multiple LanguagesOpen Source License:Apache-2.0 #Long context processing #Multilingual writing #Reinforcement learning optimization

Downloads 204

Release Time : 6/21/2025

Model Overview

This model offers multiple quantized versions and supports English and Chinese. It is particularly suitable for handling long texts and reinforcement learning tasks.

Model Features

Multilingual support

Supports both English and Chinese.

Multi-version quantization

Provides multiple quantized versions of different types and sizes for selection to meet different needs.

Long context processing

Particularly suitable for handling long texts and reinforcement learning tasks.

Model Capabilities

Text generation

Long context processing

Multilingual support

Use Cases

Writing

Long-form writing

Suitable for generating long articles or stories.

Reinforcement learning

Reinforcement learning tasks

Can be used for text generation tasks related to reinforcement learning.

🚀 LongWriter-Zero-32B Quantized Model

This is a quantized version of the LongWriter-Zero-32B model, offering various quantization options for different usage scenarios.

🚀 Quick Start

This README provides detailed information about the quantized version of the LongWriter-Zero-32B model, including usage instructions, available quantization types, and frequently asked questions.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

📚 Documentation

About

This is a static quantization of the model from https://huggingface.co/THU-KEG/LongWriter-Zero-32B. Weighted/imatrix quants are available at https://huggingface.co/mradermacher/LongWriter-Zero-32B-i1-GGUF.

Provided Quants

(sorted by size, not necessarily quality. IQ - quants are often preferable over similar sized non - IQ quants)

Link	Type	Size/GB	Notes
GGUF	Q2_K	12.4
GGUF	Q3_K_S	14.5
GGUF	Q3_K_M	16.0	lower quality
GGUF	Q3_K_L	17.3
GGUF	IQ4_XS	18.0
GGUF	Q4_K_S	18.9	fast, recommended
GGUF	Q4_K_M	20.0	fast, recommended
GGUF	Q5_K_S	22.7
GGUF	Q5_K_M	23.4
GGUF	Q6_K	27.0	very good quality
GGUF	Q8_0	34.9	fast, best quality

Here is a handy graph by ikawrakow comparing some lower - quality quant types (lower is better):

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.

📄 License

This project is licensed under the apache-2.0 license.

📋 Information Table

Property	Details
Base Model	THU - KEG/LongWriter - Zero - 32B
Datasets	THU - KEG/LongWriter - Zero - RLData
Languages	en, zh
Library Name	transformers
License	apache - 2.0
Quantized By	mradermacher
Tags	reinforcement - learning, writing, Long Context

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご