đ UniReason-Qwen3-14B-RL Quantized Model
This project provides quantized versions of the UniReason-Qwen3-14B-RL model, which is useful for text generation, math reasoning, and research purposes. It offers various quantization types with different sizes and qualities to meet diverse user needs.
đ Quick Start
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
⨠Features
- Quantized Model: Offers weighted/imatrix quants of the UniReason-Qwen3-14B-RL model.
- Multiple Quantization Types: Provides a wide range of quantization types with different sizes and qualities.
- Research Oriented: Suitable for research in text generation, math reasoning, and transferability.
đĻ Information
đ Documentation
About
Weighted/imatrix quants of https://huggingface.co/ReasoningTransferability/UniReason-Qwen3-14B-RL. Static quants are available at https://huggingface.co/mradermacher/UniReason-Qwen3-14B-RL-GGUF.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Link |
Type |
Size/GB |
Notes |
GGUF |
i1-IQ1_S |
3.7 |
for the desperate |
GGUF |
i1-IQ1_M |
3.9 |
mostly desperate |
GGUF |
i1-IQ2_XXS |
4.4 |
|
GGUF |
i1-IQ2_XS |
4.8 |
|
GGUF |
i1-IQ2_S |
5.1 |
|
GGUF |
i1-IQ2_M |
5.4 |
|
GGUF |
i1-Q2_K_S |
5.5 |
very low quality |
GGUF |
i1-Q2_K |
5.9 |
IQ3_XXS probably better |
GGUF |
i1-IQ3_XXS |
6.0 |
lower quality |
GGUF |
i1-IQ3_XS |
6.5 |
|
GGUF |
i1-Q3_K_S |
6.8 |
IQ3_XS probably better |
GGUF |
i1-IQ3_S |
6.8 |
beats Q3_K* |
GGUF |
i1-IQ3_M |
7.0 |
|
GGUF |
i1-Q3_K_M |
7.4 |
IQ3_S probably better |
GGUF |
i1-Q3_K_L |
8.0 |
IQ3_M probably better |
GGUF |
i1-IQ4_XS |
8.2 |
|
GGUF |
i1-IQ4_NL |
8.6 |
prefer IQ4_XS |
GGUF |
i1-Q4_0 |
8.6 |
fast, low quality |
GGUF |
i1-Q4_K_S |
8.7 |
optimal size/speed/quality |
GGUF |
i1-Q4_K_M |
9.1 |
fast, recommended |
GGUF |
i1-Q4_1 |
9.5 |
|
GGUF |
i1-Q5_K_S |
10.4 |
|
GGUF |
i1-Q5_K_M |
10.6 |
|
GGUF |
i1-Q6_K |
12.2 |
practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
đ License
This project is licensed under the apache-2.0 license.
đ Thanks
I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.