M

Mlabonne Qwen3 4B Abliterated GGUF

Developed by bartowski
Quantized version of Qwen3-4B-abliterated, quantized using llama.cpp, supports multiple quantization types, suitable for text generation tasks.
Downloads 3,623
Release Time : 4/29/2025

Model Overview

This is a quantized version based on the Qwen3-4B-abliterated model, quantized using the llama.cpp tool, supporting multiple quantization types and suitable for text generation tasks. The model can run in environments such as LM Studio and llama.cpp.

Model Features

Multiple Quantization Options
Offers various quantization types from BF16 to Q2_K to meet different hardware and performance needs.
imatrix Quantization
Uses the imatrix option for quantization to enhance model performance.
Broad Compatibility
Supports running in various environments such as LM Studio and llama.cpp.
Embedding/Output Weight Optimization
Certain quantization types include special optimizations for embedding and output weights to improve performance.

Model Capabilities

Text Generation
Multi-turn Dialogue
Supports System Prompts

Use Cases

Text Generation
Dialogue System
Can be used to build multi-turn dialogue systems, supporting system prompts and user input.
Content Creation
Generates articles, stories, and other textual content.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase