M

Mlabonne Qwen3 0.6B Abliterated GGUF

Developed by bartowski
This is a quantized version based on the Qwen3-0.6B-abliterated model, using llama.cpp for quantization, suitable for text generation tasks.
Downloads 1,455
Release Time : 4/30/2025

Model Overview

This model is a quantized version of Qwen3-0.6B-abliterated, supporting multiple quantization types, suitable for running text generation tasks on resource-limited devices.

Model Features

Multiple quantization options
Offers various quantization types from BF16 to Q2_K, meeting different hardware and performance needs.
Imatrix quantization
Uses imatrix option for quantization, enhancing model performance.
Supports ARM/AVX
Supports online repacking for ARM and AVX CPU inference, optimizing performance.

Model Capabilities

Text generation
Multi-turn dialogue
System prompt support

Use Cases

Chatbot
Multi-turn dialogue
Supports multi-turn dialogue, suitable for building chatbots.
Text generation
Content creation
Can be used to generate articles, stories, and other textual content.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase