# imatrix optimization

This is a quantized version of the Austral-70B-Winton model by Delta-Vector. Through quantization technology, it reduces the storage and computational resource requirements of the model while maintaining good performance, making it suitable for scenarios with limited resources.

This is the quantized version of the Qwen3-14B-abliterated model, quantized using llama.cpp's imatrix option, suitable for text generation tasks.

A quantized version based on inclusionAI/Ling-lite, using llama.cpp for imatrix quantization, supporting multiple quantization types to accommodate different hardware requirements.

A quantized version based on the katanemo/Arch-Function-Chat-3B model, quantized using llama.cpp, supporting multiple quantization types, suitable for text generation tasks.