# Efficient 4-bit quantization

Zephyr 7B Beta is a 7B parameter model based on the Mistral architecture of Hugging Face H4. It is optimized through AWQ quantization and suitable for efficient inference tasks.