Air Striker Mixtral 8x7B Instruct ZLoss 3.75bpw H6 Exl2
An experimental model fine-tuned based on Mixtral-8x7B-v0.1 with merged capabilities, supporting 8K context length and using ChatML prompt format
Downloads 49
Release Time : 1/12/2024
Model Overview
This model is created by fine-tuning Mixtral-8x7B-v0.1 with the airoboros-3.2 dataset and then merging it with Mixtral-8x7B-Instruct-v0.1, suitable for text generation tasks
Model Features
Hybrid model
Combines the strengths of the fine-tuned Mixtral-8x7B and the original Instruct version
Long context support
Supports processing of up to 8K context length
ChatML format
Uses ChatML prompt format, ideal for dialogue scenarios
Model Capabilities
Text generation
Dialogue systems
Instruction following
Use Cases
Dialogue systems
Intelligent assistant
Can be used as an intelligent conversational assistant
Content generation
Creative writing
Generates creative content such as stories and poems
Featured Recommended AI Models