Arabic Orpo Llama 3 8B Instruct

🚀 Arabic ORPO LLAMA 3

This is a fine - tuned version of Meta - Llama - 3 - 8B - Instruct, aiming to better generate Arabic text and provide more accurate language support for Arabic users.

🚀 Quick Start

This model is the a finetuned version of meta-llama/Meta-Llama-3-8B-Instruct using ORPO on 2A2I/argilla-dpo-mix-7k-arabic.

I wanted to try ORPO and see if it will better align a biased English model like llama3 to the arabic language or it will faill.

While the evaluations favour the base llama3 over my finetune, in practice i found my finetune was much better at spitting coherent (mostly correct) arabic text which i find interesting.

I would encourage everyone to try out the model from here and share his insights with me ^^

✨ Features

• Fine - tuned for Arabic: Based on the Meta - Llama - 3 - 8B - Instruct model, it is fine - tuned on Arabic datasets to better adapt to the Arabic language.
• Practical Performance: Although the evaluation results may not be as good as the base model in some aspects, it performs better in generating coherent Arabic text in practical applications.

📚 Documentation

🤔 Evaluation and Results

This result was made using lighteval with the community|arabic_mmlu tasks.

📄 License

The license of this model is llama3.