Llama 3 Cantonese 8B Instruct

🚀 Llama-3-Cantonese-8B-Instruct

Llama-3-Cantonese-8B-Instruct is a Cantonese language model based on Meta-Llama-3-8B-Instruct, fine-tuned using LoRA. It enhances Cantonese text generation and comprehension, supporting tasks like dialogue generation, text summarization, and question-answering.

🚀 Quick Start

This section provides a high - level overview of the model. For more detailed usage, please refer to the relevant documentation.

✨ Features

• Base Model: Meta-Llama-3-8B-Instruct
• Fine-tuning Method: LoRA instruction tuning
• Training Steps: 4562 steps
• Primary Language: Cantonese
• Datasets:
  • jed351/cantonese-wikipedia
  • lordjia/Cantonese_English_Translation
• Training Tools: LLaMA-Factory

📚 Documentation

Model Overview

Llama-3-Cantonese-8B-Instruct is a Cantonese language model based on Meta-Llama-3-8B-Instruct, fine-tuned using LoRA. It aims to enhance Cantonese text generation and comprehension capabilities, supporting various tasks such as dialogue generation, text summarization, and question-answering.

Quantized Version

A 4-bit quantized version of this model is also available: llama3-cantonese-8b-instruct-q4_0.gguf.

Alternative Model Recommendations

For alternatives, consider the following models, both fine-tuned by LordJia on Cantonese language tasks:

1. Qwen2-Cantonese-7B-Instruct based on Qwen2-7B-Instruct.
2. Llama-3.1-Cantonese-8B-Instruct based on Meta-Llama-3.1-8B-Instruct.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

📄 License

This model is licensed under the Llama 3 Community License. Please review the terms before use.

👥 Contributors

• LordJia https://ai.chao.cool