Cabrallama3 8b

🚀 Cabra Llama-3 8B

The Cabra Llama-3 8B is an enhanced version of the Meta-Llama-3-8B-Instruct, refined using the Cabra 30k dataset. This model is specially optimized to understand and respond in Portuguese.

Try the model on our chat.

Explore our other models and datasets, and the Cabra Llama 3 70b.

📚 Detailed Documentation

Base Model Details

Model: Meta-Llama-3-8B-Instruct

Meta developed and released the Llama 3 family of models, a collection of pre - trained and instruction - tuned text - generation models in sizes of 8B and 70B. The instruction - tuned Llama 3 models are optimized for dialogue use cases and outperform many open - source chat models in common industry benchmarks. Moreover, great care was taken to optimize utility and safety during their development.

Model Architecture: Llama 3 is an auto - regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine - tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for utility and safety.

Dataset: Cabra 30k

It is an internal dataset for fine - tuning. We will release it soon.

Quantization / GGUF

We have placed various quantized versions (GGUF) in the "quantanization" branch.

Example

<s> [INST] Tell me some interesting facts about Brasília. [/INST] 

Brasília is the capital of Brazil and was designed by Brazilian architect Oscar Niemeyer and urban planner Lúcio Costa. Here are some interesting facts about Brasília:

1. Brasília was built in the 1960s. The city was constructed to replace the old capital of Brazil, Rio de Janeiro, which was becoming overcrowded.

2. The architecture of Brasília is unique and is characterized by modernist and abstract forms. The city is divided into two main plans: the pilot plan, which is the central area of the city, and the ground plan, which is the residential area.

3. Brasília is known for its iconic landmarks, such as the Metropolitan Cathedral of Our Lady of Aparecida, the Palácio da Alvorada, and the Palácio do Planalto, which are the workplaces of the President of Brazil.

4. The city is home to the National Stadium Mané Garrincha, which hosts football games and has a capacity of 72,788 spectators. The stadium is named after the famous football player Garrincha, who was born in Brasília.

5. Brasília is a relatively new city and has a population of about 3 million people. Despite being relatively new, the city is known for its vibrant culture and is a center for tourism, business, and politics in Brazil.
</s>

💻 Usage

Currently, the model is intended for research purposes. Possible research areas and tasks include:

• Research on generative models.
• Investigation and understanding of the limitations and biases of generative models.

Commercial use is prohibited. Only for research. Contact us for more information.

Evaluations

📊 Open Portuguese LLM Leaderboard Evaluation Results

Detailed results can be found here and on the 🚀 Open Portuguese LLM Leaderboard

📄 License

This model is released under the cc - by - nc - 2.0 license.