Meta Llama 3 8B Instruct Hf AWQ

🚀 Undi95/Meta-Llama-3-8B-hf AWQ

This is a quantized version of the Meta-Llama-3-8B model, optimized for efficient deployment and inference.

🚀 Quick Start

This model is a quantized version of the Meta-Llama-3-8B-instruct-hf. It is designed for text generation tasks.

✨ Features

Model Information

Model Summary

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, great care was taken to optimize helpfulness and safety.

• Model developers: Meta
• Variations: Llama 3 comes in two sizes — 8B and 70B parameters — in pre-trained and instruction tuned variants.
• Input: Models input text only.
• Output: Models generate text and code only.
• Model Architecture: Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.

Citation

@article{llama3modelcard,
  title={Llama 3 Model Card},
  author={AI@Meta},
  year={2024},
  url = {https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md}
}