Phi 3 Mini 4k Instruct Bnb 4bit

🚀 Phi-3-mini-4k-instruct - bnb 4bit

This project offers a 4-bit quantized version of the Phi-3-mini-4k-instruct model, facilitating fine-tuning and enhancing efficiency.

🚀 Quick Start

This model is a great choice for those looking to fine-tune a pre-trained language model. It provides a 4-bit quantized version of the original Phi-3-mini-4k-instruct using bitsandbytes.

✨ Features

• Quantized Model: A 4-bit quantized version of the original model, which can potentially reduce memory usage and speed up inference.
• Fine-tuning Ready: Specifically designed for fine-tuning tasks.
• PAD Token Setting: The PAD token is set as "<|endoftext|>".

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

No code examples are provided in the original document.

📚 Documentation

Model Information

Description

This model is 4bit quantized version of Phi-3-mini-4k-instruct using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".

🔧 Technical Details

No technical details are provided in the original document.

📄 License

This model is licensed under the MIT License.