Phi 3 Portuguese Tom Cat 4k Instruct Q5 K M GGUF PTBR

🚀 noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF

This model is a conversion to the GGUF format from the original model rhaymison/phi-3-portuguese-tom-cat-4k-instruct. The conversion was carried out using llama.cpp via the ggml.ai's GGUF-my-repo space. For more in - depth details about the model, please refer to the original model card.

✨ Features

• Language Support: Specialized for Portuguese language tasks, including QA and instruction following.
• Base Model: Built upon the microsoft/Phi - 3 - mini - 4k - instruct base model.
• Datasets: Trained on the rhaymison/superset dataset.

📦 Installation

Install llama.cpp

You can install llama.cpp through brew using the following command:

brew install ggerganov/ggerganov/llama.cpp

💻 Usage Examples

CLI Usage

llama-cli --hf-repo noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF --model phi-3-portuguese-tom-cat-4k-instruct.Q5_K_M.gguf -p "The meaning to life and the universe is"

Server Usage

llama-server --hf-repo noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF --model phi-3-portuguese-tom-cat-4k-instruct.Q5_K_M.gguf -c 2048

Alternative Usage

You can also use this checkpoint directly following the usage steps in the Llama.cpp repo:

git clone https://github.com/ggerganov/llama.cpp &&             cd llama.cpp &&             make &&             ./main -m phi-3-portuguese-tom-cat-4k-instruct.Q5_K_M.gguf -n 128

📚 Documentation

Model Information

Performance Results

The model has been evaluated on multiple datasets with the following results:

📄 License

This model is licensed under the Apache 2.0 license.