Mistral Portuguese Luana 7b Mental Health Q5 K M GGUF PTBR

🚀 noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF

This model is a conversion of the original rhaymison/Mistral-portuguese-luana-7b-mental-health into the GGUF format. The conversion was carried out using llama.cpp via the ggml.ai's GGUF-my-repo space. For more in - depth details about the model, please refer to the original model card.

🚀 Quick Start

✨ Features

• Converted to GGUF format for compatibility with llama.cpp.
• Applicable in text - generation tasks, especially in the health domain with Portuguese language support.

📦 Installation

Install llama.cpp through brew:

brew install ggerganov/ggerganov/llama.cpp

💻 Usage Examples

Basic Usage

You can use the model via the CLI:

llama-cli --hf-repo noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF --model mistral-portuguese-luana-7b-mental-health.Q5_K_M.gguf -p "The meaning to life and the universe is"

Advanced Usage

Run the model using the server:

llama-server --hf-repo noxinc/Mistral-portuguese-luana-7b-mental-health-Q5_K_M-GGUF --model mistral-portuguese-luana-7b-mental-health.Q5_K_M.gguf -c 2048

You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo:

git clone https://github.com/ggerganov/llama.cpp &&             cd llama.cpp &&             make &&             ./main -m mistral-portuguese-luana-7b-mental-health.Q5_K_M.gguf -n 128

📚 Documentation

Model Information

Model Performance

The model has been evaluated on multiple datasets for text - generation tasks:

📄 License

This model is released under the Apache - 2.0 license.