Llamaestra 3.2 1B Translation GGUF

🚀 puettmann/LlaMaestra-3.2-1B-Translation - GGUF

This repository provides GGUF format model files for puettmann/LlaMaestra-3.2-1B-Translation. These files are quantized using machines from TensorBlock, and they are compatible with llama.cpp as of commit b4823.

🚀 Quick Start

This section provides an overview of the project and how to get started.

✨ Features

• Translation: Capable of handling translation tasks between English and Italian.
• Text Generation: Supports text generation tasks.
• GGUF Format: Model files are in GGUF format, compatible with llama.cpp.

📦 Installation

Command line

1. Install Huggingface Client:

pip install -U "huggingface_hub[cli]"

2. Download an individual model file to a local directory:

huggingface-cli download tensorblock/LlaMaestra-3.2-1B-Translation-GGUF --include "LlaMaestra-3.2-1B-Translation-Q2_K.gguf" --local-dir MY_LOCAL_DIR

3. If you want to download multiple model files with a pattern (e.g., *Q4_K*gguf), you can try:

huggingface-cli download tensorblock/LlaMaestra-3.2-1B-Translation-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'

📚 Documentation

Our projects

Project	Description	Image	Link
Awesome MCP Servers	A comprehensive collection of Model Context Protocol (MCP) servers.		GitHub
TensorBlock Studio	A lightweight, open, and extensible multi-LLM interaction studio.		GitHub

Prompt template

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

Cutting Knowledge Date: December 2023
Today Date: 06 Mar 2025

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Model file specification

📄 License

The model is under the llama3.2 license.