# GGUF efficient inference

This model is a fine-tuned version of google/gemma-2-9b-it for function calling tasks, with training data entirely manually annotated using the Russian version of the DiTy/function-calling dataset.

This is a GGUF format model converted from the canopylabs/3b-de-ft-research_release model, specifically optimized for German text processing.

This is a GGUF-format model converted from the slim-orpheus-3b-JAPANESE-ft model, specifically optimized for Japanese text processing.

This model is a GGUF format version converted from NVIDIA's Llama-3_3-Nemotron-Super-49B-v1, suitable for text generation tasks.

Qwen2.5-VL-32B-Instruct is a 32B-parameter multimodal vision-language model that supports joint understanding and generation tasks for images and text.

This model is a quantized version converted from google-t5/t5-small to GGUF format using llama.cpp via ggml.ai's GGUF-my-repo space.

This is a mental health counseling dialogue model fine-tuned based on the Mistral-7B-Instruct-v0.2 model, offering multiple quantized versions to suit different needs.

This model is a quantized version converted from google-t5/t5-small to GGUF format using llama.cpp via ggml.ai's GGUF-my-repo space.

This model is a GGUF format conversion of DISLab/SummLlama3-8B, suitable for text summarization tasks.

This is a GGUF format text generation model converted from the CoForAI/c4ai-command-r-08-2024 model, supporting multiple languages.

GGUF quantized version of Meta-Llama-3-8B-Instruct, suitable for local deployment and inference

TinyLLama-v0 is a lightweight language model provided in GGUF format, suitable for text generation tasks.

This is an experimental weighted fusion model of Pygmalion-2-13b and SuperCOT, supporting instruction-based interaction and suitable for text generation tasks.