T

Thedrummer Anubis 70B V1.1 GGUF

Developed by bartowski
This is a quantized version of a large language model with 70B parameters, offering multiple quantization levels to meet different hardware requirements
Downloads 246
Release Time : 6/26/2025

Model Overview

This project is a quantized version of TheDrummer's Anubis-70B-v1.1 model, quantized using llama.cpp, aiming to provide model files with different quantization levels to meet the needs of different hardware conditions and usage scenarios.

Model Features

Multiple quantization types
Provide a variety of quantization types, such as Q8_0, Q6_K, Q5_K_M, etc., to adapt to different hardware resources and performance requirements
Online repackaging
Some quantization types support online repackaging, which can automatically optimize the performance of ARM and AVX machines
Specific weight processing
Some quantized models quantize the embedding and output weights to Q8_0 to improve quality

Model Capabilities

Text generation
Dialogue system
Knowledge Q&A

Use Cases

General AI applications
Intelligent dialogue
Can be used to build an intelligent dialogue system
Knowledge Q&A
Can be used to build a knowledge Q&A system
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase