Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF Open-source Model - Supports Role-playing Conversations in 10 Languages

Dans PersonalityEngine V1.3.0 24b Q4 K M GGUF

Developed by King-Cane

A multilingual text generation model based on Mistral-Small-3.1-24B-Base-2503, supporting 10 languages, suitable for role-playing and dialogue scenarios

Large Language Model

Transformers

Open Source License:Apache-2.0 #Multilingual text generation #Support for ultra-long contexts #Optimized role-playing

Downloads 596

Release Time : 5/23/2025

Model Overview

This is a GGUF format model converted from PocketDoc/Dans-PersonalityEngine-V1.3.0-24b, focusing on text generation tasks, especially suitable for role-playing and personalized dialogue scenarios

Model Features

Multilingual support

Supports text generation in 10 languages, including major languages such as Chinese, English, and Japanese

Long context processing

Supports a context length of 32,768 tokens and still maintains a certain recall rate at 131,072 tokens

Optimized role-playing

Specifically optimized for role-playing scenarios, using the 'DanChat - 2' prompt format

Model Capabilities

Multilingual text generation

Role-playing dialogue

Long text processing

Personalized response generation

Use Cases

Dialogue system

Role-playing chatbot

Create a dialogue bot with a specific personality

Can generate natural dialogues that match the character settings

Content creation

Multilingual story generation

Generate coherent story content in different languages

Supports creative writing in multiple languages

🚀 King-Cane/Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF

This model is a text - generation model converted to GGUF format. It offers multilingual support and can be used for various tasks such as general - purpose, role - play, and story - writing.

🚀 Quick Start

This model was converted to GGUF format from PocketDoc/Dans-PersonalityEngine-V1.3.0-24b using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

✨ Features

Multilingual Support: Supports multiple languages including English, Arabic, German, French, Spanish, Hindi, Portuguese, Japanese, and Korean.
Diverse Applications: Suitable for general - purpose, role - play, story - writing, chemistry, biology, code, climate, and many other fields.

📦 Installation

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

💻 Usage Examples

Invoke through CLI

llama-cli --hf-repo King-Cane/Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q4_k_m.gguf -p "The meaning to life and the universe is"

Invoke through Server

llama-server --hf-repo King-Cane/Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q4_k_m.gguf -c 2048

Another way to use

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL = 1 flag along with other hardware - specific flags (for ex: LLAMA_CUDA = 1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL = 1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo King-Cane/Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q4_k_m.gguf -p "The meaning to life and the universe is"

./llama-server --hf-repo King-Cane/Dans-PersonalityEngine-V1.3.0-24b-Q4_K_M-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q4_k_m.gguf -c 2048

📚 Documentation

Multilingual Support

Languages
Arabic	Chinese	English	French	German
Hindi	Japanese	Korean	Portuguese	Spanish

Key Details

Property	Details
BASE MODEL	mistralai/Mistral - Small - 3.1 - 24B - Base - 2503
LICENSE	apache - 2.0
LANGUAGE	Multilingual with 10 supported languages
CONTEXT LENGTH	32768 tokens, 131072 with degraded recall

Recommended Settings

Parameter	Value
TEMPERATURE	1.0
TOP_P	0.9

Prompting Format

The model uses the following format refered to as "DanChat - 2"

📄 License

This model is released under the apache - 2.0 license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご