đ Merlinoz11/Dans-PersonalityEngine-V1.3.0-24b-Q8_0-GGUF
This model is a text - generation model that has been converted to the GGUF format. It offers multi - language support and can be used in various application scenarios such as role - playing, story - writing, and more.
đ Quick Start
This model was converted to GGUF format from PocketDoc/Dans-PersonalityEngine-V1.3.0-24b
using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
⨠Features
- Multi - language Support: Supports multiple languages including English, Arabic, German, French, Spanish, Hindi, Portuguese, Japanese, and Korean.
- Versatile Applications: Suitable for general - purpose, role - play, story - writing, chemistry, biology, code, climate, and other fields.
đĻ Installation
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
đģ Usage Examples
Use with llama.cpp
CLI
llama-cli --hf-repo Merlinoz11/Dans-PersonalityEngine-V1.3.0-24b-Q8_0-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q8_0.gguf -p "The meaning to life and the universe is"
Server
llama-server --hf-repo Merlinoz11/Dans-PersonalityEngine-V1.3.0-24b-Q8_0-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q8_0.gguf -c 2048
Another way to use
Step 1: Clone llama.cpp from GitHub
git clone https://github.com/ggerganov/llama.cpp
Step 2: Move into the llama.cpp folder and build it
cd llama.cpp && LLAMA_CURL=1 make
Step 3: Run inference through the main binary
./llama-cli --hf-repo Merlinoz11/Dans-PersonalityEngine-V1.3.0-24b-Q8_0-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q8_0.gguf -p "The meaning to life and the universe is"
or
./llama-server --hf-repo Merlinoz11/Dans-PersonalityEngine-V1.3.0-24b-Q8_0-GGUF --hf-file dans-personalityengine-v1.3.0-24b-q8_0.gguf -c 2048
đ Documentation
Model Information
Property |
Details |
Thumbnail |
https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b/resolve/main/resources/pe.png |
License |
apache - 2.0 |
Tags |
general - purpose, roleplay, storywriting, chemistry, biology, code, climate, axolotl, text - generation - inference, finetune, legal, medical, finance, llama - cpp, gguf - my - repo |
Datasets |
PocketDoc/Dans - Prosemaxx - RP, PocketDoc/Dans - Personamaxx - Logs - 2, PocketDoc/Dans - Personamaxx - VN, PocketDoc/Dans - Kinomaxx - VanillaBackrooms, PocketDoc/Dans - Prosemaxx - Gutenberg, PocketDoc/Dans - Prosemaxx - Cowriter - 3 - XL, PocketDoc/Dans - Prosemaxx - Adventure, PocketDoc/Dans - Failuremaxx - Adventure - 3, PocketDoc/Dans - Prosemaxx - InstructWriter - ZeroShot - 2, PocketDoc/Dans - Prosemaxx - InstructWriter - ZeroShot - 3, PocketDoc/Dans - Prosemaxx - InstructWriter - Continue - 2, PocketDoc/Dans - Prosemaxx - Instructwriter - Long, PocketDoc/Dans - Prosemaxx - RepRemover - 1, PocketDoc/Dans - MemoryCore - CoreCurriculum - Small, AquaV/US - Army - Survival - Sharegpt, AquaV/Multi - Environment - Operations - Sharegpt, AquaV/Resistance - Sharegpt, AquaV/Interrogation - Sharegpt, AquaV/Chemical - Biological - Safety - Applications - Sharegpt, AquaV/Energetic - Materials - Sharegpt, PocketDoc/Dans - Mathmaxx, PJMixers/Math - Multiturn - 1K - ShareGPT, PocketDoc/Dans - Taskmaxx, PocketDoc/Dans - Taskmaxx - DataPrepper, PocketDoc/Dans - Taskmaxx - ConcurrentQA - Reworked, PocketDoc/Dans - Taskmaxx - TableGPT, PocketDoc/Dans - Taskmaxx - SciRIFF, PocketDoc/Dans - Taskmaxx - Edit, PocketDoc/Dans - Toolmaxx - Agent, PocketDoc/Dans - Toolmaxx - ShellCommands, PocketDoc/Dans - Toolmaxx - Functions - Toolbench, PocketDoc/Dans - Toolmaxx - Functions - ToolACE, PocketDoc/Dans - Toolmaxx - Functions - apigen - subset, PocketDoc/Dans - Assistantmaxx - OpenAssistant2, PocketDoc/Dans - Assistantmaxx - Opus - Merge - 2, PocketDoc/Dans - Assistantmaxx - sonnetorca - subset, PocketDoc/Dans - Assistantmaxx - sonnetorca - subset - 2, PocketDoc/Dans - Assistantmaxx - Cynthia, PocketDoc/Dans - Assistantmaxx - ASL, PocketDoc/Dans - Assistantmaxx - PersonaLLM - Opus, PocketDoc/Dans - Assistantmaxx - LongAlign, PocketDoc/Dans - Assistantmaxx - OpenLeecher - Instruct, PocketDoc/Dans - Assistantmaxx - Tulu3 - IF, PocketDoc/Dans - Systemmaxx, PocketDoc/Dans - Logicmaxx - SAT - AP, PJMixers/grimulkan_theory - of - mind - ShareGPT, PJMixers/grimulkan_physical - reasoning - ShareGPT, PocketDoc/Dans - Reasoningmaxx - NaturalReasoning, PocketDoc/Dans - Reasoningmaxx - WebInstruct, PocketDoc/Dans - Reasoningmaxx - GeneralReasoning, PocketDoc/Dans - Assistantmaxx - ClosedInstruct |
Language |
en, ar, de, fr, es, hi, pt, ja, ko |
Base Model |
PocketDoc/Dans - PersonalityEngine - V1.3.0 - 24b |
Pipeline Tag |
text - generation |
Library Name |
transformers |
đ License
This model is licensed under the apache - 2.0 license.