đ The-True-Abomination-24B
This is a merged pre - trained language model created using mergekit, aiming to combine the strengths of multiple models for text generation.
đ Quick Start
This model is a merge of pre - trained language models created using mergekit. It can be used for text generation tasks.
⨠Features
đ Merge Details
đ Description
This model is a merge created with the same idea as [Casual - Autopsy/L3 - Super - Nova - RP - 8B](https://huggingface.co/Casual - Autopsy/L3 - Super - Nova - RP - 8B) in mind: compatability with as many SillyTavern features and extensions as possible while still being able to handle itself in roleplay.
Reasoning isn't perfect, but it certainly helps boost the model's capability with legacy reasoning(Status block/thinking box CoT) (Which I honestly prefer over modern reasoning. Less immersion breaking IMO.) Setting max reasoning prompts to 3 or more and/or injecting a CoT formatting prompt is recommended.
âī¸ Merge Method
This model was merged using the SCE, Della, and CABS merge methods using [TheDrummer/Cydonia - 24B - v2](https://huggingface.co/TheDrummer/Cydonia - 24B - v2) as a base.
đ Models Merged
The following models were included in the merge:
- [TheDrummer/Cydonia - 24B - v2](https://huggingface.co/TheDrummer/Cydonia - 24B - v2)
- [ReadyArt/Gaslit - Transgression - 24B - v1.0](https://huggingface.co/ReadyArt/Gaslit - Transgression - 24B - v1.0)
- [ReadyArt/Forgotten - Safeword - 24B - v4.0](https://huggingface.co/ReadyArt/Forgotten - Safeword - 24B - v4.0)
- [ReadyArt/The - Omega - Directive - M - 24B - v1.1](https://huggingface.co/ReadyArt/The - Omega - Directive - M - 24B - v1.1)
- [ReadyArt/Omega - Darker_The - Final - Directive - 24B](https://huggingface.co/ReadyArt/Omega - Darker_The - Final - Directive - 24B)
- [Mawdistical/Mawdistic - NightLife - 24b](https://huggingface.co/Mawdistical/Mawdistic - NightLife - 24b)
- [Undi95/MistralThinker - v1.1](https://huggingface.co/Undi95/MistralThinker - v1.1)
- [cognitivecomputations/Dolphin - Mistral - 24B - Venice - Edition](https://huggingface.co/cognitivecomputations/Dolphin - Mistral - 24B - Venice - Edition)
- [AlexBefest/CardProjector - 24B - v3](https://huggingface.co/AlexBefest/CardProjector - 24B - v3)
- [arcee - ai/Arcee - Blitz](https://huggingface.co/arcee - ai/Arcee - Blitz)
- [TroyDoesAI/BlackSheep - 24B](https://huggingface.co/TroyDoesAI/BlackSheep - 24B)
âī¸ Configuration
The following YAML configurations were used to produce this model:
đ Gaslit - Safeword
models:
- model: TheDrummer/Cydonia-24B-v2
- model: ReadyArt/Forgotten-Safeword-24B-v4.0
parameters:
weight: 0.4
density: 0.35
epsilon: 0.3
- model: ReadyArt/Gaslit-Transgression-24B-v1.0
parameters:
weight: 0.4
density: 0.35
epsilon: 0.3
merge_method: della
base_model: TheDrummer/Cydonia-24B-v2
parameters:
normalize: true
dtype: bfloat16
đ Omega - Duo
models:
- model: TheDrummer/Cydonia-24B-v2
- model: ReadyArt/The-Omega-Directive-M-24B-v1.1
parameters:
weight: 0.4
density: 0.35
epsilon: 0.3
- model: ReadyArt/Omega-Darker_The-Final-Directive-24B
parameters:
weight: 0.4
density: 0.35
epsilon: 0.3
merge_method: della
base_model: TheDrummer/Cydonia-24B-v2
parameters:
normalize: true
dtype: bfloat16
đ SCE - Abomination
models:
- model: TheDrummer/Cydonia-24B-v2
- model: Mawdistical/Mawdistic-NightLife-24b
- model: Gaslit-Safeword
- model: Omega-Duo
merge_method: sce
base_model: TheDrummer/Cydonia-24B-v2
parameters:
select_topk: 0.8
dtype: bfloat16
đ UNC - Reasoning
models:
- model: SCE-Abomination
- model: Undi95/MistralThinker-v1.1
parameters:
weight: 0.6
n_val: 16
m_val: 32
- model: cognitivecomputations/Dolphin-Mistral-24B-Venice-Edition
parameters:
weight: 0.4
n_val: 11
m_val: 33
merge_method: cabs
default_n_val: 8
default_m_val: 32
pruning_order:
- Undi95/MistralThinker-v1.1
- cognitivecomputations/Dolphin-Mistral-24B-Venice-Edition
base_model: SCE-Abomination
dtype: bfloat16
đ INT - Multitasks
models:
- model: SCE-Abomination
- model: AlexBefest/CardProjector-24B-v3
parameters:
weight: 0.6
n_val: 16
m_val: 32
- model: arcee-ai/Arcee-Blitz
parameters:
weight: 0.4
n_val: 11
m_val: 33
merge_method: cabs
default_n_val: 8
default_m_val: 32
pruning_order:
- AlexBefest/CardProjector-24B-v3
- arcee-ai/Arcee-Blitz
base_model: SCE-Abomination
dtype: bfloat16
đ The - True - Abomination - 24B
models:
- model: SCE-Abomination
- model: TroyDoesAI/BlackSheep-24B
- model: UNC-Reasoning
- model: INT-Multitasks
merge_method: sce
base_model: SCE-Abomination
parameters:
select_topk: 0.45
dtype: bfloat16
đ Documentation
đ Model Information
| Property |
Details |
| Base Models |
TheDrummer/Cydonia - 24B - v2, ReadyArt/Gaslit - Transgression - 24B - v1.0, ReadyArt/Forgotten - Safeword - 24B - v4.0, etc. |
| Library Name |
transformers |
| Tags |
mergekit, merge, sce, della, cabs, not - for - all - audiences, rp, roleplay, role - play |
| Language |
en |
| Pipeline Tag |
text - generation |
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Transformers Supports Multiple Languages#Role-Playing Enhancement#Chain Reasoning Optimization#Multi-Model Fusion