🚀 Language Model Merge Project
This project involves merging pre - trained language models using the mergekit tool, offering a new combined model with enhanced capabilities.
🚀 Quick Start
This is a merge of pre - trained language models created using mergekit.
✨ Features
Merge Details
Merge Method
This model was merged using the Model Stock merge method using [Nitral - AI/Captain - Eris_Violet - GRPO - v0.420](https://huggingface.co/Nitral - AI/Captain - Eris_Violet - GRPO - v0.420) as a base.
Models Merged
The following models were included in the merge:
- [ChaoticNeutrals/Captain - Eris_Violet_Toxic - Magnum - 12B](https://huggingface.co/ChaoticNeutrals/Captain - Eris_Violet_Toxic - Magnum - 12B)
- [kainatq/Kaiden - Sakura - Violet - Square - Azura - crimson - 12B](https://huggingface.co/kainatq/Kaiden - Sakura - Violet - Square - Azura - crimson - 12B)
- [grimjim/Magnolia - v3 - 12B](https://huggingface.co/grimjim/Magnolia - v3 - 12B)
- [inflatebot/MN - 12B - Mag - Mell - R1](https://huggingface.co/inflatebot/MN - 12B - Mag - Mell - R1)
- [Nitral - AI/Captain - Eris - BMO_Violent - GRPO - v0.420](https://huggingface.co/Nitral - AI/Captain - Eris - BMO_Violent - GRPO - v0.420)
- [nbeerbower/Lyra - Gutenberg - mistral - nemo - 12B](https://huggingface.co/nbeerbower/Lyra - Gutenberg - mistral - nemo - 12B)
- [Nitral - AI/Wayfarer_Eris_Noctis - 12B](https://huggingface.co/Nitral - AI/Wayfarer_Eris_Noctis - 12B)
Configuration
The following YAML configuration was used to produce this model:
merge_method: model_stock
base_model: Nitral-AI/Captain-Eris_Violet-GRPO-v0.420
parameters:
models:
- model: ChaoticNeutrals/Captain-Eris_Violet_Toxic-Magnum-12B
- model: nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
- model: kainatq/Kaiden-Sakura-Violet-Square-Azura-crimson-12B
- model: grimjim/Magnolia-v3-12B
- model: inflatebot/MN-12B-Mag-Mell-R1
- model: Nitral-AI/Captain-Eris-BMO_Violent-GRPO-v0.420
- model: Nitral-AI/Wayfarer_Eris_Noctis-12B
dtype: bfloat16
Property |
Details |
Base Model |
ChaoticNeutrals/Captain - Eris_Violet_Toxic - Magnum - 12B, kainatq/Kaiden - Sakura - Violet - Square - Azura - crimson - 12B, grimjim/Magnolia - v3 - 12B, Nitral - AI/Captain - Eris_Violet - GRPO - v0.420, inflatebot/MN - 12B - Mag - Mell - R1, Nitral - AI/Captain - Eris - BMO_Violent - GRPO - v0.420, nbeerbower/Lyra - Gutenberg - mistral - nemo - 12B, Nitral - AI/Wayfarer_Eris_Noctis - 12B |
Library Name |
transformers |
Tags |
mergekit, merge |