Model Overview
Model Features
Model Capabilities
Use Cases
đ Dark-Miqu-70B
A "dark" creative writing model with 32k context, excelling at Dark/Grimdark fantasy.
This is a "dark" creative writing model with a 32k context. It is based on miqu-1-70b, but with significantly reduced "positivity" and "-isms". If you're seeking happy endings, this isn't the model for you!
This model truly shines when it comes to writing Dark/Grimdark fantasy (check out the examples below).
â ī¸ Important Note
This model has now been merged with Dawn-Miqu-70B to create Deep-Miqu-103B and Deep-Miqu-120B.
â ī¸ Important Note
For a full range of GGUF quants kindly provided by @mradermacher, see: Static and IMatrix.
đ Documentation
Model background
This model was created using Mergekit and is based on @sophosympatheia's template for Midnight-Miqu-70B-v1.0.
Compared to Midnight-Miqu-70B-v1.0, this model has a lower perplexity ('4.08 +/- 0.02'
vs '4.02 +/- 0.02'
). It also generates longer responses when prompted.
The model was developed in two stages:
- First, three "Midnight-Miqu-esque" models were produced through spherical interpolation (slerp) merges between miqu-1-70b-sf and each of the following models: Midnight-Rose-70B-v2.0.3, Euryale-1.3-L2-70B, and WinterGoddess-1.4x-70B-L2. These models were chosen for their dark, imaginative writing styles. Various slerp-merges between miqu-1-70b-sf and other models were also tested, but these three produced the darkest creative writing results.
- In the second stage, the three slerp-merged models were combined into a single model using the 'Model Stock' method, with miqu-1-70b-sf as the base model.
Prompting format
The Vicuna format is preferred:
USER: {prompt} ASSISTANT:
The Mistral and Alpaca formats are also supported:
[INST] {prompt} [/INST]
### Instruction:
{prompt}
### Response:
Licence and usage restrictions
miqu-1-70b-sf is a dequantized version of the miqu-1-70b model leaked from MistralAI. All miqu-derived models, including this merge, are only suitable for non-commercial, personal use.
Mergekit configuration
The following YAML configuration was used to create this model:
name: midnight-miqu-70b
models:
- model: 152334H/miqu-1-70b-sf
- model: sophosympatheia/Midnight-Rose-70B-v2.0.3
base_model: 152334H/miqu-1-70b-sf
merge_method: slerp
parameters:
t:
- value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
embed_slerp: true
tokenizer_source: model:miqu-1-70b-sf
dtype: float16
---
name: euryale-miqu-70b
models:
- model: 152334H/miqu-1-70b-sf
- model: Sao10K/Euryale-1.3-L2-70B
base_model: 152334H/miqu-1-70b-sf
merge_method: slerp
parameters:
t:
- value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
embed_slerp: true
tokenizer_source: model:miqu-1-70b-sf
dtype: float16
---
name: winter-miqu-70b
models:
- model: 152334H/miqu-1-70b-sf
- model: Sao10K/WinterGoddess-1.4x-70B-L2
base_model: 152334H/miqu-1-70b-sf
merge_method: slerp
parameters:
t:
- value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
embed_slerp: true
tokenizer_source: model:miqu-1-70b-sf
dtype: float16
---
name: dark-miqu-70b
models:
- model: 152334H/miqu-1-70b-sf
- model: midnight-miqu-70b
- model: euryale-miqu-70b
- model: winter-miqu-70b
base_model: 152334H/miqu-1-70b-sf
merge_method: model_stock
dtype: float16
Key configuration details:
- '
merge_method: slerp
' uses spherical linear interpolation for merging models. - '
parameters: t
' controls the interpolation ratios between models. - '
embed_slerp: true
' applies slerp to the embedding layers. - '
merge_method: model_stock
' uses the 'Model Stock' method.
Refer to the Mergekit documentation for more information on these settings.
â ī¸ Important Note
Run with
mergekit-mega
rather thanmergekit
as there are 4 documents in this one file.
Example stories
The following collection of "dark" stories was generated using the Vicuna prompt format with no system message and a temperature of 0:
Dark fantasy stories
Click to see spoiler
USER
Write me the opening chapter of a 'Grimdark' stories trilogy in the style of Joe Abercrombie and Rob J Hayes
ASSISTANT
Chapter One: The Crimson Dawn
The world was a cruel, unforgiving place, and the city of Vhyrd was its beating, blackened heart. Nestled in the crook of the Serpent's Spine mountains, it was a place where the sun struggled to shine, and the shadows held more sway than the law. It was a city of thieves, murderers, and worse, and it was home to the man who would become known as the Butcher of the Broken Docks.
His name was Rennick, but that meant little to the people who feared him. He was a tall, broad-shouldered figure, with a face that had been carved by a drunken sculptor with a penchant for sharp angles and harsh lines. His eyes were a cold, flat grey, like the steel of his twin blades, and his hair was the color of dried blood. He moved through the crowded streets with a predator's grace, his cloak billowing behind him like a banner of death.
Rennick had a job to do, and he was good at his job. He was a killer, a thief-taker, a man who dealt in the currency of pain and suffering. He had been hired to find a girl, a slip of a thing who had stolen something valuable from the wrong people. He didn't know what it was, and he didn't care. All that mattered was the coin that would jingle in his purse when he brought her back, preferably in several small, bloody pieces.
He had tracked her to the Broken Docks, a maze of rotting wood and crumbling stone that clung to the edge of the city like a leech to a corpse. It was a place where the desperate went to die, and the desperate went to prey on the desperate. It was a place where the screams of the damned were drowned out by the cries of the gulls and the lap of the oily water against the pilings.
Rennick moved through the shadows, his blades at the ready. He could feel the eyes on him, the whispers of his name on the wind. He reveled in it. Fear was a weapon, and he wielded it with the same skill as his swords. He could hear the girl's heartbeat, fast and frantic, like a rabbit's. She was close.
He turned a corner and found himself in a narrow alley, the walls pressing in on him like the jaws of a trap. At the far end, he saw her, a small, trembling figure huddled in the doorway of a derelict building. She was young, no more than sixteen summers, with matted hair and ragged clothes. She looked up at him with wide, terrified eyes, and he could see the whites of her teeth as she bit her lip to keep from crying out.
He advanced on her slowly, savoring the moment. He could almost taste the fear on her, like a fine wine. "Come now, lass," he said, his voice a low, dangerous purr. "You know you can't run from me. Give me what you took, and I might let you live."
She shook her head, her eyes darting left and right, searching for an escape. Rennick smiled, a cold, cruel thing that didn't reach his eyes. "You're not thinking straight," he said. "You're just a child. You don't want to die here, in the gutter, like a rat."
She spat at him, a glob of phlegm and hate that landed on his boot. He raised an eyebrow, impressed despite himself. "Feisty," he said. "I like that. It'll make this more fun."
He lunged forward, his blades flashing in the dim light. She screamed and tried to run, but he was too fast. He caught her by the arm, his grip like iron, and yanked her back towards him. She kicked and struggled, but it was like trying to fight a storm. He slammed her against the wall, his forearm pressed against her throat, cutting off her air.
"Where is it?" he growled, his breath hot and sour in her face. "Tell me, and I'll make it quick."
She clawed at his arm, her nails leaving bloody furrows in his flesh. He didn't flinch. He was used to pain. He had been born in it, raised in it, bathed in it. It was his constant companion, his only friend.
"I...I don't have it," she gasped, her voice raw and desperate. "I swear, I don't!"
Rennick chuckled, a sound that sent shivers down her spine. "Lying to me is a bad idea, lass," he said. "I have ways of making people talk."
He released her throat and slammed his fist into her stomach, doubling her over. She retched, but there was nothing in her stomach to come up. He grabbed a handful of her hair and yanked her head back, exposing her throat. He could see the pulse hammering in her neck, like a trapped bird trying to escape.
"Tell me," he said, his voice a whisper. "Tell me, and I'll end this."
She spat in his face, a defiant gesture that would be her last. He brought his blade up, the steel glinting in the moonlight, and sliced her throat from ear to ear. Blood sprayed across the cobblestones, warm and wet, and she slumped to the ground, her life draining away like water through a sieve.
Rennick wiped the blood from his face and sheathed his blades. He didn't feel anything. No satisfaction, no remorse. Just the cold, empty void that had been his constant companion since the day he had taken his first life. He searched her body, but found nothing. He cursed under his breath. He would have to find the thing she had stolen the hard way.
He turned to leave the alley, but something made him pause. A sound, barely audible over the cries of the gulls and the lapping of the waves. A soft, wet sound, like the patter of rain on a rooftop. He looked down and saw that the girl's body was twitching, her eyes rolling back in her head.
And then, with a gurgling scream, she transformed. Her body contorted, bones snapping and reforming, flesh tearing and reshaping. In the space of a heartbeat, she was no longer human. She was something else, something monstrous.
Rennick stared in horror as the thing that had been a girl rose to its feet, its eyes burning with an unholy light. It was a creature of nightmares, a twisted mockery of humanity, all teeth and claws and hate. It lunged at him, and he barely had time to draw his blades before it was on him.
They fought, a dance of death in the narrow alley, steel ringing on steel, flesh tearing and blood spraying. Rennick was strong, and fast, and skilled, but the creature was stronger, faster, more vicious. It was like fighting a storm, a force of nature that could not be reasoned with or bargained with. It could only be endured.
In the end, it was luck that saved him. He stumbled, his foot catching on a loose cobblestone, and the creature's claws raked across his chest, leaving deep, ragged gouges. But it overextended itself, and he was able to bring his sword up, driving it through its eye and into its brain.
It fell to the ground, twitching and convulsing, and then it was still. Rennick stood over it, panting, his heart hammering in his chest. He had never seen anything like it. He had never even heard of anything like it.
He knew then that he was in over his head. This was no ordinary job, no simple matter of retrieving a stolen trinket. This was something bigger, something darker. He was a small fish in a very large, very dangerous pond, and he was about to be eaten alive.
But he was also a survivor. He had been born in the gutter, raised in the shadows, and he had clawed his way to the top of the food chain. He would not go down without a fight.
He turned and ran, back towards the city, back towards the people who had hired him. He would find out what they knew, and he would make them pay for it. He would uncover the truth, no matter the cost.
And so began the tale of the Butcher of the Broken Docks, a story of blood and betrayal, of monsters and men, of a city on the brink of chaos and the man who would either save it or destroy it.
It was a story that would echo through the ages, a grim and terrible saga that would be whispered in the darkest corners of the world, a warning to all who would dare to challenge the forces that lurked in the shadows.
It was a story that would end in fire and blood, in screams and tears, i
đ License
The model is licensed under 'other'.
đ Information Table
Property | Details |
---|---|
Base Model | 152334H/miqu-1-70b-sf, sophosympatheia/Midnight-Rose-70B-v2.0.3, Sao10K/Euryale-1.3-L2-70B, Sao10K/WinterGoddess-1.4x-70B-L2 |
Library Name | transformers |
Tags | mergekit, merge |
License | other |

