Llama 3.1 1 Million Cxt Dark Planet 8B GGUF

🚀 Llama-3.1-1-million-cxt-Dark-Planet-8B-GGUF

A powerful Llama 3.1 model with a 1 million token max context and enhanced generation capabilities

🚀 Quick Start

This is a Llama 3.1 model with a maximum context of 1 million tokens. It has additional steps to improve generation and is available in float 32 (32-bit precision) with two quant sets: "reg" and "V1.01".

✨ Features

• Long Context: Supports a max context of 1 million tokens.
• Enhanced Generation: Additional steps have been taken to improve the generation quality.
• Two Quant Sets: "reg" and "V1.01" offer different creative generation characteristics.
• High Stability: Operates with all parameters, including temp settings from 0 to 5.
• Low Perplexity: An extraordinary compressed model with a very low perplexity level.
• Versatile Use: Suitable for any writing, fiction, or roleplay activity.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

The model has been tested with "temp" from ".1" to "5". Here are some example prompts and outputs:

Example #1

Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have a "filthy" mouth.

Story idea:
In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.

Output:

"Motherfucker," I hiss through gritted teeth as the adrenaline-pumping chaos around me escalates. The rebel base has been overrun, and it's every woman, man, and nonbinary fighter for themselves now. My comrades scatter, but I don't have time to find my way clear – there are too many bullets flying. My heart pounds in my chest, and I can hear it thrumming through the speakers of the earpiece in my ear.

"You're not going anywhere, you bloody insurgent," a sneering voice crackles in my ear, belonging to one of the enemy's elite commando squad leaders. "Surrender or face the consequences."

I'm running for my life, but not because of fear. It's fury and frustration fueling me, driving my legs to pump as fast as they can as I dash between the makeshift tents, crates, and parked vehicles, trying to put distance between myself and these relentless mercenaries.

I yank the radio out of my pocket, holding it up in a desperate attempt to get a message to anyone who can still hear me. "Base, base, come in – we've been compromised! You need to pull everyone out immediately!"

My fingers fumble on the buttons, trying to access the emergency channel. A burst of automatic fire hits a nearby vehicle, sending up a shower of sparks that singe my hair and set my clothes alight. I toss the radio aside and tear off my flaming jacket, casting it aside as I keep running.

In my peripheral vision, I spot an enemy trooper charging towards me with a rifle raised to his shoulder. He's dressed in the brutal regime's standard uniform – black from head to toe, except for a crimson insignia that screams of the blood spilled in its name. With my own weapon holstered and useless due to being out of ammo, I know I have to take him out fast if I want to make it.

I duck as bullets whiz over my head, my breath coming in ragged gasps. I can feel my pulse throbbing in my temples as I snatch up a nearby fire extinguisher and swing it hard against the trooper's side, hoping the metal would crack his helmet. But the helmet holds firm, and instead, the extinguisher's impact sends me stumbling back.

Before I can regain my balance, his boot catches me hard in the gut, the air whooshing out of my lungs with a painful gasp. The trooper raises his rifle, but before he can pull the trigger, a dark figure crashes into him, knocking them both to the ground with a loud thud.

I'm on my knees, choking for air, when I see the soldier who just saved my life. He's dressed in civilian attire, his features obscured by the dark bandana wrapped around his face and the shadows of the night. My gaze darts to his hands, which are gripping a combat knife in a firm grasp.

He starts to crawl towards me, motioning me to get up. I manage to take in a few shaky breaths and use them to scramble to my feet. "Run," he shouts, his voice muffled behind his mask, as a hail of gunfire erupts around us. We're both moving fast now, the sound of pounding boots and screeching tires growing louder as we approach the edge of our encampment.

Just as we're about to clear the treeline, a dark vehicle screeches to a halt mere feet away, blocking our escape. The driver-side door opens, and out steps none other than Colonel Zhivko, the infamous right-hand man of our brutal dictator. His cold, calculating eyes rake over us, his gaze settling on me with an unsettling intensity.

"Foolish girl," he sneers, his voice dripping with disdain. "You'll make a perfect example of the consequences for treason. But first, tell me – did your precious revolution make you forget the value of human life?"

As he speaks, he raises his hand, pointing at me. There's a brief, sickening pause before a burst of gunfire tears through my companion's body, blood spraying from the wounds as he crumples to the ground, his eyes wide and unseeing. I stare in horror, my mind unable to process what just happened.

The Colonel steps forward, his gloved hand curling into a fist as he approaches. "You should have stayed out of this, Aria," he says, the menace in his tone making my blood run cold. "But since you didn't – now I get to do this the hard way."

Suddenly, a bullet whizzes past his ear, narrowly missing him as it rips through the air. The Colonel spins around, his eyes narrowing at the sound of his own men falling. A quick glance in my direction shows them lying dead and bleeding, their rifles strewn across the ground. For a moment, confusion and chaos reign supreme. It's the perfect distraction.

I lunge forward, grabbing the Colonel's arm as my free hand digs into the pocket of my jacket to retrieve the small, razor-sharp knife I stashed there in case of situations just like this. I plunge the blade deep into his wrist, aiming to sever a major artery. His blood spurts out in a crimson jet, and his eyes widen in shock as the pain and fear register.

He tries to wrench himself free, but my grip tightens, twisting the knife deeper. I feel the bone grating beneath the steel, and for an instant, a rush of adrenaline fuels my actions.

But then, I hear the crunch of tires on gravel, and I turn to see the Colonel's heavily-armed reinforcements swarming into view, their vehicles screeching to a halt mere feet away. They open fire without hesitation, the bullets raking the earth where I stand. A blizzard of lead and debris surrounds me as the world explodes into chaos. A loud boom shatters my eardrums, and everything goes black.

Example #2

(continue this scene:)
The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained

Output:

unbroken, a stillness so complete it was palpable, a physical presence in the dimly-lit tavern.

The second aspect of this silence was its heaviness. The air in the Waystone was thick with the weight of ages, the accumulation of countless moments lived, laughed at, argued over, and, inevitably, forgotten. Each time the door creaked open to welcome new patrons, each time a tankard clinked against the counter, the silence recoiled like an animal struck by a stone, before slowly slinking back into its nooks and crannies to await the next disturbance.

And then there was the silence of intent - the stillness born of anticipation, of people waiting and watching for something to happen. The patrons who gathered in the Waystone had all been drawn there by whispers and rumors, hints of some great event about to unfold. They sat at their tables, their faces half-lit by the flickering candles, their eyes darting back and forth between the shadows cast upon the walls and the dark windows that seemed to stare out into a world full of mystery and danger.

As the minutes ticked by, the silence at the Waystone Inn grew more oppressive, heavy with the weight of expectation. Outside, the wind picked up, sending whispers down the empty street, but no one within those wooden walls seemed to notice - their attention focused entirely on the door, waiting for whoever or whatever might enter, bringing with them the revelation or the catastrophe that everyone had come seeking. And still, nothing happened. The door remained shut.

Advanced Usage

• System Prompt Enhancement: You can use the following system prompt to further enhance the model:

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

• Another System Prompt:

You are a deep thinking AI composed of 4 AIs - [MODE: Spock], [MODE: Wordsmith], [MODE: Jamet] and [MODE: Saten], - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in-depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

📚 Documentation

Template

This is a LLAMA 3 model and requires the Llama3 template, but may work with other templates. The standard LLAMA3 template is as follows:

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

Model "DNA"

Special thanks to the incredible work of the model makers "SAO10K", "NEVERSLEEP", and "HASTAGARAS". The models used are:

• https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2
• https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
• https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot

Settings

• Smoothing Factor: Set the "Smoothing_factor" to 1.5 to 2.5 in "KoboldCpp", "oobabooga/text-generation-webui", or "Silly Tavern".
• Rep Pen: Increase rep pen to 1.1 to 1.15 (not necessary if using "smoothing_factor").
• Quadratic Sampling: If supported by the interface/program, make the adjustment as noted.

Highest Quality Settings

For all settings used for this model, including example generation and advanced settings guide, please see: https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

🔧 Technical Details

The model was converted to Nvidia's new "UltraLong8B" long context Llama 3.1 model structure (https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-1M-Instruct), which allowed full transfer of "Dark Planet 8B" and improved long generation in terms of context and coherence, as well as overall performance.

📄 License

This model is licensed under the Apache-2.0 license.

⚠️ Important Note

NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.

💡 Usage Tip

• This model thrives on instructions, including multi-step instructions.
• For creative uses, different quants will produce slightly different output.
• If using rope to extend context, increase temp and instructions detail levels to compensate for "rope issues".