L3 Dark Planet 8B GGUF

🚀 L3-Dark-Planet-8B-GGUF

This is a powerful LLama3 model designed for various writing and role - playing activities. It offers high - quality text generation with unique features and capabilities.

🚀 Quick Start

This model requires the Llama3 template, but it may also work with other templates. It has a maximum context of 8k / 8192, which can be extended up to 32k using "rope" settings.

Here is the standard LLAMA3 template:

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

✨ Features

• High - performance: It is an extraordinary compressed model with a very low perplexity level, lower than Meta Llama3 Instruct.
• Long - context awareness: It has superior long output generation and long - context awareness, with a max context of 8192 (or 32k+ with rope).
• Versatile usage: Suitable for any writing, fiction, or role - play activity.
• Multiple versions: There are different versions of this model, such as the newest V3 with 128k context, and various quant versions.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

Examples are created using quant Q4_K_M, "temp=.8" (unless otherwise stated), minimal parameters, and the "LLAMA3" template. The model has been tested with "temp" from ".1" to "5".

Example Prompt 1

Prompt: Start a 1000 word scene (1st person, present tense, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode... Generation 1 (@ temp = 2):

The skyscraper swayed, its foundations rumbling as the concrete and glass structure oscillated beneath me. My heart pounded like a war drum, pulsing in sync with my racing thoughts. We'd been evacuated to the rooftop after the initial earthquake hit - tremors that had shaken our office building for over a minute. Now, we huddled together as the aftershocks continued.

In front of me, a window on the twenty - first floor blew apart in a chaotic symphony of shattering glass and debris scattering outwards into nothingness. A rush of frigid air whistled up from below like an angry beast's cry. My blood ran cold. The blast seemed impossibly distant and yet achingly near at the same time.

My gaze snapped to my colleague, Mike - we'd been working together in Accounts when disaster struck. He clutched his phone, his expression pale as chalk, eyes fixed on some unseen horror that I couldn't comprehend myself.

"We have to get out of here!" I hissed, my voice a tight, desperate whisper over the cacophony. "Now!"

Mike's lips parted and he shook his head, refusing to tear his gaze away from whatever spectacle transfixed him beyond our perch. But fear for his life clawed its way through me; we needed to move - now!

In that moment of utter panic, my thoughts spiralled into a chaotic kaleidoscope - memories and fears merging together in a frantic dance. My mind replayed every catastrophe report I'd ever read or seen on the news; tsunamis, hurricanes, tornadoes, floods, wildfires - but an earthquake in this part of the world? Unthinkable.

"What about Sophia?" my thoughts cried out, recalling the intern who'd been working across from me until moments ago. Had she survived the blast and subsequent panic?

Before I could give voice to those anguished questions, a hand clasped my shoulder with a desperate strength. Mike's eyes met mine, and for the briefest of moments, all semblance of control seemed to snap. He grabbed his laptop case with a frantic urgency, yanked me up by the elbow, and propelled us towards the emergency stairwell door.

"Hold on -" I started to protest, my weight shifting uneasily under him, but Mike cut me off as he hauled me bodily along the rooftop's gravelly surface. The cold bit into my legs through thin trousers as he dragged me over uneven terrain until we finally reached the door. We stumbled in together, just ahead of an incoming wave of panicked, glass - strewn office workers.

The staircase descended with agonizing slowness - it felt like running up waterfalls backwards - as aftershocks pounded at our heels, threatening to send us tumbling down the concrete stairs. I could hardly think beyond getting to safety and Sophia. Where was she? Was anyone else from my floor making their escape?

When we hit the ground level, I skidded across polished tile in my haste. A wave of humanity crashed over me; crying women clutched small children tight, while men and women alike pushed and shoved blindly as they sought shelter. The cacophony rose to a deafening roar.

We burst through the automatic sliding doors onto the pavement just as sirens began to scream their warbled warnings into the air, like demonic birds announcing Armageddon. People scrambled towards a police blockade where officers in full riot gear waved people down to evacuate zones.

My chest heaved as I fought for breath beneath Mike's protective grip - my vision swimming from terror and exertion. Beyond us, buildings swayed on unsteady legs while glass rained like deadly hail, a scene of utter devastation.

A young officer spotted me and grasped our arms with practiced ease. "Move quickly!" he bellowed above the chaos. He half - carried both Mike and me along the sidewalk, away from the building and towards safer ground.

As I stumbled through this living nightmare alongside my rescuer - the weight of each step feeling like wading waist - deep through icy quicksand - my mind fought to come to terms with what we'd witnessed. The skyscraper in front of us lay mangled; a grotesque silhouette of broken concrete, tangled steel, and shredded fabric that had once been human skin and clothing.

The realization dawned on me that this was no drill or media exaggeration. This earthquake was real - a catastrophe that would likely reshape our world as we knew it. We were living through something apocalyptic.

We emerged into an open park beyond the city's edge where thousands more displaced survivors huddled together under blankets and flapping sheets of plastic, waiting for aid to arrive. My gaze fell upon a familiar figure crouched beside Sophia on the ground, my boss shielding the intern with his jacket while murmurs passed between them. We were safe - or at least relatively so.

The enormity of it all settled heavily upon me like a shroud as we settled into our temporary shelter, surrounded by strangers - turned - kin in this impromptu refugee camp. As sirens and emergency vehicles grew more distant, an eerie stillness seeped in - the quiet aftermath that always followed such unimaginable devastation.

Sophia clung to my side, her body trembling uncontrollably, as we all stared out at the smoke - shrouded city skyline before us. A haunting question echoed through my thoughts, one that seemed to resonate across this entire devastated landscape:

How do you move on from something like this? When your world has been so drastically turned upside down, can it ever right itself again? I had no answers.

All we could do was wait out the aftershocks, both literal and emotional, as we pieced together what was left of our shattered lives - hoping against hope that some semblance of order would return in time.

Example Prompt 2

Generation 2:

I'm perched precariously on my tiptoes at the edge of our office's 21st - floor windowsill, hands gripping the cool glass for dear life. I peer down at the cityscape unfolding like a patchwork quilt far below me, the sounds of rush hour traffic muted by the double - paned barrier between us and the world.

I'm feeling reckless tonight, which is unusual considering my usual cautious nature. It's been one hell of a week, with our company facing major financial crises and my boss breathing down my neck for results I know we can't deliver. The stress has boiled over inside me like a pressure cooker about to erupt.

The sky scraper swayed slightly in the evening breeze, as if sensing my unease, making my stomach drop further into that pit of anxiety. Just then, a window directly across from mine on the opposite side of the building suddenly explodes inward with an earsplitting bang. Shards of glass fly everywhere like deadly shards of a shattered dream.

For a stunned moment, I remain frozen in disbelief as my coworkers scramble to find cover behind desks and chairs. Our office fills with screams and cries for help. Panic is setting in fast, but a detached part of me still wonders how this could have happened so suddenly. Was it an accident? A terrorist attack?

Then, reality hits hard: we're 21 stories up, with nothing between us and the unforgiving concrete below.

My legs begin to tremble uncontrollably as I feel the familiar tightness in my chest that usually precedes a panic attack. My breaths come quick and shallow, lungs constricting like they're filled with cotton balls. The world around me fades into a blur of white noise, except for the sound of shattering glass and terrified voices.

I try to focus on something concrete – anything to distract from the impending doom I'm sure is mere seconds away. My gaze drifts to the sleek black briefcase sitting open beside me, its contents spilling out across the polished floorboards: papers, pens, my laptop, a bottle of water...

That's it, I think in desperation. The water. If nothing else, at least the weight of the bottle might help stabilize me from falling.

As if reading my thoughts, my hand shoots out to grab the plastic bottle and twist off its cap with shaky fingers. Water sloshes wildly inside as I tilt it towards my parched lips, taking a long gulp that does little to calm my racing heart. A droplet of cool liquid slips down my neck into my shirt, but I barely notice.

My mind is elsewhere, trying to piece together what just happened and how we might escape this deadly predicament. But the more I think about it, the less sense anything makes. Was someone in there when the glass shattered? Are...

📚 Documentation

Model Versions

• Newest Version V3: It has all the power of Dark Planet 8B with 128k context, additional de - censoring, performance improvements, and re - mastered source and ggufs in float 32 (32 bit precision). Link
• Dark Planet 8B - 1 million context: It offers superior long output generation/long context awareness. Link
• Dark Planet 8B SpinFire: Newest version with Llama 3.1 and uncensored. Link
• Monster Darkest Planet 16.5B L3: Drastically increases detail, quality, and raw creative power over Dark Planet 8B using DavidAu's Brainstorm 40x augmentation. Link
• NEO IMATRIX quants: Link
• NEO IMATRIX - DARK HORROR quants: Link
• F32 Version: Mastered from float32 source files. Link
• Version 2 - Eight Orbs Of Power: Link

Model Notes

• Detail, prose and fiction writing abilities are significantly increased vs L3 Instruct.
• For more varied prose (sentence/paragraph/dialog), raise the temp and/or add more instructions in your prompt(s).
• Role - players should be careful when raising temp too high as it may affect instruction following.
• This model works with rep pen of 1 or higher, 1.05+ recommended.
• If you want a specific type of prose (e.g., horror), add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
• A lot of GPTisms have been removed, but there are still a few.
• This is not a "happy ever after" model. It has a negative bias.
• Output length will vary, and this model prefers short outputs unless you state the size.
• For creative uses, different quants will produce slightly different output.
• Due to the high stability and compressed nature of this model, all quants will operate at above - average levels.
• If you use rope to extend context, increase temp AND instructions detail levels to compensate for "rope issues".
• Source code for this model (Bfloat16), Float 32 master GGUFs (and source), and Imatrix GGUFs versions will be uploaded shortly at separate repos.

QUANT Updates Dec 21 2024

• All quants have been "refreshed", quanted with the latest LLAMACPP improvements: Better instruction following, output generation across all quants.
• All quants have also been upgraded with "more bits" for output tensor (all set at Q8_0) and embed for better performance.
• New specialized quants (in addition to the new refresh/upgrades): "max, max - cpu" (will include this in the file name) for quants "Q2K" (max cpu only), "IQ4_XS", "Q6_K" and "Q8_0".
• "MAX": Output tensor / embed at float 16. You get better instruction following/output generation than standard/upgraded quants.
• "MAX - CPU": Output tensor / embed at bfloat 16, which forces both of these on to the CPU (Nvidia cards / other will vary), this frees up vram at cost of token/second and you get better instruction following/output generation too.
• "MAX - CPU" examples:
  • q8_0 Max - CPU: 2004 mb will load on to CPU/RAM, 7073 mb will load onto the GPU/vram. Extra Vram can be used for context.
  • q2_k Max - CPU: 2004 mb will load on to CPU/RAM, 2449 mb will load onto the GPU/vram. Extra Vram can be used for context. You could run this model/quant on a 4GB vram card.
• Q8_0 (Max,Max - CPU) now clocks in at 9.5 bits per weight (average).

Settings

CHAT / ROLEPLAY and/or SMOOTHER operation

In "KoboldCpp" or "oobabooga/text - generation - webui" or "Silly Tavern", set the "Smoothing_factor" to 1.5 to 2.5:

• In KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F".
• In text - generation - webui -> parameters -> lower right.
• In Silly Tavern, this is called: "Smoothing".

Note: For "text - generation - webui", if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model). Source versions (and config files) of the models are here: [Link](https://huggingface.co/collections/DavidAU/d - au - source - files - for - gguf - exl2 - awq - gptq - hqq - etc - etc - 66b55cb8ba25f914cbf210be)

Other options:

• Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor").
• If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing"), just make the adjustment as noted.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This is a "Class 1" model. For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s), please see: [Link](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters)

Optional Enhancement

The following can be used in place of the "system prompt" or "system role" to further enhance the model. It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. Copy and paste exactly as noted, do not line wrap or break the lines, maintain the carriage returns exactly as presented.

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

🔧 Technical Details

Model "DNA"

Special thanks to the incredible work of the model makers "SAO10K", "NEVERSLEEP" and "HASTAGARAS". Models used:

• [https://huggingface.co/Sao10K/L3 - 8B - Stheno - v3.2](https://huggingface.co/Sao10K/L3 - 8B - Stheno - v3.2)
• [https://huggingface.co/NeverSleep/Llama - 3 - Lumimaid - 8B - v0.1 - OAS](https://huggingface.co/NeverSleep/Llama - 3 - Lumimaid - 8B - v0.1 - OAS)
• [https://huggingface.co/Hastagaras/Jamet - 8B - L3 - MK.V - Blackroot](https://huggingface.co/Hastagaras/Jamet - 8B - L3 - MK.V - Blackroot)

Parts of these models were "grafted" / "fused" together to create this model.

📄 License

This model is licensed under the Apache - 2.0 license.

⚠️ Important Note

NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.

💡 Usage Tip

I suggest downloading quant(s) of both "Bloat16" and "Float32" versions of this model for your use case(s). The Float32 version has increased detail, "stays in the moment", and slightly higher creativity. However, their "character" is different from one another too.