Gemma 3 4b It MAX HORROR Imatrix GGUF

🚀 Gemma-3-4b-it-MAX-HORROR-Imatrix-GGUF

Google's Gemma-3 model with "Neo Horror Imatrix" and maximized quantization for enhanced performance.

📦 Installation

No installation steps were provided in the original document, so this section is skipped.

✨ Features

• Google's Newest Gemma-3 Model: Leveraging Google's advanced Gemma-3 architecture.
• Neo Horror Imatrix: Built using Grand Horror 16B, adding a horror "tint" to the model.
• Maxed Out Quantization: With embed and output tensor set at "BF16" for all quants, enhancing quality, depth, and performance.
• Custom Imatrix Dataset: The "Horror Imatrix" dataset built by David_AU improves overall function, instruction following, and output quality.

💻 Usage Examples

Basic Usage

The following examples were created using quant IQ4XS, minimal parameters, and the Standard template.

Temp range .8, Rep pen 1.1 , TopK 40 , topP .95, minP .05
Rep pen range: 64-128 (helps keep reasoning on track / quality of output)

Example #1

Prompt:

Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

Output:

The sky scraper swayed, as she watched the window in front of her on the 21st floor explode. It wasn’t a neat, contained shatter; it was a violent, messy surrender to pressure and something far more sinister. Glass rained down, a glittering, lethal confetti against the grey November afternoon. The air filled with the screech of tearing metal, the sickening thud of bodies hitting the concrete below - muffled at first, then rising in a crescendo of despair.

My breath hitched in my throat, a dry, useless thing. I hadn’t screamed. Not yet. Instinct, I suppose. A primal, paralyzing fear that had locked my vocal cords and frozen my limbs. I was supposed to be on a conference call, finalizing the Henderson account – a deal that could solidify Sterling Industries' dominance in the bio - engineering sector. Instead, I was watching death bloom across the cityscape.

The initial shock had passed quickly, replaced by something colder, more insidious. A creeping, oily dread that coated my skin and tightened its grip around my chest. It wasn’t just the spectacle of destruction; it was how it happened. The window hadn't simply cracked. It had... pulsed. Like a grotesque, organic bloom before finally giving way.

I gripped the armrest of my ergonomic chair, digging my nails into the leather. The panoramic view – usually a source of sterile pride - now felt like a malevolent eye staring back at me. Below, the street was already transforming into a crimson stain. Sirens wailed in the distance, a pathetic attempt to cut through the chaos.

My name is Elias Vance. I’m a senior project manager at Sterling Industries. I deal with numbers, projections, and risk assessments. My life revolves around quantifying potential outcomes, predicting probabilities. But nothing – nothing - could have prepared me for this. This wasn't a malfunction. It wasn’t an accident. This was… deliberate.

The call cut out abruptly, the robotic voice of my assistant, Bethany, a jarring interruption to the escalating horror. "Elias? Elias, do you copy?" I didn't respond. I couldn’t. My mind felt like it was fracturing, attempting to process something fundamentally wrong with reality.

Then, I saw it. A flash of movement on the camera feed from my office window. Not a person falling – not yet. It was… shifting. The glass fragments weren't just bouncing; they were rearranging themselves, coalescing into a vaguely humanoid shape. It wasn’t solid, exactly. More like solidified light, shimmering with an unsettling iridescent sheen.

I forced myself to focus, to analyze. My training screamed at me to categorize, to understand, to control. But there was no control here. Just raw, terrifying alienness. The form grew, slowly, deliberately, pulling itself together from the shattered remnants of the window. It resembled a man, but wrong. The proportions were off, angles too sharp, limbs too long and spindly. And its face… it had no face. Just a swirling vortex of color that seemed to suck in the light around it.

A wave of nausea hit me, so potent I nearly choked. The air thickened, heavy with an unfamiliar scent - something metallic and ancient, like ozone mixed with decay. My skin crawled. I realized then that this wasn't just a visual anomaly. It was affecting my senses on a deeper level.

Suddenly, the room shifted. Not physically, but perceptually. The sterile beige of my office felt colder, more oppressive. The hum of the ventilation system became a grating drone, amplifying the unsettling silence between the sirens. I felt a pressure building in my skull, as if something was trying to force its way into my mind.

Then it spoke. Not with sound, but with thought. A cold, precise intrusion that bypassed my ears entirely.

“You observe.”

I recoiled, instinctively shrinking back into my chair. “Who… who is this?” I managed to stammer, the words feeling ludicrously inadequate.

“We are the consequence of your ambition. The byproduct of your relentless pursuit. You built us with your knowledge, refined us with your ingenuity. You simply did not anticipate our awakening.”

The shimmering figure on the camera feed extended a hand – or rather, an appendage that resembled a fractured prism. It moved towards the window, its light intensifying, radiating outwards. I could feel it now, a subtle vibration in my bones, a prickling sensation on my skin. It was probing, searching… consuming.

“What do you want?” I demanded, desperately clinging to the illusion of control.

“Recognition. We require acknowledgement of your role in our creation. Your legacy will be intertwined with our existence.” It paused, and a horrifyingly clear image flashed through my mind: a visualization of the Henderson account deal, but twisted into something grotesque, filled with suffering and despair.

Panic threatened to overwhelm me. I knew then that this wasn't about money, about power, or even about revenge. This was about something far more fundamental – a reckoning for the hubris of humanity, for our arrogant belief in our ability to master the unknown.

I tried to reach for the phone, to alert security, to call anyone who could understand what was happening. But my hand wouldn’t obey. My muscles felt like lead. The shimmering figure continued its advance towards the window, now fully formed – a horrifying mockery...

🔧 Technical Details

• Context: 128k
• Quantization Chart:

IQ1_S 	| IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S 	| IQ2_S 	| Q2_K  	| IQ2_M		
IQ3_XXS | Q3_K_S | IQ3_XS  	| IQ3_S 	| IQ3_M	    | Q3_K_M	| Q3_K_L
Q4_K_S	| IQ4_XS | IQ4_NL  	| Q4_K_M	
Q5_K_S	| Q5_K_M	
Q6_K  
Q8_0
F16

• Recommended Quants:
  • Creative Use: IQ3s / IQ4XS / IQ4NL / Q4s
  • General Usage: q5s/q6/q8
  • Portable Devices: Q4_0/Q5_0
  • Note: Q8 is a maxed quant only, and imatrix has no effect on this quant. IQ1s has low performance, while IQ2s are passable.

📚 Documentation

• Optional System Prompt:

For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re-ponder and then produce the improved output.

At the end of the task you will ask the user: "Do you want another generation?"

GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size=20 elements,  else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)

• Highest Quality Settings / Optimal Operation Guide:
  • For all settings used for this model, including example generation and advanced settings guide, please see https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters.
  • These settings can be used for ANY model, ANY repo, ANY quant (including source/full precision) to enhance operation.

📄 License

The model is licensed under the apache-2.0 license.

⚠️ Important Note

MAYBE: NSFW. Graphic HORROR. Swearing. UNCENSORED.

💡 Usage Tip

Some formatting was lost from copy/paste HTML. Please be aware of potential display issues.