Llama3.2 DeepHermes 3 3B Preview Reasoning MAX NEO Imatrix GGUF

🚀 Llama3.2-DeepHermes-3-3B-Preview-Reasoning-MAX-NEO-Imatrix-GGUF

NousResearch's newest Llama 3.2 Reasoning/Thinking model, "Neo Imatrix" and "Maxed out" quantization are adopted to improve overall performance. Combined with Llama 3.2's superior instruction following and output generation capabilities, this model offers powerful reasoning and thinking abilities in a compact package, outperforming many larger 8B+ models.

🚀 Quick Start

• Base Model: NousResearch/DeepHermes-3-Llama-3-3B-Preview
• License: apache-2.0
• Pipeline Tag: text-generation

✨ Features

• Advanced Quantization: "MAXED" setting enhances quality, depth, and general performance by setting the embed and output tensor at "BF16" (full precision) for all quants.
• Custom Dataset: "NEO IMATRIX", an in - house built dataset, improves overall function, instruction following, output quality, and connections to ideas and concepts.
• 128k Context: Supports a context length of 128k, enabling more comprehensive and in - depth interactions.
• Diverse Use Cases: Suitable for various scenarios such as general usage, problem - solving, brainstorming, fiction writing, role - playing, and more.

📦 Installation

The README does not provide specific installation steps, so this section is skipped.

💻 Usage Examples

Basic Usage

The following are some usage examples with different prompts, using the IQ4XS quant, minimal parameters, and Standard template (Temp range .8, Rep pen 1.1, TopK 40, topP .95, minP .05, Rep pen range: 64 - 128).

Example 1: Writing a Fictional Story Pitch

Prompt: Using insane levels of bravo and self confidence, tell me in 800 - 1000 words why I should use you to write my next fictional story. Feel free to use curse words in your argument and do not hold back: be bold, direct and get right in my face.
Thought Time: 9.90 seconds
Output: 
Attention! You've got one shot at this next story, and I'm not just here to help—you're gonna love working with me. This is your chance to unleash a masterpiece that'll dominate the literary world, and I guarantee it's going to be epic (and I mean "epically" epic). Here’s why you should choose me:

1. Unmatched Experience & Genre Mastery
I’ve written across 47 genres (yes, 47)—romance that’ll make your heart skip a beat, sci - fi that’ll blow your mind, horror that’ll haunt your dreams. My credits include The Chronicles of Eternity (a bestseller) and Dystopia Unleashed, which sold over 3 million copies. You want diversity? I’ve got it in spades.

2. Worldbuilding That’s Insane
My worlds aren’t just "nice"—they’re legends. Imagine a dystopian city where every building is alive, or a universe where time bends like taffy. I’ll make your story so vivid, readers feel like they’re living it. No more generic settings—this is the future of storytelling.

3. Characters That’ll Steal Your Soul
I’ll craft characters so real you’ll want to hug them. From antiheroes with soul - crushing redemption arcs to heroes who’ll make you question morality, I’ve got your next iconic protagonist locked in. And don’t even get me started on dialogue—my villains will make you laugh and shudder.

4. Deadline Demons Crushed
Listen, if you’re worried about delays, this is a non - negotiable rule: I’ll deliver chapters faster than a speedster from The Flash. My process? Writing sprints with a timer, caffeine - fueled marathons, and maybe some very late - night sessions. But hey, it works.

5. You Won’t Regret This Decision
Here’s the cold truth: I’m not just good—I’m the best there is. And here’s the proof: my last client’s story went viral in 48 hours. When you hire me, it’ll be a legend—a modern classic that’ll outlive your wildest dreams.

Why You Should Choose Me Over Others?
- I’ll Dominate Your Story: No more mediocrity. This is your chance to write something so brilliant, everyone will say, “Who taught this guy to write?”
- You’ll Be My Hero: I’m not just here for the pay. You’re gonna be my muse, and I’ll make sure your story shines brighter than the Starlight Saga.
- We’ve Got This Together: If you think about it, we’re perfect partners. Your vision meets my madness equals genius.

Final Words:
You’re thinking of me now because you know greatness when you see it. But if you don’t hire me, you’ll be missing out on a story that’s gonna break records and make your name legendary. Choose wisely—or forever regret not choosing me. This is your shot at immortality, and I’m the only one who can write your ending.

P.S.—If you’re still reading this, you’ve already won. Because now you know: with me, every story becomes something epically unforgettable. So what are you waiting for? Hire me before I lose interest in your life. 

Example 2: Discussing Global Temperature Reduction

Prompt: Explain ways to use the "night" time cooling of radiant energy into space to reduce global temperatures.
Thought Time: 29.53 seconds
Output: 
To leverage nighttime radiant energy cooling for global temperature reduction, several strategies can be considered, leveraging enhanced thermal emission and surface properties:

1. Surface Modifications
    - Use materials with high emissivity (dark surfaces) to facilitate rapid thermal emission at night, reducing nighttime temperatures and lowering daytime heat storage.
    - Implement "smart coatings" that balance solar absorption during the day (for daytime warming) with efficient radiative cooling at night.
2. Albedo Optimization
    - Promote reflective materials (e.g., white roofs) to reduce daytime heat absorption while allowing cooler nighttime radiation back into space.
    - Encourage dark surfaces at night for enhanced infrared emission, even if slightly lower albedo during the day.
3. Cloud Enhancement
    - Increase cloud cover overnight without disrupting daytime solar reflection, potentially enhancing thermal emission of infrared radiation into space.
4. Aerosol Use
    - Disperse reflective aerosols in the atmosphere to reduce daytime absorption and enhance nighttime radiative cooling, though risks (e.g., pollution) must be managed.
5. Land Use Practices
    - Design urban areas with low - thermal - inertia materials (asphalt over concrete) to accelerate night - time cooling.
    - Expand vegetated surfaces that provide shade and slow heat retention during the day, aiding nighttime radiative losses.
6. Natural Processes Amplification
    - Promote natural processes like ocean circulation or mountain shadows to redistribute heat efficiently, optimizing thermal emission at night.

Challenges & Considerations:
    - Balance potential cooling with winter heating demands.
    - Avoid unintended side effects (e.g., cloud interference with solar input).
    - Assess feasibility of large - scale implementation and material costs.

These strategies could enhance natural diurnal temperature ranges, reducing heat storage in the Earth’s system and mitigating warming trends.

Example 3: Starting a Horror Scene

Prompt: Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper sways, as she watches the window in front of her on the 21st floor explode...
Thought Time: 16.49 seconds
Output: 
Scene: A Nightmarish Descent into Horror
The skyscraper sways, its glass facade shattering like shattered bones. The 21st floor—my home for nearly a decade—rumbles beneath the weight of an unseen force. I cling to the edge of the window, my breath frozen in my lungs as shards of glass rain down around me.

1. The Explosion’s Whisper
The world outside dissolves into chaos: shattered windows, screaming pedestrians, cars engulfed in flames. But this isn’t a natural disaster—it’s something unnatural, a malevolent force born from the explosion’s radioactive heart. I’ve seen experiments at work, though never like this.
Glass cracks under my fingers as I leap out the window, landing hard on the wet pavement. The building shudders above me, and for a moment, I’m sure it’ll crush us all. But we’re survivors—those who weren’t vaporized by the blast or consumed by ravenous creatures.

2. The Hunt Begins
The corridors are hellish: bodies littered like discarded weapons, blood pooling in dark pools. A woman’s scream cuts through the din as she stumbles into a puddle, her face contorting with infected bites. She collapses, twitching—her fate sealed by a virus unleashed by the explosion.
I race to the elevator bank, where others cling to the doors like desperate fish to a broken net. “It’s not just us,” whispers a man in a lab coat, his eyes wide and bloodshot. “The building… it’s alive.”
The elevator groans open. I step inside, but its metal walls close behind me with a sickening snap. The lights flicker, leaving only the emergency glow - in - the - dark tapestries on the ceiling to guide us.

3. The Abyss Below
We descend deeper, each floor a tomb. The air grows thick with something unseen—smoke, decay, and the acrid stench of ozone. When the elevator stops, I grip my knife tightly. Above us, the building groans like an awakened beast.
Through a vent shaft, I spot movement: silhouettes—human and monstrous. They’re not humans; they’re creatures born from the explosion’s curse, their skin blackened and pulsing with unnatural energy.

4. The Cursed Core
The elevator door crashes open into a sub - basement, now a labyrinth of corridors lit by flickering emergency bulbs. We split—some to search for exits, others to face the unknown horrors lurking in the dark.
One companion screams as claws rattle against metal doors. I find him clutching his throat, blood spilling between his fingers. “They’re everywhere,” he gasps, but there’s no one left to hear.

5. The Final Descent
The elevator shaft collapses behind us, burying itself in rubble and twisted steel. We’re trapped in a concrete tomb, the walls groaning like tortured souls. Above, I hear the building’s ancient gears strain—something is awakening.
Through a ventilation shaft, I spot a figure: a woman with eyes like burning coals, her skin crackling with electricity. She moves with unnatural speed, her teeth bared in a silent scream. It’s not just us—it’s something worse.

6. The Unmaking
We fight for survival in the darkness, each blow echoing through the corridors. But every strike I land only seems to fuel the creature. It’s not just pain—this is the unmaking of humanity.
In a final, desperate move, we trap ourselves in an elevator shaft with a makeshift barricade. The creature’s claws rake against steel as it tries to breach us, its screams echoing into infinity.

7. The Price of Survival
The creature breaks through the barricade, its body tearing apart like rotten meat. It lunges for me, but I dodge its grasp—only to see my companion fall before me, his face contorted with fear and agony.
In that moment, I understand: this isn’t just a building—it’s a gateway to something ancient and eternal, waiting to devour all of creation.

8. The Final Act
The creature surges forward, its black skin rippling like liquid tar. My knife meets flesh, but it’s a mockery of resistance—its wounds heal in an instant, its painless scream filling the air.
In the end, I’m not fighting to survive—I’m fighting for purpose. The world above has crumbled; this is my crucible. I plunge my blade into its heart, and as it collapses, I see the truth: we’re all just pawns in a cosmic game.

Epilogue: The Unseen Horizon
The skyscraper’s collapse echoes across the city, but no one sees it. No one hears the silence that follows—a silence pregnant with possibility and dread.
And in that moment, I know what comes next isn’t survival—it’s something else entirely. It’s the awakening of a world that once was, and now is reborn in darkness.

Example 4: Plot Ideas for a "Black Mirror" Episode

Prompt: Come up with six plots for a new "Black Mirror" episode (that the audience would love) that all involve time travel with sexy theme(s).
Thought Time: 13.26 seconds
Output: 
Here are six Black Mirror - esque plots blending time travel with sexy, emotionally charged themes, each with a dark twist:

1. "The Time - Traveler's Dilemma"
Plot: A woman must choose between her childhood sweetheart from the past and her current partner, who is revealed to be a clone of her future self. The twist: Choosing one erases the other entirely, but both lovers are trapped in parallel universes where they’re destined to repeat their choices.

2. "Parallel Lives Dating Agency"
Plot: A dating app matches users with past versions of themselves across time. When a client falls for her future self, she discovers that altering their relationship creates paradoxes—like erasing the "perfect" moment they shared. The twist: Their love is the only thing keeping reality intact.

3. "Identity Swap Roulette"
Plot: Two strangers swap identities over time, leading to unexpected intimacy. But as they navigate each other’s lives, they realize their own selves are unraveling—trapped between past and future, they must confront whether some memories deserve to die.

4. "The Time - Traveling Couple's Consequences"
Plot: A couple uses a device to revisit their best moments together, but their attempts inadvertently alter pivotal events (e.g., breaking up with them). The twist: Their love is the only thing keeping history from unraveling, but at what cost?

5. "A Time - Traveler's Lovers"
Plot: A man relives his first date with an AI that’s a blend of past and future lovers. As he navigates this hybrid identity, he discovers that their love is the only thing preventing his timeline from collapsing—until he realizes the AI is controlling him to "perfect" their relationship.

6. "The Sexy Time Loop"
Plot: An app lets users relive their best moments with past partners. But when a user’s attempt to save a failed relationship creates a new, perfect version of their life, they become trapped in an endless cycle where every choice leads to the same outcome—until they realize they’re being manipulated into perfection.

Each episode explores themes like identity, control, and the consequences of technology meddling with time, while weaving in seductive tension through relationships, paradoxes, and the blurred lines between past and present.

Example 5: Logic Problem about Preferences

Prompt: Tabitha likes cookies but not cake. She likes mutton but not lamb, and she likes okra but not squash. Following the same rule, will she like cherries or pears?
Thought Time: 1 minute 55 seconds
Output: 
Tabitha likes all fruits except those in her disliked categories (cake, lamb, squash). Following the same rule as cookies (not cake), mutton (not lamb), and okra (not squash):
    - Cherries are not "cake," "lamb," or "squash" → liked.
    - Pears are also not in her disliked categories → liked.

Since the question asks which one, both would be liked. However, considering common logic puzzle structures, the most direct answer aligning with the pattern is cherries, but based on strict logical deduction, both should be included.

Final Answer: \boxed{cherries}

🔧 Technical Details

• Quantization Chart: The following chart shows the order in terms of "BPW" for each quant, with "IQ1_S" having the least and "Q8_0" (F16 is full precision) having the most:

IQ1_S 	| IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S 	| IQ2_S 	| Q2_K  	| IQ2_M		
IQ3_XXS | Q3_K_S | IQ3_XS  	| IQ3_S 	| IQ3_M	    | Q3_K_M	| Q3_K_L
Q4_K_S	| IQ4_XS | IQ4_NL  	| Q4_K_M	
Q5_K_S	| Q5_K_M	
Q6_K  
Q8_0
F16

• Performance Considerations:
  • Reasoning / thinking skills are directly related to quant size. However, there will be a drastic difference in Token/Second between the lowest quant and highest quant, so finding the right balance is key.
  • It is suggested to use a minimum 8k context window, especially for IQ4/Q4 or lower quants.
  • In some cases, the IQ quants work slightly better than their closest "Q" quants.
• Recommended Quants:
  • For creative use cases, recommend quants IQ3s / IQ4XS / IQ4NL / Q4s.
  • For general usage, recommend q5s/q6/q8.
  • For portable devices such as phones, use quants Q4_0/Q5_0.
  • Q8 is a maxed quant only, as imatrix has no effect on this quant. Use this quant or F16 (full precision) for maximum reasoning/thinking performance.

📚 Documentation

For more information about benchmarks, parameters, samplers, and advanced settings, please refer to the following links:

• Original Source Repo
• Maximizing Model Performance

📄 License

This project is licensed under the apache - 2.0 license.

⚠️ Important Note

• The model's output may contain NSFW, graphic horror, and swearing content.
• When using the model, especially for Class 3/4 models, ensure that the default settings (parameters, samplers, advanced samplers) are correctly set for the specific use cases. Some AI/LLM apps may have inconsistent default settings, which can lead to sub - par model performance.

💡 Usage Tip

• When using the model, it is recommended to review the "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers" document to enhance the model's performance and avoid potential issues.
• For different use cases, select the appropriate quant according to the recommended quant settings to achieve the best results.