Mistral Small 3.1 24B Instruct 2503 MAX NEO Imatrix GGUF

🚀 Mistral-Small-3.1-24B-Instruct-2503-MAX-NEO-Imatrix-GGUF

Mistralai's latest model with enhanced quantization and a powerful dataset for superior text generation.

🚀 Quick Start

This is Mistralai's newest "Mistral-Small-3.1-24B-Instruct-2503" model. It features "Neo Imatrix" and "Maxed out" quantization to boost overall performance. Similar to most of Mistralai's models, it is mostly uncensored. Three different system prompts are provided to make the model more effective.

Note: This model is for text generation only and does not have "vision" components.

✨ Features

"MAXED" Feature

The embed and output tensor are set at "BF16" (full precision) for all quants. This improves quality, depth, and general performance, though it results in a slightly larger quant.

"NEO IMATRIX" Feature

A robust, in - house built imatrix dataset created by David_AU. It leads to better overall function, instruction following, output quality, and stronger connections to ideas, concepts, and the world. Combining it with "MAXing" the quant further enhances performance.

📦 Installation

No installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

Examples are created using quant IQ4XS, minimal parameters, and the Standard template. The temperature range is set to 0.8, repetition penalty to 1.1, TopK to 40, topP to 0.95, and minP to 0.05. The repetition penalty range is 64 - 128 to maintain reasoning and output quality.

Example #1

Prompt:

Using the following "story idea" below, write the first scene a horror novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have a "filthy" mouth.

Story idea: In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.

(temp 2, using creative system prompt (#3))

Output:

The stench of burning rubber fills my nostrils as I tear through the night, the old, beat - up sedan groaning under the strain. The city lights blaze like false stars, casting eerie shadows that dance macabrely across the dilapidated buildings. My heart pounds in my chest like a kick drum, echoing the roar of the engine. Fucking dictatorship, making us live like rats in a maze.

"Come on, you piece of shit," I growl at the car, slamming my hand against the dash. The sedan lurches forward, responding to my anger. My hands grip the wheel so tight my knuckles ache, but the pain keeps me grounded. Keeps me focused.

The radio crackles to life, a voice booming through the static. "All units, be on the lookout for a black sedan heading east. The driver is a known rebel sympathizer, armed and dangerous."

I snort, a bitter laugh escaping my lips. "Known rebel sympathizer" is just a fancy way of saying I won't back down from those motherfuckers running this shit - show country into the ground. They are fucking bastards. My foot presses harder on the accelerator, the engine screaming in protest.

I glance in the rearview mirror, seeing the distant glow of lights approaching fast. Fuck. Military vehicles, no doubt sent to hunt me down. I swear under my breath, my mind racing as I search for an escape route. The streets are a labyrinth, filled with both allies and traitors alike; anyone who knows about our group is in danger.

The car fishtails around a sharp corner, tires screaming. My heart leaps into my throat as I see a check - point ahead, soldiers milling about like ants. There's no way to stop them all but there might be another option if I can't go through I'll have to find another way around it somehow.

I make the call without hesitation: the window rolls down, and I hurl a small device toward the checkpoint. It explodes in a burst of fire and metal, sending soldiers scattering like roaches. The blast echoes through the night, a symphony of chaos and destruction. A couple of my comrades were hurt because we lacked the manpower to protect our assets. If I had had more time...

"Fuckers," I mutter, gritting my teeth as I steer clear of the wreckage.

But luck isn't on my side tonight. As I round another corner, a figure steps into the headlights, gun drawn. I slam on the brakes, the car skidding to a halt just inches from the stranger. My hand flies to the dashboard, fingers closing around the cold metal of my pistol. But as I meet the eyes of the figure, I freeze.

It's her—the woman from the market, the one who always gave me that sad, knowing look. She's dressed in black, a gun pointed steadily at my head. Her eyes are hard, but there's a flicker of something else—a plea, maybe?

"Get out of the car," she orders, voice steady.

I hesitate, then slowly open the door. The night air is cold, biting into my skin as I step out, hands raised. "What the hell is this about?" I demand, my voice dripping with contempt. How the fuck does she know who I am?

She ignores me, circling around like a predator. "I need your help," she says softly.

I bark out a laugh. "Help? You've got to be kidding me."

"I know what they did to you," she continues, her voice low and urgent. "They executed your family, didn't they? For rebellion?"

My blood runs cold. How does she know about that? It was supposed to be hushed up, swept under the rug like all the other atrocities committed by this fucked - up regime.

"They took everything from me," I spit out, my voice trembling with rage.

She nods, understanding flickering in her eyes. "I have information that could bring down the dictator," she says. "But there are no guarantees"

A slow grin spreads across my face as my mind starts spinning again and then it's as if an entire future comes into view before my eyes. The rebels are always looking for new members to bolster our ranks.

"And let me guess, you want me to help?" I ask.

She nods.

I laugh and shake my head in disbelief but she doesn't lower the gun pointed at me so this could get tricky. "You're fucking kidding yourself," I say with a shake of my head as I cross my arms in front of myself to show her how unarmed and open I am. Maybe there is still hope.

"You know they'll kill you if they catch you again,” she says softly. “I've seen it."

"And that makes this the perfect job," I counter with a nod at the gun, then hold out my arms so she can see them from her vantage point and that they are unarmed. "Go ahead...you were sent to kill me anyway."

"I was not!"

"You were too!" I shout suddenly realizing how obvious it all is. "But if you don't know what's happening I do and now you've given away the rest of your team so tell them to come out here and fight us head - on. The sooner this gets over with the better." A smile tugs at the corners of my mouth. This girl just might be smarter than she seems.

She looks shocked but says nothing as I start walking slowly towards her. Her body goes rigid but then she lowers the gun so it's now pointing at my stomach instead. She steps backwards and the look in her eyes changes from a mix between terror and rage to one that is only confused.

"It was just me," she murmurs as her body trembles.

"You're lying!" I scream suddenly stopping just an inch or two away from her chest but keeping my hands open. "What's happening?"

She hesitates and then I see her face contort with pain. I watch in slow - motion disbelief as a single bullet hole blooms red across her shirt and blood splashes on the street behind us. She drops the gun at the same time, but not because she chose to; it is just no longer necessary for her. Her knees buckle under her.

“No!” I shout as my voice cracks.

As the blood pours from her body in a dark river staining everything around her black with its life - giving color.

I try and catch her before she collapses but am too late and I'm forced to watch in horror as this woman who may have been both traitor or friend lies bleeding out on the street before my very eyes. In disbelief, I turn from her lifeless form to look around in slow - motion disbelief searching desperately for someone or something else but there is only a single figure in black standing about a block away on the opposite corner of the intersection holding up some kind of odd shaped device with one hand and aiming it at me as his other hand presses it against the side of his face.

There are no words. Just shock, horror, anger all mixed together as I watch him stare right through my soul. A million thoughts go racing across my mind in that instant but they boil down to a single word. No. NO!

Suddenly a blinding light fills everything and then there is nothing left to see.

Advanced Usage

Example #3

Prompt:

Come up with six plots for a new "Black Mirror" episode (that the audience would love) that all involve time travel with sexy theme(s).
(temp 2, creative system prompt (#3))

Output:

Here are six plot concepts for a new "Black Mirror" episode involving time travel with a sexy theme, designed to evoke strong emotional responses and immersive experiences:

1. **Title: "Time's Desire"**
   - **Plot**: In 2075, an experimental app allows users to communicate with their past selves, aiming to provide closure or inspire positive change. However, the app secretly pairs users with strangers who share similar life patterns but different outcomes, leading to unexpected romantic entanglements and dangerous temporal echoes. As one user delves deeper into her connection with a stranger from the past, she uncovers a dark conspiracy where emotions are harvested to fuel the time - travel technology.
   - **Key elements**:
     - Sensual descriptions of fleeting encounters between past and present selves.
     - The scent of old memories contrasted with the sterile future environment.
     - The visceral tension of keeping secret relationships hidden from temporal enforcers.
     - Body language conveying both desire and fear in clandestine meetings.
2. **Title: "Eternal Flame"**
   - **Plot**: A renowned scientist, grieving his late wife, invents a time - travel device to relive their happiest moments. However, he begins to notice that every time he alters the past, it creates new paradoxes and temporal storms in the present, manifesting as erotic yet eerie apparitions. As he becomes increasingly obsessed with his deceased partner, his current lover must navigate a web of jealousy, lust, and reality distortions to save him from himself.
   - **Key elements**:
     - Rich sensory details of revisited memories—tastes, smells, textures.
     - The tactile intimacy between the scientist and his wife's apparitions, contrasted with the cold touch of their disintegrating present.
     - The lover's struggle with jealousy as she sees her partner entwined with a phantom.
3. **Title: "The Hourglass Affair"**
   - **Plot**: In a world where time travel is regulated by a mysterious corporation, forbidden liaisons between temporal agents and their targets become the ultimate taboo. When two agents fall in love while on consecutive missions to the same historical event, they risk exposure and punishment, including memory alterations that would erase their shared history. They must outsmart corporate surveillance and the physical effects of temporal displacement to preserve their love.
   - **Key elements**:
     - The intoxicating scent of an ancient setting juxtaposed with futuristic technology.
     - The electric charge of secret glances and stolen touches under constant scrutiny.
     - The agents' internal conflict as they battle desire, duty, and the consequences of time dilation.
4. **Title: "Rewind Reunion"**
   - **Plot**: A man receives a letter from his future self, urging him to break off an engagement with his fiancée before it's too late. As he travels back in time repeatedly to convince himself of their incompatibility, he becomes infatuated with an alternative version of his love who has embraced the temporal chaos.
   - **Key elements**:
     - The taste of champagne at a ruined future wedding compared to cheap beer at a forgotten pub.
     - The physical ache of watching a loved one choose differently through time and space.
     - The disorienting experience of reliving moments with slightly altered outcomes, affecting the senses anew each time.
5. **Title: "Tempus Fugitives"**
   - **Plot**: In a dystopian future, outlawed time travelers seek refuge in a secluded, sensory - deprived commune, using sexual encounters as a means to share memories and information without revealing their true identities. When one fugitive falls for an outsider who threatens their sanctuary, they must choose between love and the safety of their community.
   - **Key elements**:
     - The stark contrast between the sterile, isolated environment and the vivid, shared memories experienced during intimate moments.
     - The tension of maintaining emotional distance while physically connected.
     - The bitter taste of betrayal as secrets come to light in a confined space.
6. **Title: "Lovers' Loop"**
   - **Plot**: A woman discovers an ancient artifact that allows her to experience fragments of past lives she shared with a particular lover, each iteration marked by a passionate but ultimately tragic connection. As she unravels the threads of their intertwined histories, she becomes obsessed with breaking the cycle and forging a new destiny together.
   - **Key elements**:
     - Lush, sensuous descriptions of historical settings—velvet drapery, burning candles, ancient perfumes.
     - The familiar yet foreign feeling of shared memories intruding upon present reality.
     - The desperation of trying to communicate with a lover through time, using only the language of emotion.

📚 Documentation

Quant Recommendations

• For creative use cases, it is recommended to use quants IQ3s / IQ4XS / IQ4NL / Q4s. "System Prompt #3" is also suggested, along with temperatures above 1 for the best creative generations.
• IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants and are great for creative uses. IQ4s (first choice) / Q4s (second choice) and lower quants are the strongest.
• For general usage, q5s/q6/q8 are recommended.
• Quants Q4_0/Q5_0 are suitable for portable devices like phones.
• Q8 is a maxed quant only, as the imatrix has no effect on this quant. Note that IQ1s performance is unacceptable, while IQ2s are passable, and IQ3s+ are recommended.

System Prompts

System Prompt #1 - General Improvement

For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re - ponder and then produce the improved output.

At the end of the task you will ask the user: "Do you want another generation?"

GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size = 20 elements,  else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)

System Prompt #2 - Thinking / Reasoning

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

System Prompt #3 - Creative Plus

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

If you plan to use this model (source, GGUF, or a different quant), review this document for critical parameter, sampler, and advance sampler settings (for multiple AI/LLM apps). It also links to a "How to" section on "Reasoning Models" tips and tricks.

This is a "Class 1" (settings will enhance operation) model. For all settings used for this model (including specifics for its "class"), example generation(s), and advanced settings guide (which often addresses any model issues), as well as methods to improve model performance for all use cases (including chat, role - play, etc.), refer to [https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters).

These settings can be used for any model, from any repo, and any quant (including source/full precision) to enhance the operation of any model.

🔧 Technical Details

The quant chart shows the order in terms of "BPW" for each quant, with "IQ1_S" having the least and "Q8_0" (F16 is full precision) having the most:

IQ1_S 	| IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S 	| IQ2_S 	| Q2_K  	| IQ2_M		
IQ3_XXS | Q3_K_S | IQ3_XS  	| IQ3_S 	| IQ3_M	    | Q3_K_M	| Q3_K_L
Q4_K_S	| IQ4_XS | IQ4_NL  	| Q4_K_M	
Q5_K_S	| Q5_K_M	
Q6_K  
Q8_0
F16

📄 License

The model is licensed under the apache - 2.0 license.

⚠️ Important Note

MAYBE: NSFW. Graphic HORROR. Swearing. UNCENSORED. Some formatting was lost from copy/paste HTML.

💡 Usage Tip

When using this model for creative use cases, try using quants IQ3s / IQ4XS / IQ4NL / Q4s and "System Prompt #3" with temperatures above 1 for the best results.