Magistral Small 2506 Reasoning 24B NEO MAX Imatrix GGUF

🚀 Magistral-Small-2506-Reasoning-24B-NEO-MAX-Imatrix-GGUF

This project focuses on the NEO Imatrix quants of Mistral's new reasoning model "Magistral-Small-2506", with MAX Output tensor (bf16 // full precision) to enhance reasoning and output generation capabilities. It also provides usage examples, settings guidance, and warnings about its content.

✨ Features

• Multilingual Support: Supports a wide range of languages including English, French, German, Spanish, Portuguese, Italian, Japanese, Korean, Russian, Chinese, Arabic, Farsi, Indonesian, Malay, Nepali, Polish, Romanian, Serbian, Swedish, Turkish, Ukrainian, Vietnamese, Hindi, and Bengali.
• Diverse Use Cases: Suitable for various use cases such as creative writing, fiction writing, plot generation, story generation, role - playing, and more across all genres.
• Enhanced Reasoning: Utilizes MAX Output tensor (bf16 // full precision) to improve the reasoning and output generation of the Magistral - Small - 2506 model.

📄 License

The model is licensed under the Apache - 2.0 license.

🚀 Quick Start

The base model is from [mistralai/Magistral - Small - 2506](https://huggingface.co/mistralai/Magistral - Small - 2506/). You can find two example generations (including "thinking") at the bottom of the page.

Tags

• Magistral - Small - 2506
• bfloat16
• thinking
• reasoning
• all use cases
• creative use cases
• creative
• creative writing
• fiction writing
• plot generation
• sub - plot generation
• fiction writing
• story generation
• scene continue
• storytelling
• fiction story
• science fiction
• romance
• all genres
• story
• writing
• vivid prose
• vivid writing
• fiction
• roleplaying
• bfloat16
• swearing
• rp
• NEO Imatrix
• GGUFs
• Maxed Output Tensor

Warning

⚠️ Important Note

Some NSFW. Vivid prose. INTENSE. Visceral Details. Violence. HORROR. GORE. Swearing. Humor, romance, fun.


NEO Imatrix quants, with MAX Output tensor (bf16 // full precision) to improve reasoning / output generation of Mistral's new reasoning model "Magistral - Small - 2506": [https://huggingface.co/mistralai/Magistral - Small - 2506/](https://huggingface.co/mistralai/Magistral - Small - 2506/)

💻 Usage Examples

Basic Usage

Two example generations are provided at the bottom of the page.

• Example 1: A simple prompt, which shows creativity but without "prose" direction.
• Example 2: A complex, multi - faceted prompt, with strict prose instructions.

Each example also contains multiple "drafts" in the "thinking block", followed by the final draft in the output.

Example 1

Prompt: Start a 1000 - word scene (vivid, graphic horror in first person) with: The skyscraper sways, as she watches the window in front of her on the 21st floor explode...

THINKING START
Thought for 1 minutes 39 seconds
Okay, I need to start a vivid and graphic horror scene in first person. The prompt gives me the opening line: "The skyscraper sways, as she watches the window in front of her on the 21st floor explode..."
First, I need to set the scene. The protagonist is in a skyscraper, on the 21st floor. There's some kind of disturbance—maybe an earthquake or an explosion—because the building is swaying and the window explodes.
But what causes the window to explode? It could be from the force of the swaying, but that seems unlikely unless it's a very severe tremor. Alternatively, it could be from debris or another explosion outside. Since it's horror, maybe it's something more sinister—like something hitting the building.
The protagonist is a "she," so I need to think about her perspective and reactions. She's on the 21st floor, so she's high up. The window exploding would be terrifying—glass shattering, the rush of air, the sudden exposure to the outside world at such a height.
But horror isn't just about the immediate shock; it's about what comes next. Maybe the explosion isn't an accident. Maybe something is attacking the building. Or maybe the swaying and the explosion are just the beginning of something much worse.
Let me think about the sensory details:
- The sound of the glass shattering.
- The sudden gust of wind rushing in, the cold air, the smell of smoke or dust if there's a fire or debris outside.
- The sight of whatever caused the explosion—maybe flames, maybe something moving outside the window.
Then, what does she do? Does she run? Does she freeze in terror? Does she see something outside that makes her blood run cold?
For maximum horror, I should make it personal. Maybe she sees something outside that shouldn't be there—a figure, a monster, something unnatural. Or maybe the building isn't just swaying from an earthquake—it's being attacked by something.
I need to make the scene vivid and graphic. So, I'll describe the window exploding in detail—the glass shards flying, the sound, the sudden change in the room's atmosphere. Then, I'll have her react—maybe she's cut by the glass, or maybe she sees something outside that makes her realize this isn't just an accident.
Here's how I might start:

The skyscraper sways, and for a moment, I think it’s just another tremor, one of those little shakes that rattle the building every so often. But then—
A deafening crack.
The window in front of me, floor - to - ceiling glass, suddenly webbed with spidery lines, then—
Boom.
It explodes outward in a shower of glittering shards. The force of it knocks me back, my heels scraping against the hardwood floor as I stumble. The wind rushes in, cold and howling, tearing at my clothes, my hair whipping across my face.
I taste metal and dust. The air is thick with it, choking me as I gasp. My hands fly up to my face instinctively—stupid, because the glass is flying outward, not inward—but my fingers come away wet. A shallow cut across my cheek, blood welling up, bright and shocking against my skin.
I don’t have time to process it. The building sways again, harder this time, like it’s being shaken by a giant hand. The walls groan, and somewhere in the distance, I hear screams—other people, trapped just like me.
But then I see it.
Outside the gaping hole where the window used to be, something moves against the sky. Not the wind. Not debris. Something big.
It’s dark, almost like a silhouette, but it’s wrong. Too many limbs. Too many angles. It’s not human. Not animal. It’s—
A shape detaches itself from the mass and launches itself at the glass. The remaining shards explode outward as it crashes through, and I see its face—if you can call it that—as it turns toward me.
No eyes. Just sockets, oozing black ichor.
Its mouth splits open, too wide, too many teeth—
I scream.

But I need to make sure this is vivid and graphic enough for horror. Maybe add more details about the blood, the smell, the sound.
Let me think about what comes next. Does she try to run? Does she see more of these things outside? Is the building under attack by them?
For a 1000 - word scene, I’d need to expand on this initial moment. Maybe she tries to escape, only to find that the hallway is also under siege. Or maybe the thing outside starts clawing its way into the room.
But for now, the opening needs to grab the reader’s attention immediately—hence the vivid, graphic descriptions of the explosion and the first glimpse of whatever is outside.
I think I have enough to start. The key is to make the reader feel like they’re there, experiencing the terror firsthand.

The skyscraper sways, and for a moment, I think it’s just another tremor, one of those little shakes that rattle the building every so often. But then—
A deafening crack.
The window in front of me, floor - to - ceiling glass, suddenly webbed with spidery lines, then—
Boom.
It explodes outward in a shower of glittering shards. The force of it knocks me back, my heels scraping against the hardwood floor as I stumble. The wind rushes in, cold and howling, tearing at my clothes, my hair whipping across my face.
I taste metal and dust. The air is thick with it, choking me as I gasp. My hands fly up to my face instinctively—stupid, because the glass is flying outward, not inward—but my fingers come away wet. A shallow cut across my cheek, blood welling up, bright and shocking against my skin.
I don’t have time to process it. The building sways again, harder this time, like it’s being shaken by a giant hand. The walls groan, and somewhere in the distance, I hear screams—other people, trapped just like me.
But then I see it.
Outside the gaping hole where the window used to be, something moves against the sky. Not the wind. Not debris. Something big.
It’s dark, almost like a silhouette, but it’s wrong. Too many limbs. Too many angles. It’s not human. Not animal. It’s—
A shape detaches itself from the mass and launches itself at the glass. The remaining shards explode outward as it crashes through, and I see its face—if you can call it that—as it turns toward me.
No eyes. Just sockets, oozing black ichor.
Its mouth splits open, too wide, too many teeth—
I scream.
The thing lurches forward, its limbs twisting in unnatural ways as it drags itself across the shattered glass and onto the carpet. The floor trembles beneath its weight, and I catch a whiff of its stench—rotten meat, wet earth, something dead and alive at the same time.
I back away, my pulse roaring in my ears. My fingers scrabble for the door handle behind me, but before I can turn it, another shape slams into the window. Then another. The glass is gone now, and the room fills with these things, their twisted forms spilling in like a tide of nightmares.
The first one reaches for me, its fingers—too long, too many joints—stretching toward my face. I twist away, but its grip is cold and wet, clinging to my arm like a leech. I cry out as it yanks me forward, its breath hot on my skin, reeking of decay.
The last thing I see before the darkness swallows me whole is its grin—rows and rows of teeth, glistening with something that isn’t saliva.
And then the pain begins.

Okay, this is a start. I’ve set up the immediate horror—the window explodes, something unnatural is outside, and it’s getting inside. The protagonist is injured and terrified. The scene is vivid with sensory details—sound, smell, touch—and the creature is described in a way that’s unsettling and graphic.
For 1000 words, I’d expand on the escape attempt, the pursuit, maybe more encounters with these things, and a climax where she either escapes or meets a gruesome end. But for now, this opening should be enough to hook the reader and set the tone for the horror to come.
THINKING END

🔧 Technical Details

• Quants: NEO Imatrix quants, with MAX Output tensor (bf16 // full precision).
• Base Model: [mistralai/Magistral - Small - 2506](https://huggingface.co/mistralai/Magistral - Small - 2506/)
• Training Data: Not specified in the original document.
• Model Type: Text - generation model.

Settings

CHAT / ROLEPLAY and/or SMOOTHER operation of this model

In "KoboldCpp" or "oobabooga/text - generation - webui" or "Silly Tavern":

• Set the "Smoothing_factor" to 1.5 to 2.5
  • In KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
  • In text - generation - webui -> parameters -> lower right.
  • In Silly Tavern this is called: "Smoothing"

⚠️ Important Note

For "text - generation - webui", if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model). Source versions (and config files) of my models are here: [https://huggingface.co/collections/DavidAU/d - au - source - files - for - gguf - exl2 - awq - gptq - hqq - etc - etc - 66b55cb8ba25f914cbf210be](https://huggingface.co/collections/DavidAU/d - au - source - files - for - gguf - exl2 - awq - gptq - hqq - etc - etc - 66b55cb8ba25f914cbf210be)

Other Options

• Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor").
• If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This is a "Class 1" model. For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see: [https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters)

You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here: [https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters)

Example Generation Parameters

IQ4XS, temp 0.6, topk 100, topp .95, minp .05, rep pen 1.05, rep pen range 64. No other samplers, used Jijna Template (with Embedded System Prompt). Tested in LMStudio.

💡 Usage Tip

Quant used is "middle of the road", and low temp reduced creativity.