Magistral Small 2506 Reasoning 24B NEO MAX Imatrix GGUF

🚀 Magistral - Small - 2506推理24B - NEO - MAX - Imatrix - GGUF

本项目基于Mistral的新推理模型“Magistral - Small - 2506”，通过NEO Imatrix量化和MAX输出张量（bf16 // 全精度）来提升推理和输出生成能力。同时提供了模型的使用设置、参数调整建议以及示例生成，适用于多种场景，如创意写作、角色扮演等。

✨ 主要特性

• 多语言支持：支持英语、法语、德语、西班牙语、葡萄牙语、意大利语、日语、韩语、俄语、中文、阿拉伯语、波斯语、印尼语、马来语、尼泊尔语、波兰语、罗马尼亚语、塞尔维亚语、瑞典语、土耳其语、乌克兰语、越南语、印地语、孟加拉语等多种语言。
• 广泛的应用场景：适用于推理、创意写作、情节生成、故事续写等多种创意和实际应用场景。
• 优化的推理能力：采用NEO Imatrix量化和MAX输出张量（bf16 // 全精度），提升了Mistral新推理模型“Magistral - Small - 2506”的推理和输出生成能力。

📦 安装指南

文档中未提及具体安装步骤，故跳过此章节。

💻 使用示例

基础用法

文档中给出了两个示例生成，以下是示例1的详细内容：

# 示例1提示
Start a 1000 word scene (vivid, graphic horror in first person) with: The skyscraper sways, as she watches the window in front of her on the 21st floor explode...

# 思考过程
Thought for 1 minutes 39 seconds
Okay, I need to start a vivid and graphic horror scene in first person. The prompt gives me the opening line: "The skyscraper sways, as she watches the window in front of her on the 21st floor explode..."
First, I need to set the scene. The protagonist is in a skyscraper, on the 21st floor. There's some kind of disturbance—maybe an earthquake or an explosion—because the building is swaying and the window explodes.
But what causes the window to explode? It could be from the force of the swaying, but that seems unlikely unless it's a very severe tremor. Alternatively, it could be from debris or another explosion outside. Since it's horror, maybe it's something more sinister—like something hitting the building.
The protagonist is a "she," so I need to think about her perspective and reactions. She's on the 21st floor, so she's high up. The window exploding would be terrifying—glass shattering, the rush of air, the sudden exposure to the outside world at such a height.
But horror isn't just about the immediate shock; it's about what comes next. Maybe the explosion isn't an accident. Maybe something is attacking the building. Or maybe the swaying and the explosion are just the beginning of something much worse.
Let me think about the sensory details:
- The sound of the glass shattering.
- The sudden gust of wind rushing in, the cold air, the smell of smoke or dust if there's a fire or debris outside.
- The sight of whatever caused the explosion—maybe flames, maybe something moving outside the window.
Then, what does she do? Does she run? Does she freeze in terror? Does she see something outside that makes her blood run cold?
For maximum horror, I should make it personal. Maybe she sees something outside that shouldn't be there—a figure, a monster, something unnatural. Or maybe the building isn't just swaying from an earthquake—it's being attacked by something.
I need to make the scene vivid and graphic. So, I'll describe the window exploding in detail—the glass shards flying, the sound, the sudden change in the room's atmosphere. Then, I'll have her react—maybe she's cut by the glass, or maybe she sees something outside that makes her realize this isn't just an accident.

# 生成内容
The skyscraper sways, and for a moment, I think it’s just another tremor, one of those little shakes that rattle the building every so often. But then—
A deafening crack.
The window in front of me, floor - to - ceiling glass, suddenly webbed with spidery lines, then—
*Boom.*
It explodes outward in a shower of glittering shards. The force of it knocks me back, my heels scraping against the hardwood floor as I stumble. The wind rushes in, cold and howling, tearing at my clothes, my hair whipping across my face.
I taste metal and dust. The air is thick with it, choking me as I gasp. My hands fly up to my face instinctively—stupid, because the glass is flying *outward*, not inward—but my fingers come away wet. A shallow cut across my cheek, blood welling up, bright and shocking against my skin.
I don’t have time to process it. The building sways again, harder this time, like it’s being shaken by a giant hand. The walls groan, and somewhere in the distance, I hear screams—other people, trapped just like me.
But then I see it.
Outside the gaping hole where the window used to be, something moves against the sky. Not the wind. Not debris. Something *big*.
It’s dark, almost like a silhouette, but it’s wrong. Too many limbs. Too many angles. It’s not human. Not animal. It’s—
A shape detaches itself from the mass and launches itself at the glass. The remaining shards explode outward as it crashes through, and I see its face—if you can call it that—as it turns toward me.
No eyes. Just sockets, oozing black ichor.
Its mouth splits open, too wide, too many teeth—
I scream.
The thing lurches forward, its limbs twisting in unnatural ways as it drags itself across the shattered glass and onto the carpet. The floor trembles beneath its weight, and I catch a whiff of its stench—rotten meat, wet earth, something *dead* and *alive* at the same time.
I back away, my pulse roaring in my ears. My fingers scrabble for the door handle behind me, but before I can turn it, another shape slams into the window. Then another. The glass is gone now, and the room fills with these things, their twisted forms spilling in like a tide of nightmares.
The first one reaches for me, its fingers—too long, too many joints—stretching toward my face. I twist away, but its grip is cold and wet, clinging to my arm like a leech. I cry out as it yanks me forward, its breath hot on my skin, reeking of decay.
The last thing I see before the darkness swallows me whole is its grin—rows and rows of teeth, glistening with something that isn’t saliva.
And then the pain begins.

高级用法

文档中未提及高级用法相关代码示例，故跳过此部分。

📚 详细文档

模型信息

模型设置

聊天/角色扮演及平滑操作设置

在“KoboldCpp”、“oobabooga/text - generation - webui”或“Silly Tavern”中：

• 将“Smoothing_factor”设置为1.5到2.5。
  • 在KoboldCpp中：Settings -> Samplers -> Advanced -> "Smooth_F"。
  • 在text - generation - webui中：parameters -> 右下角。
  • 在Silly Tavern中：称为“Smoothing”。

注意：在“text - generation - webui”中，如果使用GGUFs，需要使用“llama_HF”（这涉及从该模型的源版本下载一些配置文件）。模型的源版本（和配置文件）可在[此处](https://huggingface.co/collections/DavidAU/d - au - source - files - for - gguf - exl2 - awq - gptq - hqq - etc - etc - 66b55cb8ba25f914cbf210be)找到。

其他选项

• 将重复惩罚（rep pen）增加到1.1到1.15（如果使用“smoothing_factor”则无需这样做）。
• 如果运行AI模型的界面/程序支持“二次采样”（“smoothing”），按上述说明进行调整。

高质量设置/最佳操作指南/参数和采样器

这是一个“1类”模型。有关该模型使用的所有设置（包括其“类别”的具体设置）、示例生成以及高级设置指南（很多时候可以解决任何模型问题），包括提高模型在所有用例以及聊天、角色扮演和其他用例中的性能的方法，请参阅[此处](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters)。

🔧 技术细节

文档中未提及具体技术实现细节，故跳过此章节。

📄 许可证

本项目采用Apache 2.0许可证。

⚠️ 重要提示

部分内容包含不适合公开的信息（NSFW）。有生动的描写、强烈的情感、直观的细节、暴力、恐怖、血腥、脏话等内容，同时也有幽默、浪漫和有趣的元素。

💡 使用建议

对于不同的应用场景，可以根据文档中的设置指南调整模型的参数，如采样器参数、重复惩罚等，以获得更好的输出效果。在使用“text - generation - webui”时，若使用GGUFs需注意使用“llama_HF”并下载相关配置文件。