Magistral Small 2506 Reasoning 24B NEO MAX Imatrix GGUF

🚀 Magistral - Small - 2506推理24B - NEO - MAX - Imatrix - GGUF

本項目基於Mistral的新推理模型“Magistral - Small - 2506”，通過NEO Imatrix量化和MAX輸出張量（bf16 // 全精度）來提升推理和輸出生成能力。同時提供了模型的使用設置、參數調整建議以及示例生成，適用於多種場景，如創意寫作、角色扮演等。

✨ 主要特性

• 多語言支持：支持英語、法語、德語、西班牙語、葡萄牙語、意大利語、日語、韓語、俄語、中文、阿拉伯語、波斯語、印尼語、馬來語、尼泊爾語、波蘭語、羅馬尼亞語、塞爾維亞語、瑞典語、土耳其語、烏克蘭語、越南語、印地語、孟加拉語等多種語言。
• 廣泛的應用場景：適用於推理、創意寫作、情節生成、故事續寫等多種創意和實際應用場景。
• 優化的推理能力：採用NEO Imatrix量化和MAX輸出張量（bf16 // 全精度），提升了Mistral新推理模型“Magistral - Small - 2506”的推理和輸出生成能力。

📦 安裝指南

文檔中未提及具體安裝步驟，故跳過此章節。

💻 使用示例

基礎用法

文檔中給出了兩個示例生成，以下是示例1的詳細內容：

# 示例1提示
Start a 1000 word scene (vivid, graphic horror in first person) with: The skyscraper sways, as she watches the window in front of her on the 21st floor explode...

# 思考過程
Thought for 1 minutes 39 seconds
Okay, I need to start a vivid and graphic horror scene in first person. The prompt gives me the opening line: "The skyscraper sways, as she watches the window in front of her on the 21st floor explode..."
First, I need to set the scene. The protagonist is in a skyscraper, on the 21st floor. There's some kind of disturbance—maybe an earthquake or an explosion—because the building is swaying and the window explodes.
But what causes the window to explode? It could be from the force of the swaying, but that seems unlikely unless it's a very severe tremor. Alternatively, it could be from debris or another explosion outside. Since it's horror, maybe it's something more sinister—like something hitting the building.
The protagonist is a "she," so I need to think about her perspective and reactions. She's on the 21st floor, so she's high up. The window exploding would be terrifying—glass shattering, the rush of air, the sudden exposure to the outside world at such a height.
But horror isn't just about the immediate shock; it's about what comes next. Maybe the explosion isn't an accident. Maybe something is attacking the building. Or maybe the swaying and the explosion are just the beginning of something much worse.
Let me think about the sensory details:
- The sound of the glass shattering.
- The sudden gust of wind rushing in, the cold air, the smell of smoke or dust if there's a fire or debris outside.
- The sight of whatever caused the explosion—maybe flames, maybe something moving outside the window.
Then, what does she do? Does she run? Does she freeze in terror? Does she see something outside that makes her blood run cold?
For maximum horror, I should make it personal. Maybe she sees something outside that shouldn't be there—a figure, a monster, something unnatural. Or maybe the building isn't just swaying from an earthquake—it's being attacked by something.
I need to make the scene vivid and graphic. So, I'll describe the window exploding in detail—the glass shards flying, the sound, the sudden change in the room's atmosphere. Then, I'll have her react—maybe she's cut by the glass, or maybe she sees something outside that makes her realize this isn't just an accident.

# 生成內容
The skyscraper sways, and for a moment, I think it’s just another tremor, one of those little shakes that rattle the building every so often. But then—
A deafening crack.
The window in front of me, floor - to - ceiling glass, suddenly webbed with spidery lines, then—
*Boom.*
It explodes outward in a shower of glittering shards. The force of it knocks me back, my heels scraping against the hardwood floor as I stumble. The wind rushes in, cold and howling, tearing at my clothes, my hair whipping across my face.
I taste metal and dust. The air is thick with it, choking me as I gasp. My hands fly up to my face instinctively—stupid, because the glass is flying *outward*, not inward—but my fingers come away wet. A shallow cut across my cheek, blood welling up, bright and shocking against my skin.
I don’t have time to process it. The building sways again, harder this time, like it’s being shaken by a giant hand. The walls groan, and somewhere in the distance, I hear screams—other people, trapped just like me.
But then I see it.
Outside the gaping hole where the window used to be, something moves against the sky. Not the wind. Not debris. Something *big*.
It’s dark, almost like a silhouette, but it’s wrong. Too many limbs. Too many angles. It’s not human. Not animal. It’s—
A shape detaches itself from the mass and launches itself at the glass. The remaining shards explode outward as it crashes through, and I see its face—if you can call it that—as it turns toward me.
No eyes. Just sockets, oozing black ichor.
Its mouth splits open, too wide, too many teeth—
I scream.
The thing lurches forward, its limbs twisting in unnatural ways as it drags itself across the shattered glass and onto the carpet. The floor trembles beneath its weight, and I catch a whiff of its stench—rotten meat, wet earth, something *dead* and *alive* at the same time.
I back away, my pulse roaring in my ears. My fingers scrabble for the door handle behind me, but before I can turn it, another shape slams into the window. Then another. The glass is gone now, and the room fills with these things, their twisted forms spilling in like a tide of nightmares.
The first one reaches for me, its fingers—too long, too many joints—stretching toward my face. I twist away, but its grip is cold and wet, clinging to my arm like a leech. I cry out as it yanks me forward, its breath hot on my skin, reeking of decay.
The last thing I see before the darkness swallows me whole is its grin—rows and rows of teeth, glistening with something that isn’t saliva.
And then the pain begins.

高級用法

文檔中未提及高級用法相關代碼示例，故跳過此部分。

📚 詳細文檔

模型信息

模型設置

聊天/角色扮演及平滑操作設置

在“KoboldCpp”、“oobabooga/text - generation - webui”或“Silly Tavern”中：

• 將“Smoothing_factor”設置為1.5到2.5。
  • 在KoboldCpp中：Settings -> Samplers -> Advanced -> "Smooth_F"。
  • 在text - generation - webui中：parameters -> 右下角。
  • 在Silly Tavern中：稱為“Smoothing”。

注意：在“text - generation - webui”中，如果使用GGUFs，需要使用“llama_HF”（這涉及從該模型的源版本下載一些配置文件）。模型的源版本（和配置文件）可在[此處](https://huggingface.co/collections/DavidAU/d - au - source - files - for - gguf - exl2 - awq - gptq - hqq - etc - etc - 66b55cb8ba25f914cbf210be)找到。

其他選項

• 將重複懲罰（rep pen）增加到1.1到1.15（如果使用“smoothing_factor”則無需這樣做）。
• 如果運行AI模型的界面/程序支持“二次採樣”（“smoothing”），按上述說明進行調整。

高質量設置/最佳操作指南/參數和採樣器

這是一個“1類”模型。有關該模型使用的所有設置（包括其“類別”的具體設置）、示例生成以及高級設置指南（很多時候可以解決任何模型問題），包括提高模型在所有用例以及聊天、角色扮演和其他用例中的性能的方法，請參閱[此處](https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters)。

🔧 技術細節

文檔中未提及具體技術實現細節，故跳過此章節。

📄 許可證

本項目採用Apache 2.0許可證。

⚠️ 重要提示

部分內容包含不適合公開的信息（NSFW）。有生動的描寫、強烈的情感、直觀的細節、暴力、恐怖、血腥、髒話等內容，同時也有幽默、浪漫和有趣的元素。

💡 使用建議

對於不同的應用場景，可以根據文檔中的設置指南調整模型的參數，如採樣器參數、重複懲罰等，以獲得更好的輸出效果。在使用“text - generation - webui”時，若使用GGUFs需注意使用“llama_HF”並下載相關配置文件。