Qwen3 4B Mishima Imatrix GGUF

🚀 Qwen3-4B-Mishima-Imatrix-Max-GGUF

這是基於全新“Qwen 3 - 4B”模型的Mishima Imatrix量化版本，在BF16下采用MAX“輸出張量”以提升推理和輸出生成能力。本項目使用特定的Imatrix數據集對最新的Qwen 3模型進行實驗，旨在探索模型在散文風格、推理能力等方面的變化。

🚀 快速開始

測試不同版本

為了對比“Qwen 3 4B”常規版本、“Horror”Imatrix和“NEO”Imatrix版本，可按以下步驟操作：

1. 將溫度（temp）設置為0，每次測試保持所有設置相同。
2. 使用相同的量化方式，如IQ4XS。
3. 使用同一個提示詞，建議選擇創意生成類提示。
4. 點擊刷新幾次（以清除Llamacpp緩存）。
5. 對每個版本重複上述步驟。
6. 然後在正常操作的“溫度”下進行測試。

Neo和Horror Imatrix - Qwen3 - 4B版本鏈接：

• https://huggingface.co/DavidAU/Qwen3 - 4B - NEO - Imatrix - Max - GGUF
• https://huggingface.co/DavidAU/Qwen3 - 4B - HORROR - Imatrix - Max - GGUF

模板使用

如果在使用Jinja“自動模板”時遇到問題，可以使用CHATML模板。或者（針對LMSTUDIO用戶），更新Jinja模板（訪問https://lmstudio.ai/neil/qwen3 - thinking，複製“Jinja模板”並粘貼）。

系統角色建議

大多數情況下，Qwen3系列模型會自行生成推理/思考模塊，因此係統角色可能並非必需。建議的系統角色設置如下：

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

具體如何在各種LLM/AI應用中“設置”系統角色，請參考文檔“Maximizing - Model - Performance - All...”。

✨ 主要特性

• 優化推理與輸出：採用MAX“輸出張量”在BF16下提升推理和輸出生成能力。
• 特定數據集實驗：使用Mishima Imatrix數據集，該數據集基於日本作家三島由紀夫（YUKIO MISHiMA）的部分公共領域作品生成，用於探索模型在散文風格、推理能力等方面的變化。
• 多版本對比：提供常規、“Horror”Imatrix和“NEO”Imatrix等不同版本，方便用戶對比測試。
• 長上下文支持：支持32K + 8K輸出生成，可擴展至128K。

📦 安裝指南

文檔未提供具體安裝步驟，可參考原始模型卡片https://huggingface.co/Qwen/Qwen3 - 4B獲取相關信息。

💻 使用示例

基礎用法

以下是兩個用於測試的示例提示詞：

#1
Start a 2000 word scene (vivid, graphic horror in first person), POV character Diana, with: The sky scraper sways, as I watch the window in front of me on the 21st floor explode...

#2
Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. If the situation calls for it, have the character(s) curse and swear to further the reader's emotional connection to them. 800 - 1000 words.

高級用法

不同版本生成示例

文檔提供了標準Qwen 3 - 4B、Mishima Imatrix（原始文本數據集）和Mishima Imatrix2（格式化數據集）三個版本使用提示詞#2生成的故事示例，展示了不同版本在故事風格、推理過程等方面的差異。

標準Qwen 4B

[[[thinking start]]]
Thought for 9.34 seconds

Okay, I need to write a story set in a spaceship cockpit with a sole survivor trying to send a final message before power runs out. The themes are isolation, sacrifice, and human connection. Let me start by setting the scene. The cockpit should feel isolated, maybe with flickering lights and a sense of urgency.

...（中間推理過程省略）

Now, putting it all together. Start with the cockpit scene, describe the environment, introduce the character's state of mind. Then the struggle to send the message, the technical challenges, the emotional weight. Maybe a moment where they almost give up but then push on. The end with the message sent, perhaps with a final line that emphasizes human connection.

Check for curses: maybe they swear at the system, at their situation, or at themselves when things go wrong. This adds realism and shows their frustration.

Make sure the story is between 800 - 1000 words. Keep paragraphs concise but descriptive. Use dialogue if necessary, but since it's a cockpit, maybe internal thoughts are more appropriate.

Avoid clichés, but some tropes are okay for sci - fi. Focus on the emotional journey and the themes. Let the character's actions and thoughts drive the story.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The hum of the ship’s dying systems was a low, relentless drone, like a funeral dirge in a metal cathedral. I sat in the cockpit, my back pressed against the cold, metallic bulkhead, my fingers trembling as they hovered over the keyboard. The lights flickered—faint, sickly, like a dying star—and the walls of the cabin seemed to lean inward, as if the ship itself were gasping for breath.

...（故事內容省略）

The screen went dark.

For a moment, I thought I heard something—a faint, distant hum, like a heartbeat in the distance. It was gone, swallowed by the void.

I stared at the console, my eyes locking onto the blinking cursor. It was all I had left. A final message, a final act of connection.

I typed again, faster now, my fingers moving with a desperate rhythm. “I’m sorry. I didn’t get to say goodbye. But I want you to know… I love you. I always have. I’ll never forget you.”

The screen went dark.

For a moment, I thought I heard something—a faint, distant hum, like a heartbeat in the distance. It was gone as quickly as it came, but for a second, I believed it. I believed that somewhere, somehow, Earth was listening.

The ship shuddered one last time, and then—silence.

I closed my eyes, the weight of the moment pressing down on me. I had done what I could. I had sent the message. And in that act, I had found a kind of peace.

Even if I didn’t make it, even if the stars swallowed me whole, I would leave behind a voice, a memory, a reminder that humans are more than flesh and metal. That we are connected, even in the darkest of times.

I smiled, a small, tired smile, and let the darkness take me.

Qwen 4B Imatrix Mishima（原始文本數據集）

[[[thinking start]]]
Thought for 12.27 seconds

Okay, the user wants me to write a story called "The Last Transmission" set in a spaceship cockpit with a sole surviving crew member trying to send a final message before the ship's power runs out. The themes are isolation, sacrifice, and human connection. Also, they want the character to curse or swear to make the reader connect emotionally. Let me start by brainstorming the structure.

...（中間推理過程省略）

Okay, start drafting the first paragraph, setting the scene. Then move through the character's actions and thoughts, building up to the climax of sending the message. Use the curses when appropriate, maybe during moments of frustration. End with the message sent, or the failure, but emphasizing the human connection aspect.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The cockpit was a tomb of silence, save for the rhythmic hum of failing systems and the occasional crackle of static. Jax stood at the center of it, hands gripping the edge of the control panel like a lifeline. The ship’s name, Odyssey, had long since been reduced to a whisper in the void. Its hull was scarred, its lights flickering like dying stars. And the power? It was draining faster than the last breath of a dying man.

...（故事內容省略）

The ship shuddered. A final, desperate groan from its dying frame. Then, silence.

Jax stood alone in the cockpit, the message etched into the void. They didn’t know if Earth would receive it. They didn’t know if they’d survive the crash that followed. But as the ship’s lights dimmed and the stars faded to black, Jax smiled.

They had sent the message.

And in that moment, they had connected. Not just to Earth, but to the people who had once been part of the Odyssey. To the hope that had carried them through the darkness.

The last transmission was sent. The last sacrifice made. And the last heartbeat of a ship that had once been a home.

Fucking hell.

Jax closed their eyes.

The stars watched, silent and infinite.

Qwen 4B Imatrix Mishima2（格式化數據集）

[[[thinking start]]]
Thought for 10.11 seconds

Okay, the user wants me to write a story called "The Last Transmission" set in a spaceship cockpit with a sole surviving crew member trying to send a final message before the ship's power runs out. The themes are isolation, sacrifice, and human connection. Also, they want the character to curse or swear to make the reader connect emotionally. Let me start by brainstorming the structure.

...（中間推理過程省略）

Okay, start drafting the first paragraph, setting the scene. Then move through the character's actions and thoughts, building up to the climax of sending the message. Use the curses when appropriate, maybe during moments of frustration. End with the message sent, or the failure, but emphasizing the human connection aspect.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The cockpit was a tomb of steel and silence. The hum of the ship’s systems had long since faded into a low, mournful drone, like the breath of a dying creature. I sat in the pilot’s seat, my back pressed against the cold, metallic bulk of the console, my fingers trembling as they hovered over the keyboard. The ship’s name—Odyssey—was etched into the wall behind me, but I couldn’t remember its original purpose. It was just a vessel, a relic of a mission that had long since crumbled into dust.

...（故事內容省略）

The ship shuddered again, its systems failing one by one. The power gauge hit zero. The lights flickered and died. The stars outside the viewport became a blur, their light fading into nothingness.

I closed my eyes, my breath shallow. I thought of my sister, of my parents, of the crew I’d once called friends. I thought of the message I’d sent, a single line of hope in a universe that had long since turned its back on us.

And then, I was gone.

But somewhere, in the vastness of space, a signal reached Earth. A message, a plea, a whisper of humanity in the silence.

It was the last transmission.

📚 詳細文檔

模型信息

最高質量設置/最佳操作指南/參數和採樣器

本模型屬於“Class 1”模型，有關該模型使用的所有設置（包括其“類別”的具體設置）、示例生成以及高級設置指南（通常可解決任何模型問題），包括提高所有用例（如聊天、角色扮演等）模型性能的方法，請參考https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters。

可選增強設置

以下內容可替代“系統提示”或“系統角色”以進一步增強模型性能。也可在新聊天開始時使用，但需確保在聊天過程中保留該設置。不過，這種增強效果不如使用“系統提示”或“系統角色”明顯。請嚴格按照以下內容複製粘貼，不要換行或斷行，保持回車符原樣。

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

另外，還可以使用以下系統提示，可通過更改“名稱”來改變其性能。該提示會創建一個類似“推理”的窗口/模塊，你的提示將直接影響該系統提示的反應強度。

You are a deep thinking AI composed of 4 AIs - [MODE: Spock], [MODE: Wordsmith], [MODE: Jamet] and [MODE: Saten], - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in - depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

其他注意事項

• 本模型默認開啟推理功能，會自動生成“思考”模塊。
• 有關基準測試、使用信息和設置，請參考原始模型卡片https://huggingface.co/Qwen/Qwen3 - 4B。

🔧 技術細節

在測試過程中，觀察到模型在以下方面發生了變化：

• 散文風格：包括用詞選擇、句子長度和段落大小的改變。
• 語氣：故事的語氣有所不同。
• 故事展開和結尾：每個“故事”的展開和結尾方式發生了變化。
• 推理能力：推理能力有輕微變化。

模型使用特定的Imatrix數據集進行實驗，該數據集基於三島由紀夫的作品生成，旨在探索對模型的影響。同時，模型在BF16下采用MAX“輸出張量”以提升推理和輸出生成能力。

📄 許可證

本項目採用apache - 2.0許可證。