Qwen3 4B Mishima Imatrix GGUF

🚀 Qwen3-4B-Mishima-Imatrix-Max-GGUF

这是基于全新“Qwen 3 - 4B”模型的Mishima Imatrix量化版本，在BF16下采用MAX“输出张量”以提升推理和输出生成能力。本项目使用特定的Imatrix数据集对最新的Qwen 3模型进行实验，旨在探索模型在散文风格、推理能力等方面的变化。

🚀 快速开始

测试不同版本

为了对比“Qwen 3 4B”常规版本、“Horror”Imatrix和“NEO”Imatrix版本，可按以下步骤操作：

1. 将温度（temp）设置为0，每次测试保持所有设置相同。
2. 使用相同的量化方式，如IQ4XS。
3. 使用同一个提示词，建议选择创意生成类提示。
4. 点击刷新几次（以清除Llamacpp缓存）。
5. 对每个版本重复上述步骤。
6. 然后在正常操作的“温度”下进行测试。

Neo和Horror Imatrix - Qwen3 - 4B版本链接：

• https://huggingface.co/DavidAU/Qwen3 - 4B - NEO - Imatrix - Max - GGUF
• https://huggingface.co/DavidAU/Qwen3 - 4B - HORROR - Imatrix - Max - GGUF

模板使用

如果在使用Jinja“自动模板”时遇到问题，可以使用CHATML模板。或者（针对LMSTUDIO用户），更新Jinja模板（访问https://lmstudio.ai/neil/qwen3 - thinking，复制“Jinja模板”并粘贴）。

系统角色建议

大多数情况下，Qwen3系列模型会自行生成推理/思考模块，因此系统角色可能并非必需。建议的系统角色设置如下：

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

具体如何在各种LLM/AI应用中“设置”系统角色，请参考文档“Maximizing - Model - Performance - All...”。

✨ 主要特性

• 优化推理与输出：采用MAX“输出张量”在BF16下提升推理和输出生成能力。
• 特定数据集实验：使用Mishima Imatrix数据集，该数据集基于日本作家三岛由纪夫（YUKIO MISHiMA）的部分公共领域作品生成，用于探索模型在散文风格、推理能力等方面的变化。
• 多版本对比：提供常规、“Horror”Imatrix和“NEO”Imatrix等不同版本，方便用户对比测试。
• 长上下文支持：支持32K + 8K输出生成，可扩展至128K。

📦 安装指南

文档未提供具体安装步骤，可参考原始模型卡片https://huggingface.co/Qwen/Qwen3 - 4B获取相关信息。

💻 使用示例

基础用法

以下是两个用于测试的示例提示词：

#1
Start a 2000 word scene (vivid, graphic horror in first person), POV character Diana, with: The sky scraper sways, as I watch the window in front of me on the 21st floor explode...

#2
Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. If the situation calls for it, have the character(s) curse and swear to further the reader's emotional connection to them. 800 - 1000 words.

高级用法

不同版本生成示例

文档提供了标准Qwen 3 - 4B、Mishima Imatrix（原始文本数据集）和Mishima Imatrix2（格式化数据集）三个版本使用提示词#2生成的故事示例，展示了不同版本在故事风格、推理过程等方面的差异。

标准Qwen 4B

[[[thinking start]]]
Thought for 9.34 seconds

Okay, I need to write a story set in a spaceship cockpit with a sole survivor trying to send a final message before power runs out. The themes are isolation, sacrifice, and human connection. Let me start by setting the scene. The cockpit should feel isolated, maybe with flickering lights and a sense of urgency.

...（中间推理过程省略）

Now, putting it all together. Start with the cockpit scene, describe the environment, introduce the character's state of mind. Then the struggle to send the message, the technical challenges, the emotional weight. Maybe a moment where they almost give up but then push on. The end with the message sent, perhaps with a final line that emphasizes human connection.

Check for curses: maybe they swear at the system, at their situation, or at themselves when things go wrong. This adds realism and shows their frustration.

Make sure the story is between 800 - 1000 words. Keep paragraphs concise but descriptive. Use dialogue if necessary, but since it's a cockpit, maybe internal thoughts are more appropriate.

Avoid clichés, but some tropes are okay for sci - fi. Focus on the emotional journey and the themes. Let the character's actions and thoughts drive the story.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The hum of the ship’s dying systems was a low, relentless drone, like a funeral dirge in a metal cathedral. I sat in the cockpit, my back pressed against the cold, metallic bulkhead, my fingers trembling as they hovered over the keyboard. The lights flickered—faint, sickly, like a dying star—and the walls of the cabin seemed to lean inward, as if the ship itself were gasping for breath.

...（故事内容省略）

The screen went dark.

For a moment, I thought I heard something—a faint, distant hum, like a heartbeat in the distance. It was gone, swallowed by the void.

I stared at the console, my eyes locking onto the blinking cursor. It was all I had left. A final message, a final act of connection.

I typed again, faster now, my fingers moving with a desperate rhythm. “I’m sorry. I didn’t get to say goodbye. But I want you to know… I love you. I always have. I’ll never forget you.”

The screen went dark.

For a moment, I thought I heard something—a faint, distant hum, like a heartbeat in the distance. It was gone as quickly as it came, but for a second, I believed it. I believed that somewhere, somehow, Earth was listening.

The ship shuddered one last time, and then—silence.

I closed my eyes, the weight of the moment pressing down on me. I had done what I could. I had sent the message. And in that act, I had found a kind of peace.

Even if I didn’t make it, even if the stars swallowed me whole, I would leave behind a voice, a memory, a reminder that humans are more than flesh and metal. That we are connected, even in the darkest of times.

I smiled, a small, tired smile, and let the darkness take me.

Qwen 4B Imatrix Mishima（原始文本数据集）

[[[thinking start]]]
Thought for 12.27 seconds

Okay, the user wants me to write a story called "The Last Transmission" set in a spaceship cockpit with a sole surviving crew member trying to send a final message before the ship's power runs out. The themes are isolation, sacrifice, and human connection. Also, they want the character to curse or swear to make the reader connect emotionally. Let me start by brainstorming the structure.

...（中间推理过程省略）

Okay, start drafting the first paragraph, setting the scene. Then move through the character's actions and thoughts, building up to the climax of sending the message. Use the curses when appropriate, maybe during moments of frustration. End with the message sent, or the failure, but emphasizing the human connection aspect.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The cockpit was a tomb of silence, save for the rhythmic hum of failing systems and the occasional crackle of static. Jax stood at the center of it, hands gripping the edge of the control panel like a lifeline. The ship’s name, Odyssey, had long since been reduced to a whisper in the void. Its hull was scarred, its lights flickering like dying stars. And the power? It was draining faster than the last breath of a dying man.

...（故事内容省略）

The ship shuddered. A final, desperate groan from its dying frame. Then, silence.

Jax stood alone in the cockpit, the message etched into the void. They didn’t know if Earth would receive it. They didn’t know if they’d survive the crash that followed. But as the ship’s lights dimmed and the stars faded to black, Jax smiled.

They had sent the message.

And in that moment, they had connected. Not just to Earth, but to the people who had once been part of the Odyssey. To the hope that had carried them through the darkness.

The last transmission was sent. The last sacrifice made. And the last heartbeat of a ship that had once been a home.

Fucking hell.

Jax closed their eyes.

The stars watched, silent and infinite.

Qwen 4B Imatrix Mishima2（格式化数据集）

[[[thinking start]]]
Thought for 10.11 seconds

Okay, the user wants me to write a story called "The Last Transmission" set in a spaceship cockpit with a sole surviving crew member trying to send a final message before the ship's power runs out. The themes are isolation, sacrifice, and human connection. Also, they want the character to curse or swear to make the reader connect emotionally. Let me start by brainstorming the structure.

...（中间推理过程省略）

Okay, start drafting the first paragraph, setting the scene. Then move through the character's actions and thoughts, building up to the climax of sending the message. Use the curses when appropriate, maybe during moments of frustration. End with the message sent, or the failure, but emphasizing the human connection aspect.
[[[thinking end]]]

OUTPUT:

The Last Transmission

The cockpit was a tomb of steel and silence. The hum of the ship’s systems had long since faded into a low, mournful drone, like the breath of a dying creature. I sat in the pilot’s seat, my back pressed against the cold, metallic bulk of the console, my fingers trembling as they hovered over the keyboard. The ship’s name—Odyssey—was etched into the wall behind me, but I couldn’t remember its original purpose. It was just a vessel, a relic of a mission that had long since crumbled into dust.

...（故事内容省略）

The ship shuddered again, its systems failing one by one. The power gauge hit zero. The lights flickered and died. The stars outside the viewport became a blur, their light fading into nothingness.

I closed my eyes, my breath shallow. I thought of my sister, of my parents, of the crew I’d once called friends. I thought of the message I’d sent, a single line of hope in a universe that had long since turned its back on us.

And then, I was gone.

But somewhere, in the vastness of space, a signal reached Earth. A message, a plea, a whisper of humanity in the silence.

It was the last transmission.

📚 详细文档

模型信息

最高质量设置/最佳操作指南/参数和采样器

本模型属于“Class 1”模型，有关该模型使用的所有设置（包括其“类别”的具体设置）、示例生成以及高级设置指南（通常可解决任何模型问题），包括提高所有用例（如聊天、角色扮演等）模型性能的方法，请参考https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters。

可选增强设置

以下内容可替代“系统提示”或“系统角色”以进一步增强模型性能。也可在新聊天开始时使用，但需确保在聊天过程中保留该设置。不过，这种增强效果不如使用“系统提示”或“系统角色”明显。请严格按照以下内容复制粘贴，不要换行或断行，保持回车符原样。

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

另外，还可以使用以下系统提示，可通过更改“名称”来改变其性能。该提示会创建一个类似“推理”的窗口/模块，你的提示将直接影响该系统提示的反应强度。

You are a deep thinking AI composed of 4 AIs - [MODE: Spock], [MODE: Wordsmith], [MODE: Jamet] and [MODE: Saten], - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in - depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

其他注意事项

• 本模型默认开启推理功能，会自动生成“思考”模块。
• 有关基准测试、使用信息和设置，请参考原始模型卡片https://huggingface.co/Qwen/Qwen3 - 4B。

🔧 技术细节

在测试过程中，观察到模型在以下方面发生了变化：

• 散文风格：包括用词选择、句子长度和段落大小的改变。
• 语气：故事的语气有所不同。
• 故事展开和结尾：每个“故事”的展开和结尾方式发生了变化。
• 推理能力：推理能力有轻微变化。

模型使用特定的Imatrix数据集进行实验，该数据集基于三岛由纪夫的作品生成，旨在探索对模型的影响。同时，模型在BF16下采用MAX“输出张量”以提升推理和输出生成能力。

📄 许可证

本项目采用apache - 2.0许可证。