Qwen3 8B NEO Imatrix Max GGUF

🚀 Qwen3-8B-NEO-Imatrix-Max-GGUF

This project focuses on the NEO Imatrix Quants of the new "Qwen 3 - 8B" model. It maximizes the "output tensor" at BF16 to enhance reasoning and output generation. The NEO Imatrix dataset is generated in - house.

✨ Features

• Imatrix Effect: The lower the quant you use, the stronger the Imatrix effect. IQ4XS/IQ4NL is the best - balanced quant for quality and Imatrix effect. These quants are also great for creative use cases. For stronger reasoning, higher quants are recommended. The Q8_0 quant is maxed only as Imatrix has no effect on it. F16 is full precision.
• Context Length: It supports a context length of 32 K + 8K output generation, which can be extended to 128k.
• Jinja Template: If you encounter issues with the Jinja "auto template", use the CHATML template. LMSTUDIO users can update the Jinja Template by copying from [https://lmstudio.ai/neil/qwen3 - thinking].
• System Role: Most of the time, Qwen3s generate their own reasoning/thinking blocks. But you can use the suggested system role if needed.
• Optimal Settings: It's a "Class 1" model. For all settings, example generation, advanced settings, and methods to improve model performance, refer to [https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters].
• Optional Enhancement: There are optional system prompts that can enhance scene generation and continuation functions.

📚 Documentation

Jinja Template / Template to Use with this Model

If you are having issues with Jinja "auto template", use CHATML template. OR (LMSTUDIO users / option) Update the Jinja Template (go to this site, template-> copy the "Jinja template" and then paste.) [ https://lmstudio.ai/neil/qwen3 - thinking ]

System Role - Suggested

You may or may not need this, as most times Qwen3s generate their own reasoning/thinking blocks.

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

See document "Maximizing - Model - Performance - All..." below for how to "set" system role in various LLM/AI apps below.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This a "Class 1" model: For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see: [ https://huggingface.co/DavidAU/Maximizing - Model - Performance - All - Quants - Types - And - Full - Precision - by - Samplers_Parameters ]

Optional Enhancement

The following can be used in place of the "system prompt" or "system role" to further enhance the model. It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.

This is another system prompt you can use, and you can change the "names" to alter it's performance. This creates a quasi "reasoning" window/block. Your prompt will directly impact how strong this system prompt reacts.

You are a deep thinking AI composed of 4 AIs - [MODE: Spock], [MODE: Wordsmith], [MODE: Jamet] and [MODE: Saten], - you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself (and 4 partners) via systematic reasoning processes (display all 4 partner thoughts) to help come to a correct solution prior to answering. Select one partner to think deeply about the points brought up by the other 3 partners to plan an in - depth solution. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

Other Notes

Reasoning is ON by default in this model, and model will auto - generate "think" block(s). For benchmarks, usage info, settings please see org model card here: [ https://huggingface.co/Qwen/Qwen3 - 8B ] [ Model card, and examples to follow. ]

📄 License

This project is licensed under the Apache - 2.0 license.