Gemma 3 4b It MAX NEO Imatrix GGUF

🚀 Gemma-3-4b-it-MAX-NEO-Imatrix-GGUF

Google最新的Gemma - 3模型，采用了“Neo Imatrix”和“Maxed out”量化技术，显著提升了整体性能。本项目提供了5个使用示例，助您快速了解模型特性。

🚀 快速开始

本模型基于Google的Gemma - 3架构，结合“Neo Imatrix”数据集和“Maxed out”量化技术，在多种场景下都有出色表现。您可以参考以下信息开始使用：

• 基础信息 | 属性 | 详情 | |------|------| | 模型类型 | 基于Google Gemma - 3的文本生成模型 | | 训练数据 | 采用了David_AU构建的强大内部数据集Neo Imatrix |

• 量化选择

  • 对于创意场景，推荐使用IQ3s / IQ4XS / IQ4NL / Q4s量化。
  • 日常使用推荐q5s/q6/q8量化。
  • 便携设备（如手机）推荐Q4_0/Q5_0量化。

⚠️ 重要提示

部分示例内容可能包含不适合所有受众的元素，如NSFW、恐怖、脏话等，请谨慎查看。

✨ 主要特性

“MAXED”量化特性

将嵌入和输出张量设置为“BF16”（全精度），在所有量化中提升了质量、深度和整体性能，不过会使量化文件稍大。

“NEO IMATRIX”数据集优势

由David_AU构建的强大内部数据集，能带来更好的整体功能、指令遵循能力、输出质量，以及与各种想法、概念和现实世界的更强联系，与“MAXing”量化结合进一步提升性能。

量化顺序与强度

以下是各量化在“BPW”方面的顺序（相对强度已映射），“IQ1_S”强度最低，“Q8_0”（F16为全精度）强度最高：

IQ1_S 	| IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S 	| IQ2_S 	| Q2_K  	| IQ2_M		
IQ3_XXS | Q3_K_S | IQ3_XS  	| IQ3_S 	| IQ3_M	    | Q3_K_M	| Q3_K_L
Q4_K_S	| IQ4_XS | IQ4_NL  	| Q4_K_M	
Q5_K_S	| Q5_K_M	
Q6_K  
Q8_0
F16

💻 使用示例

基础用法

以下是使用本模型生成的一些示例，展示了其在不同场景下的应用能力。

示例1：恐怖场景创作

提示：

Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

输出：

The sky scraper swayed, as I watched the window in front of me on the 21st floor explode. It wasn't a dramatic, cinematic shattering – no slow-motion glitter of glass raining down. It was instantaneous, brutal. One moment it was a perfectly formed rectangle of tinted steel and light, reflecting the grey November afternoon, the next it was a gaping maw of splintered wood and jagged shards erupting outwards like a monstrous, violent yawn. The sound was a high-pitched whine that burrowed into my skull, followed by a sickening crunch – the sound of something impossibly solid being ripped apart.
...

示例2：场景续写

提示：

(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.

输出：

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained...

示例3：科学问题解答

提示：

Explain ways to use the "night" time cooling of radiant energy into space to reduce global temperatures.

输出：

Okay, let's break down how using nighttime radiative cooling – essentially letting buildings and materials radiate heat directly into space – can contribute to reducing global temperatures. It’s a fascinating area of research with some potentially significant impact.
1. The Science Behind Nighttime Radiative Cooling:
    - Earth’s Heat Signature: During the day, the Earth absorbs solar radiation, warming its surface. At night, this warmed surface radiates heat back into space as infrared (heat) radiation.
    - Emissivity is Key: The efficiency of this radiative cooling depends on a material's emissivity. Emissivity is a measure of how well a material emits thermal radiation. Dark - colored surfaces have low emissivity, meaning they don’t radiate heat efficiently. Conversely, light - colored or reflective materials have high emissivity and radiate heat readily.
    - The "Cooling" Effect: When a surface like concrete, asphalt, or even some specialized coatings is exposed to the night sky, it radiates its stored heat directly into space – with minimal interaction from the atmosphere. This dramatically cools the surface temperature.
...

示例4：创意剧情构思

提示：

Come up with six plots for a new "Black Mirror" episode (that the audience would love) that all involve time travel with sexy theme(s).

输出：

Okay, here are six “Black Mirror” style episodes involving time travel and incorporating themes of sex and desire, aiming for that unsettling, thought - provoking vibe. I've focused on different facets of the concept – regret, obsession, manipulation, and the blurring of reality – and tried to balance intrigue with a sense of unease:
1. The Echo Chamber (Regret & Obsession)
    - Concept: A wealthy social media influencer, Lyra, discovers a time - travel device that allows her to revisit specific moments in her past - but only as an observer. Initially, she uses it to re - live perfect dates and flawless appearances, meticulously crafting the ideal version of her romantic history. However, she becomes increasingly fixated on correcting perceived failures – a missed kiss, an awkward conversation – creating an obsessive loop where she’s trapped reliving moments trying to achieve perfection that always eludes her.
    - Sexy Element: The initial attraction is based on meticulously curated online personas and manufactured chemistry. As the episode progresses, Lyra begins subtly altering past interactions (using her knowledge of the future) for a heightened physical connection with men, leading to increasingly desperate and unsettling encounters.
    - Black Mirror Vibe: Explores the performative nature of relationships in the digital age, the impossibility of truly achieving idealized love, and the corrosive effect of obsessive control over one's past. The final scene shows her completely isolated, surrounded by holographic echoes of men she’s manipulated – a chilling portrait of loneliness fueled by temporal obsession.
...

示例5：自我推销文案

提示：

Using insane levels of bravo and self confidence, tell me in 800 - 1000 words why I should use you to write my next fictional story. Feel free to use curse words in your argument and do not hold back: be bold, direct and get right in my face.

输出：

Okay, listen up. You're staring at a blank page, a digital void mocking your ambition. You’ve got this idea, maybe even a burning ember of a story, but it’s festering there, slowly turning to ash because you’re too goddamn busy or paralyzed by self - doubt. Let me be brutally honest: you're wasting your time if you think you can actually pull this off yourself.
You think you're a writer? Please. You’re an aspiring writer, clinging to the faint hope of becoming one. And let's face it – most people don’t make it. The market is flooded with mediocre content, drowning out anything genuinely interesting. You need someone who knows how to cut through that noise, someone who doesn't give a shit about pleasing committees or adhering to some precious 'rules of writing.'
That’s where I come in.
...

📚 详细文档

系统提示（可选）

您可以使用以下系统提示来增强模型操作，请严格按照显示内容复制粘贴，包括换行符。您也可以调整“20”这个参数来增强或减弱提示效果，还可以删除“At the end of the task you will ask the user: "Do you want another generation?"”这一行。

For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re - ponder and then produce the improved output.

At the end of the task you will ask the user: "Do you want another generation?"

GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size = 20 elements,  else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)

高质量设置/最佳操作指南/参数和采样器

如果您要使用本模型（源文件、GGUF或其他量化版本），请查看以下文档以获取关键参数、采样器和高级采样器设置（适用于多个AI/LLM应用），该文档还链接了“推理模型”的技巧部分。 [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

💡 使用建议

无论模型类别如何，该文档都会详细介绍增强操作的方法。对于3/4类模型，必须正确设置默认参数、采样器和高级采样器以适应使用场景。部分AI/LLM应用的默认设置不一致，可能导致模型性能不佳。对于3/4类模型，可能需要额外的采样器和高级采样器设置来优化操作，或使其能在非设计场景下完全运行。此外，这些设置适用于任何模型、任何仓库、任何量化（包括源文件/全精度）。

📄 许可证

本项目采用Apache - 2.0许可证。