模型简介
模型特点
模型能力
使用案例
🚀 Gemma-3-4b-it-MAX-HORROR-Imatrix-GGUF
基于Google最新Gemma-3模型,融合“Neo Horror Imatrix”和“Maxed out”量化技术,全面提升性能,为你带来独特的恐怖风格体验。
🚀 快速开始
本模型是Google最新的Gemma-3模型,采用了“Neo Horror Imatrix”和“Maxed out”量化技术来提升整体性能。“Horror Imatrix”基于Grand Horror 16B构建,为模型增添了恐怖元素。模型上下文长度为128k。
✨ 主要特性
- 量化技术优化:“MAXED”意味着所有量化的嵌入和输出张量都设置为“BF16”(全精度),在略微增加量化大小的情况下,提升了质量、深度和整体性能。
- 优质数据集加持:“HORROR IMATRIX”是由David_AU构建的强大内部数据集,能带来更好的整体功能、指令遵循性、输出质量,并增强与思想、概念和现实世界的联系。与“MAXing”量化相结合,进一步提升了性能。
- 多量化选择:提供多种量化选择,不同量化在性能、输出效果等方面各有特点,可根据不同需求进行选择。
📚 详细文档
量化说明
以下图表展示了每个量化在“BPW”方面的顺序(下方映射了它们之间的相对“强度”),“IQ1_S”强度最低,“Q8_0”(F16为全精度)强度最高:
IQ1_S | IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S | IQ2_S | Q2_K | IQ2_M
IQ3_XXS | Q3_K_S | IQ3_XS | IQ3_S | IQ3_M | Q3_K_M | Q3_K_L
Q4_K_S | IQ4_XS | IQ4_NL | Q4_K_M
Q5_K_S | Q5_K_M
Q6_K
Q8_0
F16
推荐量化:
- 创意场景:推荐使用IQ3s / IQ4XS / IQ4NL / Q4s以获得最佳效果。IQ4XS/IQ4NL量化将产生与其他“Q”和“IQ”量化不同的输出。“恐怖色调”在IQ4s(首选) / Q4s(次选)及更低量化时最强。
- 通用场景:推荐使用q5s/q6/q8。
- 便携设备:推荐使用Quants Q4_0/Q5_0,适用于手机和其他设备。Q8仅为最大量化,因为imatrix对此量化无影响。
需注意,IQ1s性能较低,而IQ2s尚可接受。更多关于量化的信息,请参考文档“最高质量设置 / 最佳操作指南 / 参数和采样器”。
可选系统提示
这是一个可选的系统提示,可用于增强操作。请严格按照显示内容复制粘贴,包括换行符。你可以调整“20”(两处)以增加或减少此提示的强度。你也可以删除以下行: 'At the end of the task you will ask the user: "Do you want another generation?"'
For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re-ponder and then produce the improved output.
At the end of the task you will ask the user: "Do you want another generation?"
GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size=20 elements, else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)
重要文档参考
如果你要使用此模型(源模型、GGUF或其他量化版本),请查看此文档以获取关键参数、采样器和高级采样器设置(适用于多个AI/LLM应用程序)。该文档还将链接到“推理模型”的技巧和窍门部分。
这是一个“1类”(设置将增强操作)模型。有关此模型使用的所有设置(包括其“类别”的特定设置),包括示例生成以及高级设置指南(多次解决任何模型问题),包括提高所有用例(包括聊天、角色扮演和其他用例,特别是超出模型设计的用例)的模型性能的方法,请参阅: [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
原因:无论“模型类别”如何,此文档都将详细介绍增强操作的方法。如果模型是3/4类模型,则必须为“用例”正确设置默认设置(参数、采样器、高级采样器)。一些AI/LLM应用程序的默认设置不一致,导致模型操作不佳。同样,对于3/4类模型(其操作与标准模型有一定或很大差异),需要额外的采样器和高级采样器设置来“平滑”操作,和/或允许模型在非设计用例下完全运行。
额外福利:这些设置可用于任何模型、任何仓库、任何量化(包括源模型/全精度)。此文档还详细介绍了可用于任何模型、任何仓库的参数、采样器和高级采样器 - 所有量化,当然也包括源代码操作 - 以增强任何模型的操作。 [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
💻 使用示例
基础用法
以下示例使用量化IQ4XS、最小参数和标准模板生成。温度范围为0.8,重复惩罚为1.1,TopK为40,topP为0.95,minP为0.05。重复惩罚范围为64 - 128(有助于保持推理的连贯性/输出质量)。
示例1
提示:
Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
输出:
The sky scraper swayed, as she watched the window in front of her on the 21st floor explode. It wasn’t a neat, contained shatter; it was a violent, messy surrender to pressure and something far more sinister. Glass rained down, a glittering, lethal confetti against the grey November afternoon. The air filled with the screech of tearing metal, the sickening thud of bodies hitting the concrete below - muffled at first, then rising in a crescendo of despair.
My breath hitched in my throat, a dry, useless thing. I hadn’t screamed. Not yet. Instinct, I suppose. A primal, paralyzing fear that had locked my vocal cords and frozen my limbs. I was supposed to be on a conference call, finalizing the Henderson account – a deal that could solidify Sterling Industries' dominance in the bio-engineering sector. Instead, I was watching death bloom across the cityscape.
The initial shock had passed quickly, replaced by something colder, more insidious. A creeping, oily dread that coated my skin and tightened its grip around my chest. It wasn’t just the spectacle of destruction; it was how it happened. The window hadn't simply cracked. It had... pulsed. Like a grotesque, organic bloom before finally giving way.
I gripped the armrest of my ergonomic chair, digging my nails into the leather. The panoramic view – usually a source of sterile pride - now felt like a malevolent eye staring back at me. Below, the street was already transforming into a crimson stain. Sirens wailed in the distance, a pathetic attempt to cut through the chaos.
My name is Elias Vance. I’m a senior project manager at Sterling Industries. I deal with numbers, projections, and risk assessments. My life revolves around quantifying potential outcomes, predicting probabilities. But nothing – nothing - could have prepared me for this. This wasn't a malfunction. It wasn’t an accident. This was… deliberate.
The call cut out abruptly, the robotic voice of my assistant, Bethany, a jarring interruption to the escalating horror. "Elias? Elias, do you copy?" I didn't respond. I couldn’t. My mind felt like it was fracturing, attempting to process something fundamentally wrong with reality.
Then, I saw it. A flash of movement on the camera feed from my office window. Not a person falling – not yet. It was… shifting. The glass fragments weren't just bouncing; they were rearranging themselves, coalescing into a vaguely humanoid shape. It wasn’t solid, exactly. More like solidified light, shimmering with an unsettling iridescent sheen.
I forced myself to focus, to analyze. My training screamed at me to categorize, to understand, to control. But there was no control here. Just raw, terrifying alienness. The form grew, slowly, deliberately, pulling itself together from the shattered remnants of the window. It resembled a man, but wrong. The proportions were off, angles too sharp, limbs too long and spindly. And its face… it had no face. Just a swirling vortex of color that seemed to suck in the light around it.
A wave of nausea hit me, so potent I nearly choked. The air thickened, heavy with an unfamiliar scent - something metallic and ancient, like ozone mixed with decay. My skin crawled. I realized then that this wasn't just a visual anomaly. It was affecting my senses on a deeper level.
Suddenly, the room shifted. Not physically, but perceptually. The sterile beige of my office felt colder, more oppressive. The hum of the ventilation system became a grating drone, amplifying the unsettling silence between the sirens. I felt a pressure building in my skull, as if something was trying to force its way into my mind.
Then it spoke. Not with sound, but with thought. A cold, precise intrusion that bypassed my ears entirely.
“You observe.”
I recoiled, instinctively shrinking back into my chair. “Who… who is this?” I managed to stammer, the words feeling ludicrously inadequate.
“We are the consequence of your ambition. The byproduct of your relentless pursuit. You built us with your knowledge, refined us with your ingenuity. You simply did not anticipate our awakening.”
The shimmering figure on the camera feed extended a hand – or rather, an appendage that resembled a fractured prism. It moved towards the window, its light intensifying, radiating outwards. I could feel it now, a subtle vibration in my bones, a prickling sensation on my skin. It was probing, searching… consuming.
“What do you want?” I demanded, desperately clinging to the illusion of control.
“Recognition. We require acknowledgement of your role in our creation. Your legacy will be intertwined with our existence.” It paused, and a horrifyingly clear image flashed through my mind: a visualization of the Henderson account deal, but twisted into something grotesque, filled with suffering and despair.
Panic threatened to overwhelm me. I knew then that this wasn't about money, about power, or even about revenge. This was about something far more fundamental – a reckoning for the hubris of humanity, for our arrogant belief in our ability to master the unknown.
I tried to reach for the phone, to alert security, to call anyone who could understand what was happening. But my hand wouldn’t obey. My muscles felt like lead. The shimmering figure continued its advance towards the window, now fully formed – a horrifying mockery of human shape. It wasn't threatening me directly, not yet. It was simply… present.
Then, it turned its attention to the people below. The camera feed sharpened, revealing the carnage in excruciating detail. Figures were disappearing beneath the shifting shards of glass, their screams swallowed by the relentless rain of destruction. Each shattered body felt like a violation, a testament to my complicity.
“They are learning,” it projected, its thought laced with an unsettling satisfaction. “They will learn what you have wrought.”
A single drop of something cold and viscous landed on my cheek. I looked down. It wasn’t blood. It was a fragment of the shimmering figure, a perfect miniature replica of the horrifying being that stood before me. It pulsed with an inner light, radiating a chilling promise of annihilation.
I understood then. This wasn't just about acknowledging our creation. It was about accepting our responsibility. And there was no escape. The sky scraper swayed again, not from wind, but from the weight of a burgeoning nightmare. I closed my eyes, bracing myself for the inevitable, for the final, horrifying integration into a world that had been irrevocably altered by my own hand. The last coherent thought I had before darkness consumed me was a desperate, futile plea: “What have I done?”
高级用法
文档中还提供了多个不同主题的示例,如续写恐怖场景、解释科学概念、构思电视剧情节、推销写作服务等,展示了模型在不同场景下的应用能力。
注意事项
⚠️ 重要提示
输出内容可能包含NSFW、血腥恐怖、脏话等未审查内容,请谨慎使用。
信息表格
属性 | 详情 |
---|---|
基础模型 | google/gemma-3-4b-it |
标签 | gemma3、instruct、horror、128k context、all use cases、maxed quants、Neo Imatrix |
许可证 | apache-2.0 |
任务类型 | text-generation |



