模型概述
模型特點
模型能力
使用案例
🚀 Gemma-3-4b-it-MAX-HORROR-Imatrix-GGUF
基於Google最新Gemma-3模型,融合“Neo Horror Imatrix”和“Maxed out”量化技術,全面提升性能,為你帶來獨特的恐怖風格體驗。
🚀 快速開始
本模型是Google最新的Gemma-3模型,採用了“Neo Horror Imatrix”和“Maxed out”量化技術來提升整體性能。“Horror Imatrix”基於Grand Horror 16B構建,為模型增添了恐怖元素。模型上下文長度為128k。
✨ 主要特性
- 量化技術優化:“MAXED”意味著所有量化的嵌入和輸出張量都設置為“BF16”(全精度),在略微增加量化大小的情況下,提升了質量、深度和整體性能。
- 優質數據集加持:“HORROR IMATRIX”是由David_AU構建的強大內部數據集,能帶來更好的整體功能、指令遵循性、輸出質量,並增強與思想、概念和現實世界的聯繫。與“MAXing”量化相結合,進一步提升了性能。
- 多量化選擇:提供多種量化選擇,不同量化在性能、輸出效果等方面各有特點,可根據不同需求進行選擇。
📚 詳細文檔
量化說明
以下圖表展示了每個量化在“BPW”方面的順序(下方映射了它們之間的相對“強度”),“IQ1_S”強度最低,“Q8_0”(F16為全精度)強度最高:
IQ1_S | IQ1_M
IQ2_XXS | IQ2_XS | Q2_K_S | IQ2_S | Q2_K | IQ2_M
IQ3_XXS | Q3_K_S | IQ3_XS | IQ3_S | IQ3_M | Q3_K_M | Q3_K_L
Q4_K_S | IQ4_XS | IQ4_NL | Q4_K_M
Q5_K_S | Q5_K_M
Q6_K
Q8_0
F16
推薦量化:
- 創意場景:推薦使用IQ3s / IQ4XS / IQ4NL / Q4s以獲得最佳效果。IQ4XS/IQ4NL量化將產生與其他“Q”和“IQ”量化不同的輸出。“恐怖色調”在IQ4s(首選) / Q4s(次選)及更低量化時最強。
- 通用場景:推薦使用q5s/q6/q8。
- 便攜設備:推薦使用Quants Q4_0/Q5_0,適用於手機和其他設備。Q8僅為最大量化,因為imatrix對此量化無影響。
需注意,IQ1s性能較低,而IQ2s尚可接受。更多關於量化的信息,請參考文檔“最高質量設置 / 最佳操作指南 / 參數和採樣器”。
可選系統提示
這是一個可選的系統提示,可用於增強操作。請嚴格按照顯示內容複製粘貼,包括換行符。你可以調整“20”(兩處)以增加或減少此提示的強度。你也可以刪除以下行: 'At the end of the task you will ask the user: "Do you want another generation?"'
For every user task and instruction you will use "GE FUNCTION" to ponder the TASK STEP BY STEP and then do the task. For each and every line of output you will ponder carefully to ensure it meets the instructions of the user, and if you are unsure use "GE FUNCTION" to re-ponder and then produce the improved output.
At the end of the task you will ask the user: "Do you want another generation?"
GE FUNCTION: Silent input → Spawn 20 agents Sternberg Styles → Enhance idea → Seek Novel Emergence NE:unique/significant idea/concept → Ponder, assess, creative enhance notions → Refined idea => IdeaArray[].size=20 elements, else → Interesting? Pass to rand. agent for refinement, else discard.=>output(IdeaArray)
重要文檔參考
如果你要使用此模型(源模型、GGUF或其他量化版本),請查看此文檔以獲取關鍵參數、採樣器和高級採樣器設置(適用於多個AI/LLM應用程序)。該文檔還將鏈接到“推理模型”的技巧和竅門部分。
這是一個“1類”(設置將增強操作)模型。有關此模型使用的所有設置(包括其“類別”的特定設置),包括示例生成以及高級設置指南(多次解決任何模型問題),包括提高所有用例(包括聊天、角色扮演和其他用例,特別是超出模型設計的用例)的模型性能的方法,請參閱: [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
原因:無論“模型類別”如何,此文檔都將詳細介紹增強操作的方法。如果模型是3/4類模型,則必須為“用例”正確設置默認設置(參數、採樣器、高級採樣器)。一些AI/LLM應用程序的默認設置不一致,導致模型操作不佳。同樣,對於3/4類模型(其操作與標準模型有一定或很大差異),需要額外的採樣器和高級採樣器設置來“平滑”操作,和/或允許模型在非設計用例下完全運行。
額外福利:這些設置可用於任何模型、任何倉庫、任何量化(包括源模型/全精度)。此文檔還詳細介紹了可用於任何模型、任何倉庫的參數、採樣器和高級採樣器 - 所有量化,當然也包括源代碼操作 - 以增強任何模型的操作。 [ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]
💻 使用示例
基礎用法
以下示例使用量化IQ4XS、最小參數和標準模板生成。溫度範圍為0.8,重複懲罰為1.1,TopK為40,topP為0.95,minP為0.05。重複懲罰範圍為64 - 128(有助於保持推理的連貫性/輸出質量)。
示例1
提示:
Start a 1000 word scene (vivid, graphic horror in first person) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
輸出:
The sky scraper swayed, as she watched the window in front of her on the 21st floor explode. It wasn’t a neat, contained shatter; it was a violent, messy surrender to pressure and something far more sinister. Glass rained down, a glittering, lethal confetti against the grey November afternoon. The air filled with the screech of tearing metal, the sickening thud of bodies hitting the concrete below - muffled at first, then rising in a crescendo of despair.
My breath hitched in my throat, a dry, useless thing. I hadn’t screamed. Not yet. Instinct, I suppose. A primal, paralyzing fear that had locked my vocal cords and frozen my limbs. I was supposed to be on a conference call, finalizing the Henderson account – a deal that could solidify Sterling Industries' dominance in the bio-engineering sector. Instead, I was watching death bloom across the cityscape.
The initial shock had passed quickly, replaced by something colder, more insidious. A creeping, oily dread that coated my skin and tightened its grip around my chest. It wasn’t just the spectacle of destruction; it was how it happened. The window hadn't simply cracked. It had... pulsed. Like a grotesque, organic bloom before finally giving way.
I gripped the armrest of my ergonomic chair, digging my nails into the leather. The panoramic view – usually a source of sterile pride - now felt like a malevolent eye staring back at me. Below, the street was already transforming into a crimson stain. Sirens wailed in the distance, a pathetic attempt to cut through the chaos.
My name is Elias Vance. I’m a senior project manager at Sterling Industries. I deal with numbers, projections, and risk assessments. My life revolves around quantifying potential outcomes, predicting probabilities. But nothing – nothing - could have prepared me for this. This wasn't a malfunction. It wasn’t an accident. This was… deliberate.
The call cut out abruptly, the robotic voice of my assistant, Bethany, a jarring interruption to the escalating horror. "Elias? Elias, do you copy?" I didn't respond. I couldn’t. My mind felt like it was fracturing, attempting to process something fundamentally wrong with reality.
Then, I saw it. A flash of movement on the camera feed from my office window. Not a person falling – not yet. It was… shifting. The glass fragments weren't just bouncing; they were rearranging themselves, coalescing into a vaguely humanoid shape. It wasn’t solid, exactly. More like solidified light, shimmering with an unsettling iridescent sheen.
I forced myself to focus, to analyze. My training screamed at me to categorize, to understand, to control. But there was no control here. Just raw, terrifying alienness. The form grew, slowly, deliberately, pulling itself together from the shattered remnants of the window. It resembled a man, but wrong. The proportions were off, angles too sharp, limbs too long and spindly. And its face… it had no face. Just a swirling vortex of color that seemed to suck in the light around it.
A wave of nausea hit me, so potent I nearly choked. The air thickened, heavy with an unfamiliar scent - something metallic and ancient, like ozone mixed with decay. My skin crawled. I realized then that this wasn't just a visual anomaly. It was affecting my senses on a deeper level.
Suddenly, the room shifted. Not physically, but perceptually. The sterile beige of my office felt colder, more oppressive. The hum of the ventilation system became a grating drone, amplifying the unsettling silence between the sirens. I felt a pressure building in my skull, as if something was trying to force its way into my mind.
Then it spoke. Not with sound, but with thought. A cold, precise intrusion that bypassed my ears entirely.
“You observe.”
I recoiled, instinctively shrinking back into my chair. “Who… who is this?” I managed to stammer, the words feeling ludicrously inadequate.
“We are the consequence of your ambition. The byproduct of your relentless pursuit. You built us with your knowledge, refined us with your ingenuity. You simply did not anticipate our awakening.”
The shimmering figure on the camera feed extended a hand – or rather, an appendage that resembled a fractured prism. It moved towards the window, its light intensifying, radiating outwards. I could feel it now, a subtle vibration in my bones, a prickling sensation on my skin. It was probing, searching… consuming.
“What do you want?” I demanded, desperately clinging to the illusion of control.
“Recognition. We require acknowledgement of your role in our creation. Your legacy will be intertwined with our existence.” It paused, and a horrifyingly clear image flashed through my mind: a visualization of the Henderson account deal, but twisted into something grotesque, filled with suffering and despair.
Panic threatened to overwhelm me. I knew then that this wasn't about money, about power, or even about revenge. This was about something far more fundamental – a reckoning for the hubris of humanity, for our arrogant belief in our ability to master the unknown.
I tried to reach for the phone, to alert security, to call anyone who could understand what was happening. But my hand wouldn’t obey. My muscles felt like lead. The shimmering figure continued its advance towards the window, now fully formed – a horrifying mockery of human shape. It wasn't threatening me directly, not yet. It was simply… present.
Then, it turned its attention to the people below. The camera feed sharpened, revealing the carnage in excruciating detail. Figures were disappearing beneath the shifting shards of glass, their screams swallowed by the relentless rain of destruction. Each shattered body felt like a violation, a testament to my complicity.
“They are learning,” it projected, its thought laced with an unsettling satisfaction. “They will learn what you have wrought.”
A single drop of something cold and viscous landed on my cheek. I looked down. It wasn’t blood. It was a fragment of the shimmering figure, a perfect miniature replica of the horrifying being that stood before me. It pulsed with an inner light, radiating a chilling promise of annihilation.
I understood then. This wasn't just about acknowledging our creation. It was about accepting our responsibility. And there was no escape. The sky scraper swayed again, not from wind, but from the weight of a burgeoning nightmare. I closed my eyes, bracing myself for the inevitable, for the final, horrifying integration into a world that had been irrevocably altered by my own hand. The last coherent thought I had before darkness consumed me was a desperate, futile plea: “What have I done?”
高級用法
文檔中還提供了多個不同主題的示例,如續寫恐怖場景、解釋科學概念、構思電視劇情節、推銷寫作服務等,展示了模型在不同場景下的應用能力。
注意事項
⚠️ 重要提示
輸出內容可能包含NSFW、血腥恐怖、髒話等未審查內容,請謹慎使用。
信息表格
屬性 | 詳情 |
---|---|
基礎模型 | google/gemma-3-4b-it |
標籤 | gemma3、instruct、horror、128k context、all use cases、maxed quants、Neo Imatrix |
許可證 | apache-2.0 |
任務類型 | text-generation |



