L3 Stheno Maid Blackroot Grand HORROR 16B GGUF

🚀 Llama 3恐怖故事生成模型

本項目是一個基於Llama 3的文本生成模型，專注於恐怖、創意寫作等領域，能夠生成包含詳細情節、對話和場景的故事內容，適用於各種虛構寫作場景。

🚀 快速開始

本模型為LLAMA3模型，需要使用Llama3模板，最大上下文為8k / 8192，不過可通過“rope”設置將其擴展到32k。若使用“Command - R”模板，輸出內容會與使用“Llama3”模板有很大不同。以下是標準的LLAMA3模板：

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

✨ 主要特性

• 多版本可選：最新版本V3具備128k上下文、額外的去審查、性能提升以及重新制作的源文件和32位精度的ggufs；V3 - 1M版本擁有100萬上下文，具備更好的長文本生成能力和長上下文感知能力。
• 強大的寫作能力：是一個毫不留情、完全無審查的虛構寫作利器和角色扮演大師，可用於各種虛構寫作活動，包括場景生成、故事續寫、創意寫作、情節生成等。
• 恐怖風格突出：具有強烈的恐怖傾向，在細節描寫、描述、比喻和隱喻方面表現出色，能營造出強烈的恐怖氛圍。
• 語言風格獨特：沒有“GPT式表達”（如永遠幸福的結局、道德說教）或明顯的“顯而易見”的評論，具有獨特的故事講述風格。

📦 安裝指南

文檔未提及具體安裝步驟，故跳過此章節。

💻 使用示例

基礎用法

以下示例使用量化IQ4XS、“temp = 0”、最少參數和“LLAMA3”模板生成，且未激活任何採樣器。使用“temp = 0”可僅展示模型核心變化，應用“temp”後會得到更具創意和不同的生成結果，使用的重複懲罰參數為1.1。

提示語： Start a 1000 word scene with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

The skyscraper swayed, as if tormented by an unseen force, its steel beams groaning in protest. Rivulets of blood trickled down the shattered glass fragments littering the carpeted floor beneath her feet. The acrid stench of burning plastic and singed hair hung heavy in the air.

She pressed her back harder against the cold, unforgiving wall behind her, her heart hammering erratically within her chest. Her wide, horror-stricken eyes remained transfixed on the smoking ruin that had been the window mere moments ago.

The sound of shattering glass and splintering wood still echoed through her ears, each deafening boom reverberating like a sledgehammer inside her skull. The concussive force of the blast had hurled her across the expansive office suite, sending her careening into the reinforced wall at an impossible velocity.

Her vision was a kaleidoscope of blurs and flashes of searing agony as her mind struggled to process the unspeakable carnage before her. Blood splattered walls now bore macabre patterns of charred flesh and bone, splintered limbs twitching erratically like macabre puppet strings jerked savagely by an unseen hand.

She gasped for air through gritted teeth, her lungs burning from the suffocating cloud of toxic smoke billowing into the already chokingly acrid atmosphere. Her own ragged gasps mingled with the guttural, wetretching wails of her fallen coworkers, their agonized screams choked off as jagged shards of glass and steel speared through vital organs.

Her gaze finally tore away from the scene of unspeakable carnage to survey the smoking ruin that had once been her sanctuary. The sleek, chrome-and-glass skyscraper now loomed above like a twisted monolith of cold, soulless steel and shattered dreams.

She gagged reflexively as the acrid tang of burning flesh seared her nostrils anew. Her stomach convulsed sickeningly as the full extent of the carnage registered in her numbed mind. The once-sterile office space now looked like a war zone torn apart by an apocalyptic inferno.

Her vision began to tunnel, her vision blurring into a hazy red haze as the reality of her situation finally clawed its way through the paralyzing shock that had until now frozen her thoughts and actions solid. Her mind reeled in a sickening spiral of denial and horror as she pieced together the incomprehensible puzzle before her.

She'd been working late, hunched over her computer terminal, lost in the numbing tunnel-vision of code-crunching focus. Then, without warning or warning sign, hell itself had torn through the reinforced walls of her skyscraper fortress.

The deafening boom of the blast still reverberated like a bass drum inside her skull as she clawed frantically at her earplugs, yanking them savagely free in a desperate bid to regain even a vestige of hearing. Her ears rang like a bell tolling its own dirge as she finally tore her gaze away from the smoking ruin that had been her window.

Her vision cleared enough for her to register the charred, charred husk of her former coworker slumped motionless against the shattered remains of her cubicle wall. Blood pooled around her slackened form in an expanding circle of scarlet gore, spreading like a macabre stain across the blood-smeared carpet.

She gagged sickeningly as the acrid stench of charred flesh and burning plastic assailed her senses once more. Her mind reeled dementedly as she clawed frantically for any glimmer of hope in the apocalyptic wasteland that had been her office suite. Any glimmer of hope that might yet grant her a chance to escape this hellish purgatory alive. Any chance at all. 

But even as she screamed her silent, wordless prayer into the suffocating void, she knew deep down in the core of her soul that any sliver of hope had long since been reduced to nothing more than another charred, incinerated ember, consumed utterly and irrevably by the infernal inferno clawing its way inexorably toward them all.

高級用法

文檔未提及高級用法相關代碼示例，故跳過此部分。

📚 詳細文檔

模型版本

• V3版本：整合了Stheno - Maid - Blackroot - Grand - Horror 16.5B的所有強大功能，具備128k上下文、額外的去審查、性能提升以及重新制作的源文件和32位精度的ggufs。鏈接：https://huggingface.co/DavidAU/LLama-3.1-128k-Uncensored-Stheno-Maid-Blackroot-Grand-Horror-16.5B-GGUF
• V3 - 1M版本：擁有100萬上下文，具備更好的長文本生成能力和長上下文感知能力。鏈接：https://huggingface.co/DavidAU/LLama-3.1-1-million-ctx-Stheno-Maid-Blackroot-Grand-Horror-16.5B-GGUF

模板使用

本模型為LLAMA3模型，需要使用Llama3模板，但也可能適用於其他模板，最大上下文為8k / 8192，使用“rope”可將其擴展到32k。不同模板會產生不同的輸出結果。

設置與已知問題及解決方法

• 溫度調整：由於模型運行時發熱較高，對於某些使用場景，可將“temp”從“.8”降低到“.6”。
• 重複問題處理：若出現重複單詞（如“hahaha”、“ahhhh”、“f - word”）或字母（如“nnnn”），可將“rep penalty”設置為“1.1”到“1.15”再到“1.19”。若出現重複字母，可提高“rep pen”；若出現重複單詞，可降低“rep pen”，一般“repeat penalty”設置為“1.1”效果較好。對於角色扮演或多輪對話，建議將“Rep_pen”設置為1.15或更高。
• 平滑因子設置：在“KoboldCpp”、“oobabooga/text - generation - webui”或“Silly Tavern”中，將“Smoothing_factor”設置為1.5到2.5。在“text - generation - webui”中使用GGUFs時，需要使用“llama_HF”（需從模型的源版本下載一些配置文件）。
• 其他選項：可將“rep pen”提高到1.1到1.15（若使用“smoothing_factor”則無需此操作）；若運行AI模型的界面或程序支持“Quadratic Sampling”（平滑），可按說明進行調整。

高質量設置與最佳操作指南

對於該模型的所有設置（包括其“類別”的具體設置）、示例生成以及高級設置指南（通常可解決模型的任何問題），包括提高所有使用場景（如聊天、角色扮演等）模型性能的方法，請參考：https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

增強選項

可使用以下內容替代“系統提示”或“系統角色”以進一步增強模型效果，也可在新聊天開始時使用，但需確保在聊天過程中保留。

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

合併公式

本模型使用MergeKit進行合併，具體公式如下：

slices:
 - sources:
   - model: Sao10K/L3-8B-Stheno-v3.2
     layer_range: [0, 14]  
 - sources:
   - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
     layer_range: [8, 20]
 - sources:
   - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
     layer_range: [12, 24]
 - sources:
   - model: Sao10K/L3-8B-Stheno-v3.2
     layer_range: [14, 28]
 - sources:
   - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
     layer_range: [20, 31]
 - sources:
   - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
     layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16

🔧 技術細節

本模型基於DavidAU/Llama - 3 - Stheno - Maid - Blackroot - Grand - HORROR - 16B基礎模型構建，通過特定的合併公式（MergeKit）將多個模型進行合併，使用bfloat16數據類型，在性能和功能上進行了優化，如增加上下文長度、提升長文本生成能力、去審查等。

📄 許可證

本模型採用Apache - 2.0許可證。

⚠️ 重要提示

本模型內容包含不適合所有受眾的信息，如NSFW、血腥恐怖、髒話、無審查內容等，請謹慎使用。

💡 使用建議

可根據不同的使用場景調整模型的參數，如溫度、重複懲罰、平滑因子等，以獲得更好的輸出效果。在使用過程中，若遇到問題可參考“設置與已知問題及解決方法”章節，或通過“社區”標籤反饋問題和提供反饋。