L3 Stheno Maid Blackroot Grand HORROR 16B GGUF

🚀 Llama 3恐怖故事生成模型

本项目是一个基于Llama 3的文本生成模型，专注于恐怖、创意写作等领域，能够生成包含详细情节、对话和场景的故事内容，适用于各种虚构写作场景。

🚀 快速开始

本模型为LLAMA3模型，需要使用Llama3模板，最大上下文为8k / 8192，不过可通过“rope”设置将其扩展到32k。若使用“Command - R”模板，输出内容会与使用“Llama3”模板有很大不同。以下是标准的LLAMA3模板：

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

✨ 主要特性

• 多版本可选：最新版本V3具备128k上下文、额外的去审查、性能提升以及重新制作的源文件和32位精度的ggufs；V3 - 1M版本拥有100万上下文，具备更好的长文本生成能力和长上下文感知能力。
• 强大的写作能力：是一个毫不留情、完全无审查的虚构写作利器和角色扮演大师，可用于各种虚构写作活动，包括场景生成、故事续写、创意写作、情节生成等。
• 恐怖风格突出：具有强烈的恐怖倾向，在细节描写、描述、比喻和隐喻方面表现出色，能营造出强烈的恐怖氛围。
• 语言风格独特：没有“GPT式表达”（如永远幸福的结局、道德说教）或明显的“显而易见”的评论，具有独特的故事讲述风格。

📦 安装指南

文档未提及具体安装步骤，故跳过此章节。

💻 使用示例

基础用法

以下示例使用量化IQ4XS、“temp = 0”、最少参数和“LLAMA3”模板生成，且未激活任何采样器。使用“temp = 0”可仅展示模型核心变化，应用“temp”后会得到更具创意和不同的生成结果，使用的重复惩罚参数为1.1。

提示语： Start a 1000 word scene with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

The skyscraper swayed, as if tormented by an unseen force, its steel beams groaning in protest. Rivulets of blood trickled down the shattered glass fragments littering the carpeted floor beneath her feet. The acrid stench of burning plastic and singed hair hung heavy in the air.

She pressed her back harder against the cold, unforgiving wall behind her, her heart hammering erratically within her chest. Her wide, horror-stricken eyes remained transfixed on the smoking ruin that had been the window mere moments ago.

The sound of shattering glass and splintering wood still echoed through her ears, each deafening boom reverberating like a sledgehammer inside her skull. The concussive force of the blast had hurled her across the expansive office suite, sending her careening into the reinforced wall at an impossible velocity.

Her vision was a kaleidoscope of blurs and flashes of searing agony as her mind struggled to process the unspeakable carnage before her. Blood splattered walls now bore macabre patterns of charred flesh and bone, splintered limbs twitching erratically like macabre puppet strings jerked savagely by an unseen hand.

She gasped for air through gritted teeth, her lungs burning from the suffocating cloud of toxic smoke billowing into the already chokingly acrid atmosphere. Her own ragged gasps mingled with the guttural, wetretching wails of her fallen coworkers, their agonized screams choked off as jagged shards of glass and steel speared through vital organs.

Her gaze finally tore away from the scene of unspeakable carnage to survey the smoking ruin that had once been her sanctuary. The sleek, chrome-and-glass skyscraper now loomed above like a twisted monolith of cold, soulless steel and shattered dreams.

She gagged reflexively as the acrid tang of burning flesh seared her nostrils anew. Her stomach convulsed sickeningly as the full extent of the carnage registered in her numbed mind. The once-sterile office space now looked like a war zone torn apart by an apocalyptic inferno.

Her vision began to tunnel, her vision blurring into a hazy red haze as the reality of her situation finally clawed its way through the paralyzing shock that had until now frozen her thoughts and actions solid. Her mind reeled in a sickening spiral of denial and horror as she pieced together the incomprehensible puzzle before her.

She'd been working late, hunched over her computer terminal, lost in the numbing tunnel-vision of code-crunching focus. Then, without warning or warning sign, hell itself had torn through the reinforced walls of her skyscraper fortress.

The deafening boom of the blast still reverberated like a bass drum inside her skull as she clawed frantically at her earplugs, yanking them savagely free in a desperate bid to regain even a vestige of hearing. Her ears rang like a bell tolling its own dirge as she finally tore her gaze away from the smoking ruin that had been her window.

Her vision cleared enough for her to register the charred, charred husk of her former coworker slumped motionless against the shattered remains of her cubicle wall. Blood pooled around her slackened form in an expanding circle of scarlet gore, spreading like a macabre stain across the blood-smeared carpet.

She gagged sickeningly as the acrid stench of charred flesh and burning plastic assailed her senses once more. Her mind reeled dementedly as she clawed frantically for any glimmer of hope in the apocalyptic wasteland that had been her office suite. Any glimmer of hope that might yet grant her a chance to escape this hellish purgatory alive. Any chance at all. 

But even as she screamed her silent, wordless prayer into the suffocating void, she knew deep down in the core of her soul that any sliver of hope had long since been reduced to nothing more than another charred, incinerated ember, consumed utterly and irrevably by the infernal inferno clawing its way inexorably toward them all.

高级用法

文档未提及高级用法相关代码示例，故跳过此部分。

📚 详细文档

模型版本

• V3版本：整合了Stheno - Maid - Blackroot - Grand - Horror 16.5B的所有强大功能，具备128k上下文、额外的去审查、性能提升以及重新制作的源文件和32位精度的ggufs。链接：https://huggingface.co/DavidAU/LLama-3.1-128k-Uncensored-Stheno-Maid-Blackroot-Grand-Horror-16.5B-GGUF
• V3 - 1M版本：拥有100万上下文，具备更好的长文本生成能力和长上下文感知能力。链接：https://huggingface.co/DavidAU/LLama-3.1-1-million-ctx-Stheno-Maid-Blackroot-Grand-Horror-16.5B-GGUF

模板使用

本模型为LLAMA3模型，需要使用Llama3模板，但也可能适用于其他模板，最大上下文为8k / 8192，使用“rope”可将其扩展到32k。不同模板会产生不同的输出结果。

设置与已知问题及解决方法

• 温度调整：由于模型运行时发热较高，对于某些使用场景，可将“temp”从“.8”降低到“.6”。
• 重复问题处理：若出现重复单词（如“hahaha”、“ahhhh”、“f - word”）或字母（如“nnnn”），可将“rep penalty”设置为“1.1”到“1.15”再到“1.19”。若出现重复字母，可提高“rep pen”；若出现重复单词，可降低“rep pen”，一般“repeat penalty”设置为“1.1”效果较好。对于角色扮演或多轮对话，建议将“Rep_pen”设置为1.15或更高。
• 平滑因子设置：在“KoboldCpp”、“oobabooga/text - generation - webui”或“Silly Tavern”中，将“Smoothing_factor”设置为1.5到2.5。在“text - generation - webui”中使用GGUFs时，需要使用“llama_HF”（需从模型的源版本下载一些配置文件）。
• 其他选项：可将“rep pen”提高到1.1到1.15（若使用“smoothing_factor”则无需此操作）；若运行AI模型的界面或程序支持“Quadratic Sampling”（平滑），可按说明进行调整。

高质量设置与最佳操作指南

对于该模型的所有设置（包括其“类别”的具体设置）、示例生成以及高级设置指南（通常可解决模型的任何问题），包括提高所有使用场景（如聊天、角色扮演等）模型性能的方法，请参考：https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

增强选项

可使用以下内容替代“系统提示”或“系统角色”以进一步增强模型效果，也可在新聊天开始时使用，但需确保在聊天过程中保留。

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

合并公式

本模型使用MergeKit进行合并，具体公式如下：

slices:
 - sources:
   - model: Sao10K/L3-8B-Stheno-v3.2
     layer_range: [0, 14]  
 - sources:
   - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
     layer_range: [8, 20]
 - sources:
   - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
     layer_range: [12, 24]
 - sources:
   - model: Sao10K/L3-8B-Stheno-v3.2
     layer_range: [14, 28]
 - sources:
   - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
     layer_range: [20, 31]
 - sources:
   - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
     layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16

🔧 技术细节

本模型基于DavidAU/Llama - 3 - Stheno - Maid - Blackroot - Grand - HORROR - 16B基础模型构建，通过特定的合并公式（MergeKit）将多个模型进行合并，使用bfloat16数据类型，在性能和功能上进行了优化，如增加上下文长度、提升长文本生成能力、去审查等。

📄 许可证

本模型采用Apache - 2.0许可证。

⚠️ 重要提示

本模型内容包含不适合所有受众的信息，如NSFW、血腥恐怖、脏话、无审查内容等，请谨慎使用。

💡 使用建议

可根据不同的使用场景调整模型的参数，如温度、重复惩罚、平滑因子等，以获得更好的输出效果。在使用过程中，若遇到问题可参考“设置与已知问题及解决方法”章节，或通过“社区”标签反馈问题和提供反馈。