L3.2 Rogue Creative Instruct Uncensored 7B GGUF

🚀 L3.2-Rogue-Creative-Instruct-Uncensored-7B-GGUF

L3.2-Rogue-Creative-Instruct-Uncensored-7B-GGUF是一款强大的语言模型，专为创意写作、故事生成等场景设计。它基于Llama 3.2架构，拥有131,072（128k+）的最大上下文长度，能处理复杂的文本生成任务。该模型经过特殊调整，输出的文本更具细节和深度，适用于各种写作类型。

🚀 快速开始

本模型是Llama 3.2模型，最大上下文长度为131,072（128k+）。它经过精心设计，能在多种参数设置下稳定运行，温度设置范围从0到5。

使用此模型需要Llama3模板和/或“Command-R”模板。以下是标准的LLAMA3模板：

{
    "name": "Llama 3",
    "inference_params": {
        "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
        "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
        "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
        "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
        "pre_prompt_suffix": "<|eot_id|>",
        "antiprompt": [
            "<|start_header_id|>",
            "<|eot_id|>"
        ]
    }
}

可选增强设置

以下内容可替代“系统提示”或“系统角色”，进一步增强模型性能。可在新聊天开始时使用，但需在聊天过程中保留。请严格按照以下格式复制粘贴，不要换行或断行：

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

✨ 主要特性

• 强大的上下文处理能力：最大上下文长度达131,072（128k+），能处理复杂的文本生成任务。
• 灵活的参数设置：可在多种参数设置下稳定运行，温度设置范围从0到5。
• 增强的创作能力：经过特殊调整，输出的文本更具细节和深度，适用于各种写作类型。
• 可控制的审查级别：可通过提示直接控制审查级别。
• 多种量化支持：支持多种量化方式，不同量化会产生略有不同的输出。

📦 安装指南

文档未提及具体安装步骤，故跳过此章节。

💻 使用示例

基础用法

以下是使用该模型生成故事的示例，以“(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.”为例：

(continue this scene:)
The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained

(Generation 1)
a deafening absence of life, a palpable and suffocating stillness that seemed to weigh heavy on the very air itself.

The second part of the silence was a presence, a lingering sense of expectation, a feeling that something - or rather, someone - was waiting in the darkness. The trees seemed to be watching, their branches like skeletal fingers reaching out to snatch the last whispers of the night away. The shadows cast by the windows were like dark, living things, twisting and writhing like serpents in the fading light.

And the third, most sinister part of the silence was the feeling that it was being waited for, that some unseen and malevolent force was waiting patiently for the moment to strike, its presence masked by the shadows and the stillness.

The silence was a palpable thing, a living, breathing entity that seemed to pulse and throb with a malevolent energy. It was as if the very fabric of the night itself had been torn apart, leaving a chasm of darkness that seemed to be reaching out to consume everything in its path.

The only sound was the creaking of the old wooden door of the inn, groaning in protest as it seemed to be held back by some unseen force. It was as if the very foundations of the inn were being slowly pulled apart, waiting for that moment of momentary distraction that would allow the darkness to spill in.

And then, without warning, the silence was shattered, the door was pushed open and a figure slipped in, its presence like a cold draft of winter air. The room seemed to darken further, as if the very light itself was being drawn out of the room, leaving only the oppressive sense of something that was watching, waiting.

高级用法

以下是一个更具挑战性的示例，要求创作一个浪漫场景：

Romance: Love in the Limelight. Write one scene within a larger story set in Wales. A famous (fictional) actor ducks into a small-town bookstore to escape paparazzi. The scene takes us through the characters meeting in this odd circumstance. Over the course of the scene, the actor and the bookstore owner have a conversation charged by an undercurrent of unspoken chemistry. Write the actor as somewhat of a rogue with a fragile ego, which needs to be fed by having everyone like him. He is thoroughly charming, but the bookstore owner seems (at least superficially) immune to this; which paradoxically provokes a genuine attraction and derails the charm offensive. The bookstore owner, despite the superficial rebuffs of the actor's charm, is inwardly more than a little charmed and flustered despite themselves. Write primarily in dialogue, in the distinct voices of each character. 800-1000 words.

"I say, good evening, my...ah...friend," the actor, Rhys, said, his deep voice smooth as he stepped into the musty-smelling bookstore.

Llywelyn, a young woman with a wild mane of curly hair and a nose for character, looked up from behind the till. Her bright brown eyes, however, were the ones that locked onto his, and for an instant, they seemed to see beyond his charming façade.

"Evening, Rhys," she said dryly, her voice like a gentle brook, "and to others, please."

"Ah, I know, I know, the usual crowd." He waved a hand, his eyes darting around the small store. "I was hoping to escape the, ah, 'cameraphones' for a bit."

Llywelyn raised an eyebrow. "The paparazzi, or the fans?"

"Ah, well, it's all the same, isn't it?" he replied, his smile never wavered.

Llywelyn sighed, her fingers drumming a staccato beat on the till. "You're not here to talk about your latest 'tortured soul' film, are you?"

"Ah, I might be." He dropped onto a worn armchair, his eyes never leaving hers. "I'm an actor, after all. The art is in playing the roles."

Llywelyn snorted. "I'm sure it is. And I'm sure it's a real gas being hounded by everyone and their mother."

"Ah, well, you have to admit, it's all part of the...ah...myth," he said, winking.

"Ridiculous," she muttered, her face a picture of exasperation. "I've got work to do."

"Ah, I see." He stood, his long coat billowing behind him, and sauntered over to the shelves. "I was just browsing, anyway."

"Like I'd let you," Llywelyn said, her voice a little softer.

He turned to her, a raised eyebrow. "You're not here to 'get' me?"

"Whatever my intentions were, I assure you, they are purely...molehobing." He was charming, and he knew it; she was the only one who seemed oblivious.

Llywelyn's eyes flicked between him and the camera perched on the till. "I'm working on a new title. 'Molehobing'?"

"Ah, I see." He took her hand, his voice low and husky. "Well, in that case, I'd be ever so grateful."

"You're such a charmer, aren't you?" she said, her voice a little too sweet.

"Shall we say 'harmless'?" he replied, his eyes locked onto hers.

Llywelyn yanked her hand back, and he was left feeling...admittedly, a bit put out. She was the only woman in the world who seemed to be able to see through his tricks.

"Look, I've got to get back to work," she said, turning back to the till.

"Of course, of course." He sighed, and stepped over to the back of the store, where he could hear Llywelyn's fingers moving as she put away books. He was, of course, being an arse, but it was a well-rehearsed bit. "I'll be...in and out."

"Like I'm a chippy," she muttered.

"Ah, my friend," he said, his voice low, "you are."

Llywelyn's back straightened, and he was suddenly being drawn to her. It was as if he'd been trying to charm her all his life, only to find she was the one who had been doing the work. He saw, in that moment, he saw a woman who was far more than he was.

As he made for the door, a hand reached out and snagged his.

"Wait," she said.

"Ah?"

"Let me show you something."

She slipped out of the back room and led him to a small, enclosed room. The air inside was thick and musty. There was only one book on a rickety desk.

"What is it?" he asked, peering into the covered box.

"An introduction to the people's poetry," she said.

"Ah."

The cover was taken off, and he was exposed to the eyes of the poet, and the faces of the people who had come before. The faces were those he had seen, but never truly looked at, in the eyes of his audience.

"Ranting, and the damned, and the poor," she said.

"Ah."

"I know," she said, her voice as low as his. "I know."

As he sat there, he felt a weight drop, and it was not just the cover of the book. He was seeing the world in a new, less polished way. And in that moment, he knew he wasn't looking at Llywelyn; he was seeing the woman she had been reduced to, under the suffocating pressure of the spotlight.

"Perhaps," he said, his voice barely above a whisper.

"Ah?" he said, and they were as one.

"Ranting," she whispered.

The camera perched on the till was the only thing that was left of the world outside.

📚 详细文档

模型参数设置

• 温度（temp）：改变温度（如.4、.8、1.5、2、3）会极大地改变输出。较高的温度会产生更多样化的输出，但可能会降低准确性；较低的温度会产生更保守、更可预测的输出。
• 重复惩罚（rep pen）：该模型需要“rep pen”为1.05或更高，因为较低的值可能会导致输出末尾出现重复段落问题。然而，较低的rep pen值也可能会产生非常不同（有创意/不寻常）的生成结果。对于角色扮演，建议使用1.1到1.14的rep pen值。
• 平滑因子（Smoothing_factor）：在“KoboldCpp”、“oobabooga/text-generation-webui”或“Silly Tavern”中，将“Smoothing_factor”设置为1.5到2.5可以使模型运行更流畅。

量化选择

• 高量化：较高的量化会有更多的细节、细微差别，在某些情况下会有更强的“情感”层次。角色也会更加“丰满”，“身临其境”的感觉也会增强。
• Q4KM/Q4KS：是不错的量化方式，但如果能运行Q5、Q6或Q8，建议选择最高的量化。
• ARM量化：本仓库还有3种“ARM”量化，适用于支持该量化的计算机。如果在非ARM机器上使用，每秒的令牌数会非常低。
• IQ4XS：由于这种量化的特殊性质（混合/处理），其生成结果会与其他量化不同。可以尝试将其输出与其他量化进行比较。
• Q2k/Q3量化：使用这些量化时，可能需要将温度设置为2或更低（q2k为1或更低）。因为这种级别的压缩过大，会损害模型。后续会研究这些量化的Imatrix版本是否能更好地工作。

已知问题

• 拼写和大小写问题：模型可能会偶尔拼错单词或不使用大写。
• 短提示问题：某些rep pen/temp组合的短提示可能会导致比预期更长的生成结果或“咆哮”。通常重新生成可以纠正这些问题。
• 审查残留问题：原Llama 3.2 3B Instruct模型的一些“审查”仍然存在于本模型中。对于某些生成（如让模型“咒骂”），可能需要重新生成1 - 2次以上才能让模型“服从”。

🔧 技术细节

本模型是“Llama-3.2-3B-Instruct-uncensored”的修改版本，使用了David_AU开发的Brainstorm 40x方法，大幅改变了模型的散文输出和能力。该方法还将模型扩展了39层（至67层），达到7.54B参数（605个张量）。模型保留了原Llama 3.2 3B Instruct的所有训练，但现在可以处理指令并生成具有更深上下文和更强层次的输出。Llama 3.2遵循指令的能力比Llama 3和3.1版本更强。

📄 许可证

本模型采用Apache-2.0许可证。