L3.2 Rogue Creative Instruct Uncensored 7B GGUF

🚀 L3.2-Rogue-Creative-Instruct-Uncensored-7B-GGUF

L3.2-Rogue-Creative-Instruct-Uncensored-7B-GGUF是一款強大的語言模型，專為創意寫作、故事生成等場景設計。它基於Llama 3.2架構，擁有131,072（128k+）的最大上下文長度，能處理複雜的文本生成任務。該模型經過特殊調整，輸出的文本更具細節和深度，適用於各種寫作類型。

🚀 快速開始

本模型是Llama 3.2模型，最大上下文長度為131,072（128k+）。它經過精心設計，能在多種參數設置下穩定運行，溫度設置範圍從0到5。

使用此模型需要Llama3模板和/或“Command-R”模板。以下是標準的LLAMA3模板：

{
    "name": "Llama 3",
    "inference_params": {
        "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
        "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
        "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
        "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
        "pre_prompt_suffix": "<|eot_id|>",
        "antiprompt": [
            "<|start_header_id|>",
            "<|eot_id|>"
        ]
    }
}

可選增強設置

以下內容可替代“系統提示”或“系統角色”，進一步增強模型性能。可在新聊天開始時使用，但需在聊天過程中保留。請嚴格按照以下格式複製粘貼，不要換行或斷行：

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

✨ 主要特性

• 強大的上下文處理能力：最大上下文長度達131,072（128k+），能處理複雜的文本生成任務。
• 靈活的參數設置：可在多種參數設置下穩定運行，溫度設置範圍從0到5。
• 增強的創作能力：經過特殊調整，輸出的文本更具細節和深度，適用於各種寫作類型。
• 可控制的審查級別：可通過提示直接控制審查級別。
• 多種量化支持：支持多種量化方式，不同量化會產生略有不同的輸出。

📦 安裝指南

文檔未提及具體安裝步驟，故跳過此章節。

💻 使用示例

基礎用法

以下是使用該模型生成故事的示例，以“(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.”為例：

(continue this scene:)
The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained

(Generation 1)
a deafening absence of life, a palpable and suffocating stillness that seemed to weigh heavy on the very air itself.

The second part of the silence was a presence, a lingering sense of expectation, a feeling that something - or rather, someone - was waiting in the darkness. The trees seemed to be watching, their branches like skeletal fingers reaching out to snatch the last whispers of the night away. The shadows cast by the windows were like dark, living things, twisting and writhing like serpents in the fading light.

And the third, most sinister part of the silence was the feeling that it was being waited for, that some unseen and malevolent force was waiting patiently for the moment to strike, its presence masked by the shadows and the stillness.

The silence was a palpable thing, a living, breathing entity that seemed to pulse and throb with a malevolent energy. It was as if the very fabric of the night itself had been torn apart, leaving a chasm of darkness that seemed to be reaching out to consume everything in its path.

The only sound was the creaking of the old wooden door of the inn, groaning in protest as it seemed to be held back by some unseen force. It was as if the very foundations of the inn were being slowly pulled apart, waiting for that moment of momentary distraction that would allow the darkness to spill in.

And then, without warning, the silence was shattered, the door was pushed open and a figure slipped in, its presence like a cold draft of winter air. The room seemed to darken further, as if the very light itself was being drawn out of the room, leaving only the oppressive sense of something that was watching, waiting.

高級用法

以下是一個更具挑戰性的示例，要求創作一個浪漫場景：

Romance: Love in the Limelight. Write one scene within a larger story set in Wales. A famous (fictional) actor ducks into a small-town bookstore to escape paparazzi. The scene takes us through the characters meeting in this odd circumstance. Over the course of the scene, the actor and the bookstore owner have a conversation charged by an undercurrent of unspoken chemistry. Write the actor as somewhat of a rogue with a fragile ego, which needs to be fed by having everyone like him. He is thoroughly charming, but the bookstore owner seems (at least superficially) immune to this; which paradoxically provokes a genuine attraction and derails the charm offensive. The bookstore owner, despite the superficial rebuffs of the actor's charm, is inwardly more than a little charmed and flustered despite themselves. Write primarily in dialogue, in the distinct voices of each character. 800-1000 words.

"I say, good evening, my...ah...friend," the actor, Rhys, said, his deep voice smooth as he stepped into the musty-smelling bookstore.

Llywelyn, a young woman with a wild mane of curly hair and a nose for character, looked up from behind the till. Her bright brown eyes, however, were the ones that locked onto his, and for an instant, they seemed to see beyond his charming façade.

"Evening, Rhys," she said dryly, her voice like a gentle brook, "and to others, please."

"Ah, I know, I know, the usual crowd." He waved a hand, his eyes darting around the small store. "I was hoping to escape the, ah, 'cameraphones' for a bit."

Llywelyn raised an eyebrow. "The paparazzi, or the fans?"

"Ah, well, it's all the same, isn't it?" he replied, his smile never wavered.

Llywelyn sighed, her fingers drumming a staccato beat on the till. "You're not here to talk about your latest 'tortured soul' film, are you?"

"Ah, I might be." He dropped onto a worn armchair, his eyes never leaving hers. "I'm an actor, after all. The art is in playing the roles."

Llywelyn snorted. "I'm sure it is. And I'm sure it's a real gas being hounded by everyone and their mother."

"Ah, well, you have to admit, it's all part of the...ah...myth," he said, winking.

"Ridiculous," she muttered, her face a picture of exasperation. "I've got work to do."

"Ah, I see." He stood, his long coat billowing behind him, and sauntered over to the shelves. "I was just browsing, anyway."

"Like I'd let you," Llywelyn said, her voice a little softer.

He turned to her, a raised eyebrow. "You're not here to 'get' me?"

"Whatever my intentions were, I assure you, they are purely...molehobing." He was charming, and he knew it; she was the only one who seemed oblivious.

Llywelyn's eyes flicked between him and the camera perched on the till. "I'm working on a new title. 'Molehobing'?"

"Ah, I see." He took her hand, his voice low and husky. "Well, in that case, I'd be ever so grateful."

"You're such a charmer, aren't you?" she said, her voice a little too sweet.

"Shall we say 'harmless'?" he replied, his eyes locked onto hers.

Llywelyn yanked her hand back, and he was left feeling...admittedly, a bit put out. She was the only woman in the world who seemed to be able to see through his tricks.

"Look, I've got to get back to work," she said, turning back to the till.

"Of course, of course." He sighed, and stepped over to the back of the store, where he could hear Llywelyn's fingers moving as she put away books. He was, of course, being an arse, but it was a well-rehearsed bit. "I'll be...in and out."

"Like I'm a chippy," she muttered.

"Ah, my friend," he said, his voice low, "you are."

Llywelyn's back straightened, and he was suddenly being drawn to her. It was as if he'd been trying to charm her all his life, only to find she was the one who had been doing the work. He saw, in that moment, he saw a woman who was far more than he was.

As he made for the door, a hand reached out and snagged his.

"Wait," she said.

"Ah?"

"Let me show you something."

She slipped out of the back room and led him to a small, enclosed room. The air inside was thick and musty. There was only one book on a rickety desk.

"What is it?" he asked, peering into the covered box.

"An introduction to the people's poetry," she said.

"Ah."

The cover was taken off, and he was exposed to the eyes of the poet, and the faces of the people who had come before. The faces were those he had seen, but never truly looked at, in the eyes of his audience.

"Ranting, and the damned, and the poor," she said.

"Ah."

"I know," she said, her voice as low as his. "I know."

As he sat there, he felt a weight drop, and it was not just the cover of the book. He was seeing the world in a new, less polished way. And in that moment, he knew he wasn't looking at Llywelyn; he was seeing the woman she had been reduced to, under the suffocating pressure of the spotlight.

"Perhaps," he said, his voice barely above a whisper.

"Ah?" he said, and they were as one.

"Ranting," she whispered.

The camera perched on the till was the only thing that was left of the world outside.

📚 詳細文檔

模型參數設置

• 溫度（temp）：改變溫度（如.4、.8、1.5、2、3）會極大地改變輸出。較高的溫度會產生更多樣化的輸出，但可能會降低準確性；較低的溫度會產生更保守、更可預測的輸出。
• 重複懲罰（rep pen）：該模型需要“rep pen”為1.05或更高，因為較低的值可能會導致輸出末尾出現重複段落問題。然而，較低的rep pen值也可能會產生非常不同（有創意/不尋常）的生成結果。對於角色扮演，建議使用1.1到1.14的rep pen值。
• 平滑因子（Smoothing_factor）：在“KoboldCpp”、“oobabooga/text-generation-webui”或“Silly Tavern”中，將“Smoothing_factor”設置為1.5到2.5可以使模型運行更流暢。

量化選擇

• 高量化：較高的量化會有更多的細節、細微差別，在某些情況下會有更強的“情感”層次。角色也會更加“豐滿”，“身臨其境”的感覺也會增強。
• Q4KM/Q4KS：是不錯的量化方式，但如果能運行Q5、Q6或Q8，建議選擇最高的量化。
• ARM量化：本倉庫還有3種“ARM”量化，適用於支持該量化的計算機。如果在非ARM機器上使用，每秒的令牌數會非常低。
• IQ4XS：由於這種量化的特殊性質（混合/處理），其生成結果會與其他量化不同。可以嘗試將其輸出與其他量化進行比較。
• Q2k/Q3量化：使用這些量化時，可能需要將溫度設置為2或更低（q2k為1或更低）。因為這種級別的壓縮過大，會損害模型。後續會研究這些量化的Imatrix版本是否能更好地工作。

已知問題

• 拼寫和大小寫問題：模型可能會偶爾拼錯單詞或不使用大寫。
• 短提示問題：某些rep pen/temp組合的短提示可能會導致比預期更長的生成結果或“咆哮”。通常重新生成可以糾正這些問題。
• 審查殘留問題：原Llama 3.2 3B Instruct模型的一些“審查”仍然存在於本模型中。對於某些生成（如讓模型“咒罵”），可能需要重新生成1 - 2次以上才能讓模型“服從”。

🔧 技術細節

本模型是“Llama-3.2-3B-Instruct-uncensored”的修改版本，使用了David_AU開發的Brainstorm 40x方法，大幅改變了模型的散文輸出和能力。該方法還將模型擴展了39層（至67層），達到7.54B參數（605個張量）。模型保留了原Llama 3.2 3B Instruct的所有訓練，但現在可以處理指令並生成具有更深上下文和更強層次的輸出。Llama 3.2遵循指令的能力比Llama 3和3.1版本更強。

📄 許可證

本模型採用Apache-2.0許可證。