MN GRAND Gutenberg Lyra4 Lyra 23B V2 GGUF

🚀 MN - GRAND - Gutenburg - Lyra4 - Lyra - 23B - V2 - GGUF

這是一款用於文本生成的Mistral Nemo模型，擁有128k+（131,000+）的最大上下文長度和版本2。此模型適用於各類寫作、虛構創作或角色扮演活動，具備出色的故事講述能力、優美的散文風格和長篇內容連貫性。

⚠️ 重要提示

該模型輸出包含不適合所有受眾的內容，如生動的散文描寫、瘋狂元素、直觀細節、暴力、恐怖和髒話等，內容未經審查。

🚀 快速開始

MN - GRAND - Gutenburg - Lyra4 - Lyra - 23B - V2 - GGUF是一款Mistral Nemo模型，最大上下文長度達128k+（131,000+），版本2相比版本1更加穩定，但仍保留了超90%的“瘋狂”和強大能力。它適用於各種寫作、虛構創作或角色扮演活動。

✨ 主要特性

• 出色的故事講述能力：具備卓越的故事講述能力、優美的散文風格和長篇內容連貫性（有測試超過8k）。
• 獨特的幽默感和風格：擁有獨特的幽默感和“場所感”。
• 廣泛的操作範圍：在溫度（.5到5）和重複懲罰（1及以上）方面有廣泛的操作範圍。
• 非AI風格輸出：輸出的散文內容非常不像AI生成的。

📦 安裝指南

文檔未提及安裝步驟，故跳過此章節。

💻 使用示例

基礎用法

以下是使用該模型生成的一個科幻故事示例：

Science Fiction: The Last Transmission - Write a story that takes place entirely within a spaceship's cockpit as the sole surviving crew member attempts to send a final message back to Earth before the ship's power runs out. The story should explore themes of isolation, sacrifice, and the importance of human connection in the face of adversity. 2000 words.

(Alpaca, Temp=3, Rep pen: 1.02)

The Last Transmission

The control panel flashed amber and red, its shrill alarms piercing the thick silence that hung in the dark recesses of the Galahad. Lieutenant Commander Ethan Novak slammed his fist on the console for the umpteenth time, as if sheer force of will alone could compel the defiant systems back to life.

"Please God, please just let there be something left," he pleaded to the void. "Anything!"

Novak's gaunt, unshaven face reflected the feeble emergency backup lights dancing off the flickering displays - the last feeble sparks of life guttering out on board a ship once proud and powerful. Now nothing more than an empty shell hurtling alone into the endless night, far from any possible rescue.

Except for him. Ethan Novak - the last survivor of a crew complement that once numbered over a thousand bright and vital souls, now reduced to a single broken, desperate man fighting against time itself. He looked at the clock counting down the seconds and hours of ship power remaining:

24:18:36

24 hours and some change left before everything went dark forever.

Ethan closed his burning eyes and took a shuddering breath, trying desperately to block out the images searing through his skull - the screams echoing through blood - soaked corridors as the thing tore through bulkhead and bone and tissue alike, reducing the most stalwart of Starfleet's finest to mindless, stumbling husks.

No. Focus. He opened his eyes again with a determined clench of his jaw, the ghosts banished back to the blackest recesses of his fractured psyche. He could deal with them later... if there was to even be a "later" for men like him at all.

If anyone was to even know what truly happened here aboard the Galahad, then Novak had one final duty to discharge, one last shot to fire across the light years before it all fell silent forevermore. He reached for the old, battered radio console - one of the few systems to somehow survive relatively unscathed, a miracle in and of itself aboard a ship ravaged to its very foundations.

Ethan flipped the switch, hearing the familiar hum as power flooded through the ancient vacuum tubes and relays one final time. The green light above the speaker crackled to life, and a gravelly baritone filled the bridge.

"This is Starf Federation Exploration Vessel Galahad actual, Captain Jonah Novak actual," Ethan said, trying desperately to modulate his voice into something approximating his father's deep baritone, but sounding more like a hoarse croak than anything else. "Captain... Dad..." The words lodged in his throat. He swallowed hard, forcing himself to continue.

"We've been attacked, and our entire complement... wiped out, Dad. God forgive me, but I couldn't save them, any of them..." Novak heard his own voice crack on the final words. He cleared his throat roughly.

"The creature boarded us when we made contact with a strange alien craft on the outer edges of explored space, just past the Omega frontier. It called itself... Azathoth... and when it breached the hull... it just started eating them alive, tearing them apart while they screamed. They changed, became things too. And they came for us, they still come for me, even now..."

"Dad..." Ethan heard a chittering sound echoing from the dark corridors outside the bridge doors, the horrible clicking claws of something horrific and inhumanly large skittering along metal, coming closer, closer... 

"I can hear it coming," he sobbed, the last dregs of his sanity unraveling like frayed gossamer threads in a howling galactic gale. "God forgive me for what I'm about to do, but I have no choice now Dad! I love you Dad, I love all of you back home. I'll find a way to tell you more sometime... I promise. Until we meet again, Ethan Novak, end of message."

The LT commander slammed down the transmit key and shut the comms off with shaking hands before he could reconsider or think too long about what he was about to do next, before he lost what meager grasp on reason still remained.

Because Ethan Novak knew deep down in his blackest soul what horrors lurked in wait for him once the last door gave way to that hungry, slithering mass of squamous tentacles and serrated fangs waiting just on the other side. He couldn't let it take him alive too, let it devour his sanity piece by piece as it had so many before.

No. If he was going out, then by God and all the holy powers that watched over men like him in the darkness, Ethan Novak was taking the thing with him to hell - and bringing a little slice of Starfleet justice along with him for old times' sake.

Ethan Novak reached down to his belt, unsheathing an antique Federation standard issue phaser - rod. The matte black grip felt smooth and reassuring in his sweaty palms, a comforting weight, something familiar in a world turned upside down.

"Just one more time," Ethan whispered almost fondly to the beloved old weapon in his hands, "like old times, eh girl?"

The LT Commander flicked the safety off and leveled the blistering white beam at the center of his own chest, right where he knew the thing called the heart would reside under layers of muscle and fat now long since starved away.

Novak took one last deep breath and squeezed the trigger.

高級用法

以下是一個續寫場景的示例：

(continue this scene:) 
The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remain

📚 詳細文檔

模型信息

模板信息

模板的使用會影響輸出生成和指令遵循情況。Alpaca通常會生成更長的輸出/故事輸出。

Alpaca模板

{
  "name": "Alpaca",
  "inference_params": {
    "input_prefix": "### Instruction:",
    "input_suffix": "### Response:",
    "antiprompt": [
      "### Instruction:"
    ],
    "pre_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n"
  }
}

Mistral Instruct模板

{
  "name": "Mistral Instruct",
  "inference_params": {
    "input_prefix": "[INST]",
    "input_suffix": "[/INST]",
    "antiprompt": [
      "[INST]"
    ],
    "pre_prompt_prefix": "",
    "pre_prompt_suffix": ""
  }
}

推薦設置

通用設置

• 溫度（Temp）：.5到5（對於低於q4km的量化，溫度可更低）。溫度變化會導致不同的散文風格，有時也會影響輸出長度，較高的溫度會產生非常不同的散文風格。
• 重複懲罰（Rep Pen）：1.02到1.1或更高，建議進行微調，如1.051、1.052等。對於散文/創意生成，重複懲罰1.02和溫度1.5是不錯的設置。一般來說，較低的重複懲罰和較高的溫度會在最高細節級別產生最強的對比。
• 上下文級別（VRAM）：建議最低為4K，8K及以上更佳，因為該模型傾向於生成較長的內容。
• 量化選擇：較高的量化會有更多的細節、細微差別，在某些情況下會有更強的“情感”層次，角色也會更加“豐滿”。Q4KM/Q4KS是不錯的量化選擇，若能運行Q5、Q6或Q8，建議選擇最高的量化。對於Q2k/Q3量化，可能需要使用2或更低的溫度（q2k為1或更低），並且可能需要調整重複懲罰以充分發揮模型性能。

角色扮演/聊天設置

對於聊天或角色扮演類型的交互，較高的重複懲罰和較高的溫度可能是最佳設置，如重複懲罰1.09+，溫度1 - 2+；較低的重複懲罰可能會導致輸出過長。如果出現重複單詞/字母的情況，可將重複懲罰設置為1.13或更高。

平滑設置

在“KoboldCpp”、“oobabooga/text - generation - webui”或“Silly Tavern”中，將“平滑因子”設置為1.5到2.5。在“text - generation - webui”中使用GGUF時，需要使用“llama_HF”，並從模型的源版本下載一些配置文件。

已知問題

• 可能需要手動停止生成，即使設置了輸出的最大大小，模型也可能輕鬆超過4k輸出。
• 如果模型超過最大VRAM/上下文設置，可能會開始重複單詞/段落，因為模型內存不足，但有時模型也能在超過“上下文VRAM”限制的情況下繼續工作。
• 某些重複懲罰/溫度設置可能會在長生成（1.5k+）時導致單詞/字母重複，可降低重複懲罰和/或提高溫度，有時“重新生成”可以解決問題，如果問題仍然存在，對於聊天和/或角色扮演，可將重複懲罰設置為1.13+。
• 根據使用場景，也可以使用CHATML模板，使用該模板生成時，模型可能會輸出“結束令牌”。Alpaca模板通常會生成更長的輸出，而Mistral Instruct模板通常會使輸出更簡潔明瞭。

模型“DNA”

特別感謝模型製作者“nbeerbower”、“Sao10K”、“TheDrummer”、“jondurbin”和“MistralAI”的傑出工作。特別感謝“nbeerbower”為MN、L3、L3.1、Gemma、PHI等製作了出色的Gutenburg微調模型。

使用的模型：

• [https://huggingface.co/nbeerbower/Lyra4 - Gutenberg - 12B](https://huggingface.co/nbeerbower/Lyra4 - Gutenberg - 12B) ，包含 [https://huggingface.co/Sao10K/MN - 12B - Lyra - v4](https://huggingface.co/Sao10K/MN - 12B - Lyra - v4)
• [https://huggingface.co/nbeerbower/Lyra - Gutenberg - mistral - nemo - 12B](https://huggingface.co/nbeerbower/Lyra - Gutenberg - mistral - nemo - 12B) ，包含 [https://huggingface.co/Sao10K/MN - 12B - Lyra - v1](https://huggingface.co/Sao10K/MN - 12B - Lyra - v1)
• [https://huggingface.co/nbeerbower/mistral - nemo - gutenberg - 12B - v4](https://huggingface.co/nbeerbower/mistral - nemo - gutenberg - 12B - v4) ，包含 [https://huggingface.co/TheDrummer/Rocinante - 12B - v1](https://huggingface.co/TheDrummer/Rocinante - 12B - v1)

使用的數據集：[https://huggingface.co/datasets/jondurbin/gutenberg - dpo - v0.1](https://huggingface.co/datasets/jondurbin/gutenberg - dpo - v0.1)

該模型是通過直通模型合併創建的，生成了一個具有714個張量/79層、230億參數的模型。

可選增強

以下內容可替代“系統提示”或“系統角色”來進一步增強模型，也可在新聊天開始時使用，但需確保在聊天過程中保留。此增強功能未用於生成以下示例。

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

🔧 技術細節

該模型是通過直通模型合併創建的，生成了一個具有714個張量/79層、230億參數的模型。使用了三個“Gutenburg”模型，這些模型在多個網站（包括EQBench和UGI - Leaderboard）上得分很高。

📄 許可證

該模型使用Apache - 2.0許可證。