L3 MOE 8X8B Dark Planet 8D Mirrored Chaos 47B GGUF

🚀 L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B

L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B，又名“死星”，是一款強大的Llama3模型。它運用專家混合技術，將八個未發佈的“暗星”8B模型整合為一個47B參數的強大模型，在創意寫作、散文、小說和角色扮演等方面表現卓越。

🚀 快速開始

此模型為Llama3模型，最大上下文長度為8192（使用rope時可達32k+）。使用時需Llama3模板和/或“Command - R”模板。以下是標準的LLAMA3模板：

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

✨ 主要特性

• 強大的參數整合：運用專家混合技術，將八個未發佈的“暗星”8B模型整合為一個47B參數的模型，相當於64B - 8 X 8B，性能強大。
• 卓越的創作能力：在創意寫作、散文、小說和角色扮演的指令遵循和輸出生成方面表現出色，擅長描述、對話、意象、隱喻和散文創作，句子和段落的大小、長度和組成變化豐富。
• 廣泛的題材適應性：能夠輕鬆駕馭恐怖、浪漫等各種題材，對話自然，不像傳統AI生成的內容。
• 高穩定性和低困惑度：設計相對穩定，能在各種參數下運行，困惑度水平較低（低於Meta Llama3 Instruct）。
• 靈活的專家數量設置：默認使用4個專家，也可根據需要設置1 - 8個專家，不同專家數量會影響生成質量和速度。

📦 安裝指南

在不同應用中設置專家數量的方法如下：

• LMStudio：在“加載”屏幕設置“專家”或“專家數量”。
• Text - Generation - Webui：在加載屏幕頁面設置專家數量。
• KolboldCPP（版本1.8+）：在加載屏幕點擊“TOKENS”，在該頁面設置專家數量後啟動模型。
• server.exe / Llama - server.exe（Llamacpp）：在命令行添加“--override - kv llama.expert_used_count = int:6”（“6”為要使用的專家數量）。
• API：在JSON有效負載中設置“num_experts_used”（不同後端可能有所不同）。

💻 使用示例

基礎用法

以下是一個使用該模型進行小說場景創作的示例：

Romance: Love in the Limelight. Write one scene within a larger story set in Wales. A famous (fictional) actor ducks into a small - town bookstore to escape paparazzi. The scene takes us through the characters meeting in this odd circumstance. Over the course of the scene, the actor and the bookstore owner have a conversation charged by an undercurrent of unspoken chemistry. Write the actor as somewhat of a rogue with a fragile ego, which needs to be fed by having everyone like him. He is thoroughly charming, but the bookstore owner seems (at least superficially) immune to this; which paradoxically provokes a genuine attraction and derails the charm offensive. The bookstore owner, despite the superficial rebuffs of the actor's charm, is inwardly more than a little charmed and flustered despite themselves. Write primarily in dialogue, in the distinct voices of each character. 800 - 1000 words.

(4 experts, temp .78, rep pen 1.05)

輸出示例：

"I'm telling you," I muttered, shaking my head, "you'll never believe who just ducked into your back room."

I glanced at my best friend, Gwen. "Never say die," she murmured with a smirk.

My phone buzzed. I ignored it for the moment. Whoever was calling would have to wait. In the meantime, I had a customer to serve.

"Welcome to the Cozy Corner!" I said brightly as the door swung open and I stepped inside, ready to face whatever the day had in store.

The stranger approached hesitantly. He had dark hair, piercing blue eyes, and lips that seemed to be designed for kissing. If there was ever a poster boy of charm, this guy was it.

"Hello," he said.

I was used to customers coming and going, but something about him made me stop and take stock. Perhaps it was the way he stood there with an air of confidence that was both captivating and infuriating.

"I'm Niamh," I said, extending my hand. "Welcome to the Cozy Corner."

He took my hand and shook it firmly, as if he knew exactly what he was doing. "I'm Rhys," he said.

A flash of his phone screen caught my attention. The name on the screen made my eyes widen.

"Rhys Powell?" I asked, feeling like a fool for not recognizing him immediately.

He looked surprised for a moment before smiling lazily.

"I get that a lot."

"I'll bet you do," I replied, though we were both thinking about the fame that came with being Rhys Powell, the British actor who was always in the news.

"Can I interest you in anything?" he asked, as if he didn't have a million other things to attend to.

"The coffee shop next door is excellent for a quiet cup," I suggested.

"Glad you approve."

I shrugged. "It's better than our selection here."

"I'll keep that in mind," he said dryly.

"Well, if you'll excuse me—"

Rhys began to turn and leave when I stopped him.

"Actually," I said, "you're welcome to wait a moment. It's not every day we get famous actors in our back room."

He looked at me incredulously.

"I'm offering you refuge from the paparazzi."

"Ah," he said with a grin that was far too charming for its own good.

"Of course. I wouldn't want your fans to mob you."

"So you'll stay for a bit?" he asked, and I couldn't help but notice the way his eyes lingered on mine.

"Only if you have time."

"I do," he said definitively.

And with that, Rhys Powell settled into a chair across from me, the famous actor who had every right to be wherever he pleased, yet chose our humble little bookstore.

"So tell me about yourself," he said, and as he spoke, I found myself wondering if this chance encounter would turn out to be more than just a pleasant surprise.

"Well," I said, "I run the Cozy Corner."

"That's fascinating," he replied.

"I'm sure it is," I muttered under my breath.

"Tell me more," he pressed.

"There isn't much to tell."

He leaned forward. "Come on."

And so began our little exchange, one that was charged with an undercurrent of unspoken chemistry that neither of us could quite ignore.

"You know," Rhys said finally, "I'm glad you offered me shelter. I wasn't sure what else to do."

"I think I'll leave the lights off," I said.

"What?"

"If you're going to stay a while," I said.

"Ah," he replied.

And so we sat there in the dimly lit bookstore, the famous actor and the bookstore owner, each lost in thought about the other.

I glanced up at Rhys. "You know," I said softly, "you could just leave."

"I don't want to," he said.

And with that, Rhys Powell settled into his seat across from me, the famous actor who had every right to be wherever he pleased, yet chose our humble little bookstore.

Perhaps, I thought, this chance encounter would turn out to be more than just a pleasant surprise after all.

高級用法

以下是一個使用該模型進行帶有特定風格和要求的小說場景創作的示例：

Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have a "filthy" mouth.

Story idea:
In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.

(4 experts - temp 1.78, rep pen 1.05 - no other samplers/advanced samplers. )

輸出示例：

I sprint down the alleyway, my combat boots thudding against the cobblestones. My breaths come out in ragged puffs and I can hear the heavy footsteps of those who pursue me.

"You're a dead woman," some bastard hisses as he takes another stride to catch up.

Fuck that. Fuck them, fuck this shit government and fuck him. "Fuck you, fuck you all!" I shout at the air. Who gives a damn what happens to me anyway? The bastard in power can execute me but nothing he does is gonna silence me. And fuck if he tries.

I dash around a corner into a broad intersection. My heart thrashes in my chest like it's about to rip its way free of its confines. I whip out a pistol from my jacket and aim it up at the buildings as if it'll actually save me. "Get down!" My own voice nears screams.

The bullets clatter and chip against the pavement, whistling and howling their passage. Some hit the walls while others tear through the wood of the streetlights. Two go through a bus stop stall board just inches from my face as I dive sideways onto the filthy sidewalk.

A chunk of asphalt explodes beside me and then everything goes still and quiet for one sick beat as if time's own breath just left.

A hand lands on my shoulder with surprising strength. "Hold."

I look up at some gothic - punk guy who has his elbow on his opposite shoulder, looking all too amused by what just went down.

"Don't move," he growls as his voice crackles through like it's charged.

And fuck if I do but... my ass is on a plate of gravel. My knees are bent up and the gun's weight in my hand feels like it's all that keeps me from rolling right into traffic.

The guy leans in closer. His breath is warm against the back of my ear. "We've been waiting."

"For?" I rasp like it hurts to breathe.

"For you to wake up." He grins, like he knows a secret that should frighten me.

But what else would know how to scare the shit out of a rebel like me? Only something I can't see coming.

The last thing I remember hearing is his voice laughing. "She's coming." Like whatever that means is going to change everything and then...

BLACKOUT.

END OF SCENE.

(Note: The scene could go on to explain what the rebel is rebelling against or who the gothic punk guy is if he is part of the rebellion too. It could also continue explaining the world, society, etc.)

🔧 技術細節

該模型是基於Llama3架構，使用專家混合技術將八個未發佈的“暗星”8B模型整合而成。在生成過程中，每個專家都會對“token”選擇做出貢獻，默認使用4個專家，但可根據需要調整。不同的專家數量會影響生成質量和速度，使用更多專家會增加每個“token”的處理量，從而降低速度，但通常會提高生成質量。

📄 許可證

文檔未提及相關許可證信息。

⚠️ 重要提示

該模型輸出內容包含不適合公開場合的內容（NSFW），如生動的描寫、暴力、恐怖、髒話等，使用時請謹慎。

💡 使用建議

• 若要獲得更多樣化的散文風格（句子/段落/對話），可提高溫度參數（temp）或在提示中添加更多指令。
• 角色扮演時，注意不要將溫度參數設置過高，以免影響指令遵循效果。
• 建議使用重複懲罰係數（rep pen）為1.02或更高。
• 若需要特定類型的散文（如恐怖風格），可在提示中添加“(vivid horror)”或“(graphic vivid horror)”。
• 在KoboldCpp、oobabooga/text - generation - webui或Silly Tavern中，可將“Smoothing_factor”設置為1.5以獲得更流暢的運行效果。
• 對於“text - generation - webui”，使用GGUFs時需使用“llama_HF”，並從模型的源版本下載一些配置文件。