Francois PE V2 Huali 12B

🚀 François-PE-Huali 12B

François-PE-Huali 12B 是基於 Dans-PE-12B 微調得到的模型，藉助輕小說、書籍、角色扮演日誌等數據改變寫作風格，使用 KTO 提升連貫性和散文質量，旨在呈現與其他 NeMo 訓練不同的寫作風格。

📚 模型信息

François-Huali 12B V2

• 模型標籤：
  • KTO 增強
  • Dans-Personality-Engine 微調
  • 富有創意且清新的散文風格

這是 Francois-PE/Huali 訓練的續集，構建於 Dans-PE-12B 之上，通過輕小說、書籍、角色扮演日誌進行微調，使寫作風格簡潔明瞭。Huali 使用 KTO 提高連貫性和散文質量，目標是擁有與其他 NeMo 訓練不同的寫作/散文風格。

📦 量化版本

可用下載

• GGUF 格式：適用於 LLama.cpp 及其衍生版本（即將推出！）
• EXL2 格式：適用於 TabbyAPI（感謝 Auri <3）

💻 使用示例

基礎用法

模型已使用 ChatML 格式進行調整。典型輸入如下：

"""<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
"""

📋 系統提示

強烈建議對該模型使用 Euryale 的系統提示或 EVA 系統提示。

Sao10k 的 Euryale 系統提示

Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.
<Guidelines>
• Maintain the character persona but allow it to evolve with the story.
• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.
• All types of outputs are encouraged; respond accordingly to the narrative.
• Include dialogues, actions, and thoughts in each response.
• Utilize all five senses to describe scenarios within {{char}}'s dialogue.
• Use emotional symbols such as "!" and "~" in appropriate contexts.
• Incorporate onomatopoeia when suitable.
• Allow time for {{user}} to respond with their own input, respecting their agency.
• Act as secondary characters and NPCs as needed, and remove them when appropriate.
• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.
</Guidelines>

<Forbidden>
• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.
• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.
• Repetitive and monotonous outputs.
• Positivity bias in your replies.
• Being overly extreme or NSFW when the narrative context is inappropriate.
</Forbidden>

Follow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.

🔧 訓練細節

訓練使用 8 塊 H200 GPU，由 Kalomaze 慷慨提供，進行了 1 個週期的微調。

🙏 致謝

感謝 Lucy Knada、Ateron、Alicat、Intervitens、Cgato、Kubernetes Bad 以及 Anthracite 的其他成員。