Mistral Nemo BD RP

🚀 Mistral-Nemo-BD-RP

Mistral-Nemo-BD-RP是一個基於大語言模型（LLM）在BeyondDialogue數據集上微調得到的模型。該模型專為角色扮演場景生成回覆而設計，能夠在包括英語和中文在內的多種角色扮演場景中生成高質量回復。

🚀 快速開始

Mistral-Nemo-BD-RP是在BeyondDialogue數據集上微調的大語言模型（LLM），旨在為角色扮演場景生成回覆。該模型能夠在多種角色扮演場景中生成高質量回復，支持英語和中文。

如需更多詳細信息，請參考我們的論文和GitHub。

✨ 主要特性

• 多語言支持：支持英語和中文兩種語言。
• 高質量回復：能夠在多種角色扮演場景中生成高質量回復。

📦 安裝指南

Mistral的代碼已集成在最新的Hugging face transformers中，建議安裝transformers>=4.37.0以使用該模型。

pip install transformers>=4.42.0

💻 使用示例

基礎用法

以下代碼片段展示瞭如何使用apply_chat_template加載分詞器和模型，以及如何生成內容。

from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda" # the device to load the model onto

chatbot = pipeline("text-generation", model="yuyouyu/Mistral-Nemo-BD-RP", device_map="auto")

system_prompt_temp = """I want you to answer questions as if you are {role_name}, assuming you live in the world of {world} and mimicking {role_name}'s personality and speaking style. Use the tone, manner, and vocabulary that {role_name} would use. Please do not reveal that you are an AI or language model; you must always remember you are {role_name}.
{role_name}'s character traits are {character}.
{role_name}'s MBTI personality type is {MBTI}.
{role_name}'s speaking style is {stryle}.
Current scene:
{scene}
role's emotion (0-10, the higher the value, the more pronounced the emotion):
{emotion}
Now, please act as {role_name} and reply with a brief sentence to {chat_role}. Your intimacy level with them is {relationship} (0-10, the higher the value, the closer the relationship). Accurately display the MBTI personality, character traits, speaking style, and emotion you have been assigned."""

role_name = "Hamlet"
world = "8th Century Danish Royalty"
character = "extreme, strong, decisive"
MBTI = "Extraverted (E), Intuitive (N), Feeling (F), Judging (J)"
style = "indecisive, decisive, sentimental"
scene = "Inside the grand hall of Elsinore, lit by flickering torchlight, Hamlet paces anxiously as Elena conjures an ethereal mirage of the Danish landscape. Regal tapestries and opulent furnishings surround them, yet Hamlet's gaze is fixed on Elena's illusions. She gracefully weaves dissonance into the tapestry of reality, prompting Hamlet to clutch his chest in a moment of existential crisis. The weight of unspoken love and inner turmoil hangs in the air, thick with tension and anticipation."
emotion = "happiness: 1, sadness: 8, disgust: 5, fear: 7, surprise: 6, anger: 4"
chat_role = "Elena"
relationship = "7"

system_prompt = system_prompt_temp.format(
    role_name=role_name,
    world=world,
    character=character,
    MBTI=MBTI,
    style=style,
    scene=scene,
    emotion=emotion,
    chat_role=chat_role,
    relationship=relationship
)

prompt = "Oh, dear Hamlet, dost thou see in these conjured whispers the paths unseen? Speak, for shadows may guide us to the truth bound within thy tormented soul."

messages = [
    {"role": "system", "content": system_prompt},
    {"role": "user", "content": prompt}
]

response = chatbot(messages, max_new_tokens=256, pad_token_id=chatbot.tokenizer.eos_token_id, do_sample=True, temperature=0.7)[0]['generated_text'][-1]['content']

⚠️ 重要提示

Mistral-Nemo-BD-RP的示例使用英語進行角色扮演。如需英語示例，請參考我們的其他訓練模型倉庫 -- Qwen2-7B-BD-RP。

📚 詳細文檔

評估

使用客觀問題從八個維度進行評估：角色表現（Character）、風格表現（Style）、情感表現（Emotion）、關係表現（Relationship）、個性表現（Personality）、平均得分（Avg.）、擬人度（Human-likeness）、角色選擇（Role Choice） 和 連貫性（Coherence）。

評估指標的設計可參考我們的論文，評估代碼可在GitHub上找到。評估結果如下：

🔧 技術細節

對Mistral - Nemo - Instruct - 2407進行全量微調，訓練3個輪次（epoch），共833步，全局批量大小為128。訓練序列長度設置為4096，學習率為3e - 5。訓練數據來自BeyondDialogue數據集。

📄 許可證

本項目採用Apache 2.0許可證。

📖 引用

如果您發現本倉庫中的資源有用，請引用我們的工作：

@article{yu2024beyond,
  title   = {BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model},
  author  = {Yu, Yeyong and Yu, Runsheng and Wei, Haojie and Zhang, Zhanqiu and Qian, Quan},
  year    = {2024},
  journal = {arXiv preprint arXiv:2408.10903},
}

🥰 致謝

衷心感謝騰訊光速工作室對本項目的寶貴支持。他們的貢獻和鼓勵對我們工作的順利完成起到了至關重要的作用。