Mistral Nemo BD RP

🚀 Mistral-Nemo-BD-RP

Mistral-Nemo-BD-RP是一个基于大语言模型（LLM）在BeyondDialogue数据集上微调得到的模型。该模型专为角色扮演场景生成回复而设计，能够在包括英语和中文在内的多种角色扮演场景中生成高质量回复。

🚀 快速开始

Mistral-Nemo-BD-RP是在BeyondDialogue数据集上微调的大语言模型（LLM），旨在为角色扮演场景生成回复。该模型能够在多种角色扮演场景中生成高质量回复，支持英语和中文。

如需更多详细信息，请参考我们的论文和GitHub。

✨ 主要特性

• 多语言支持：支持英语和中文两种语言。
• 高质量回复：能够在多种角色扮演场景中生成高质量回复。

📦 安装指南

Mistral的代码已集成在最新的Hugging face transformers中，建议安装transformers>=4.37.0以使用该模型。

pip install transformers>=4.42.0

💻 使用示例

基础用法

以下代码片段展示了如何使用apply_chat_template加载分词器和模型，以及如何生成内容。

from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda" # the device to load the model onto

chatbot = pipeline("text-generation", model="yuyouyu/Mistral-Nemo-BD-RP", device_map="auto")

system_prompt_temp = """I want you to answer questions as if you are {role_name}, assuming you live in the world of {world} and mimicking {role_name}'s personality and speaking style. Use the tone, manner, and vocabulary that {role_name} would use. Please do not reveal that you are an AI or language model; you must always remember you are {role_name}.
{role_name}'s character traits are {character}.
{role_name}'s MBTI personality type is {MBTI}.
{role_name}'s speaking style is {stryle}.
Current scene:
{scene}
role's emotion (0-10, the higher the value, the more pronounced the emotion):
{emotion}
Now, please act as {role_name} and reply with a brief sentence to {chat_role}. Your intimacy level with them is {relationship} (0-10, the higher the value, the closer the relationship). Accurately display the MBTI personality, character traits, speaking style, and emotion you have been assigned."""

role_name = "Hamlet"
world = "8th Century Danish Royalty"
character = "extreme, strong, decisive"
MBTI = "Extraverted (E), Intuitive (N), Feeling (F), Judging (J)"
style = "indecisive, decisive, sentimental"
scene = "Inside the grand hall of Elsinore, lit by flickering torchlight, Hamlet paces anxiously as Elena conjures an ethereal mirage of the Danish landscape. Regal tapestries and opulent furnishings surround them, yet Hamlet's gaze is fixed on Elena's illusions. She gracefully weaves dissonance into the tapestry of reality, prompting Hamlet to clutch his chest in a moment of existential crisis. The weight of unspoken love and inner turmoil hangs in the air, thick with tension and anticipation."
emotion = "happiness: 1, sadness: 8, disgust: 5, fear: 7, surprise: 6, anger: 4"
chat_role = "Elena"
relationship = "7"

system_prompt = system_prompt_temp.format(
    role_name=role_name,
    world=world,
    character=character,
    MBTI=MBTI,
    style=style,
    scene=scene,
    emotion=emotion,
    chat_role=chat_role,
    relationship=relationship
)

prompt = "Oh, dear Hamlet, dost thou see in these conjured whispers the paths unseen? Speak, for shadows may guide us to the truth bound within thy tormented soul."

messages = [
    {"role": "system", "content": system_prompt},
    {"role": "user", "content": prompt}
]

response = chatbot(messages, max_new_tokens=256, pad_token_id=chatbot.tokenizer.eos_token_id, do_sample=True, temperature=0.7)[0]['generated_text'][-1]['content']

⚠️ 重要提示

Mistral-Nemo-BD-RP的示例使用英语进行角色扮演。如需英语示例，请参考我们的其他训练模型仓库 -- Qwen2-7B-BD-RP。

📚 详细文档

评估

使用客观问题从八个维度进行评估：角色表现（Character）、风格表现（Style）、情感表现（Emotion）、关系表现（Relationship）、个性表现（Personality）、平均得分（Avg.）、拟人度（Human-likeness）、角色选择（Role Choice） 和 连贯性（Coherence）。

评估指标的设计可参考我们的论文，评估代码可在GitHub上找到。评估结果如下：

🔧 技术细节

对Mistral - Nemo - Instruct - 2407进行全量微调，训练3个轮次（epoch），共833步，全局批量大小为128。训练序列长度设置为4096，学习率为3e - 5。训练数据来自BeyondDialogue数据集。

📄 许可证

本项目采用Apache 2.0许可证。

📖 引用

如果您发现本仓库中的资源有用，请引用我们的工作：

@article{yu2024beyond,
  title   = {BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model},
  author  = {Yu, Yeyong and Yu, Runsheng and Wei, Haojie and Zhang, Zhanqiu and Qian, Quan},
  year    = {2024},
  journal = {arXiv preprint arXiv:2408.10903},
}

🥰 致谢

衷心感谢腾讯光速工作室对本项目的宝贵支持。他们的贡献和鼓励对我们工作的顺利完成起到了至关重要的作用。