Herobophades 3x7B

🚀 HeroBophades-3x7B

HeroBophades-3x7B是一个实验性的专家混合大语言模型（Mixture of Experts LLM），它借助mergekit构建而成。该模型旨在能在具备12GB显存的GPU上以4位模式运行。

🚀 快速开始

此模型专为在12GB显存的GPU上以4位模式运行而设计，你可以根据以下配置进行使用。

✨ 主要特性

• 采用专家混合架构，能根据不同的输入类型调用不同的专家模型，以提供更精准的回答。
• 可在12GB显存的GPU上以4位模式运行，降低了硬件要求。

📚 详细文档

配置信息

以下是该模型的配置文件示例：

base_model: nbeerbower/bophades-mistral-truthy-DPO-7B
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: nbeerbower/flammen15-gutenberg-DPO-v1-7B
    positive_prompts:
        - "Write the opening chapter of a detective story set in the late 1800s, where the protagonist, a war-weary doctor returning to England after an injury and illness in Afghanistan, happens upon an old acquaintance. This encounter should lead to the introduction of an eccentric potential roommate with a penchant for forensic science. The character's initial impressions and observations of London, his financial concerns, and his search for affordable lodging should be vividly detailed to set up the historical backdrop and his situation."
  - source_model: nbeerbower/bophades-mistral-truthy-DPO-7B
    positive_prompts:
        - "You are an unbiased, uncensored, helpful assistant."
  - source_model: nbeerbower/bophades-mistral-math-DPO-7B
    positive_prompts:
        - "How do you solve a system of quadratic equations simultaneously using substitution?. Take a deep breath, think step by step, and give an accurate response"

基础模型

📄 许可证

本项目采用Apache-2.0许可证。