Herobophades 3x7B

🚀 HeroBophades-3x7B

HeroBophades-3x7B是一個實驗性的專家混合大語言模型（Mixture of Experts LLM），它藉助mergekit構建而成。該模型旨在能在具備12GB顯存的GPU上以4位模式運行。

🚀 快速開始

此模型專為在12GB顯存的GPU上以4位模式運行而設計，你可以根據以下配置進行使用。

✨ 主要特性

• 採用專家混合架構，能根據不同的輸入類型調用不同的專家模型，以提供更精準的回答。
• 可在12GB顯存的GPU上以4位模式運行，降低了硬件要求。

📚 詳細文檔

配置信息

以下是該模型的配置文件示例：

base_model: nbeerbower/bophades-mistral-truthy-DPO-7B
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: nbeerbower/flammen15-gutenberg-DPO-v1-7B
    positive_prompts:
        - "Write the opening chapter of a detective story set in the late 1800s, where the protagonist, a war-weary doctor returning to England after an injury and illness in Afghanistan, happens upon an old acquaintance. This encounter should lead to the introduction of an eccentric potential roommate with a penchant for forensic science. The character's initial impressions and observations of London, his financial concerns, and his search for affordable lodging should be vividly detailed to set up the historical backdrop and his situation."
  - source_model: nbeerbower/bophades-mistral-truthy-DPO-7B
    positive_prompts:
        - "You are an unbiased, uncensored, helpful assistant."
  - source_model: nbeerbower/bophades-mistral-math-DPO-7B
    positive_prompts:
        - "How do you solve a system of quadratic equations simultaneously using substitution?. Take a deep breath, think step by step, and give an accurate response"

基礎模型

📄 許可證

本項目採用Apache-2.0許可證。