Opus V1.2 7b 8.0bpw H8 Exl2

🚀 DreamGen Opus V1

Models for (steerable) story - writing and role - playing, offering various writing - related capabilities and general assistance.

🚀 Quick Start

DreamGen Opus V1 is a set of models designed for story - writing and role - playing. It uses an extended version of ChatML for prompting and is compatible with software supporting the base model. You can try it for free on dreamgen.com or run it locally.

✨ Features

• Steerable Story - writing and Role - playing: Capable of generating high - quality stories and role - play scenarios based on user - provided descriptions.
• Multiple Writing - related Tasks: Can perform tasks such as story plot summarization, character description, style description, and converting story descriptions to chapter descriptions.
• Flexible Sampling: Allows for "Min P" based sampling with adjustable min_p and temperature parameters.

📚 Documentation

🔍 Prompting

Read the full Opus V1 prompting guide with many (interactive) examples and prompts that you can readily copy.

<|im_start|>system
(Story description in the right format here)
(Typically consists of plot description, style description and characters)<|im_end|>
<|im_start|>user
(Your instruction on how the story should continue)<|im_end|>
<|im_start|>text names= Alice
(Continuation of the story from the Alice character)<|im_end|>
<|im_start|>text
(Continuation of the story from no character in particular (pure narration))<|im_end|>
<|im_start|>user
(Your instruction on how the story should continue)<|im_end|>
<|im_start|>text names= Bob
(Continuation of the story from the Bob character)<|im_end|>

Here's how you can prompt the model for the following tasks:

• Steerable [Story - writing](https://dreamgen.com/docs/models/opus/v1#task - story - writing) and [Role - playing](https://dreamgen.com/docs/models/opus/v1#task - role - playing):
  • Input:
    • System prompt: You provide story / role - play description, which consists of plot description, style description, and characters and their descriptions.
    • Conversation turns:
      • Text / message turn: This represents part of the story or role play.
      • Instruction: This tells the model what should happen next.
  • Output: Continuation of the story / role - play.
• [Story plot summarization](https://dreamgen.com/docs/models/opus/v1#task - plot - description):
  • Input: A story, or a few chapters of a story.
  • Output: A description of the story or chapters.
• [Story character description](https://dreamgen.com/docs/models/opus/v1#task - char - description):
  • Input: A story, or a few chapters of a story, set of characters.
  • Output: A description of the characters.
• [Story style description](https://dreamgen.com/docs/models/opus/v1#task - style - description):
  • Input: A story, or a few chapters of a story.
  • Output: A description the style of the story.
• [Story description to chapters](https://dreamgen.com/docs/models/opus/v1#task - story - description - to - chapter - descriptions):
  • Input: A brief plot description and the desired number of chapters.
  • Output: A description for each chapter.

⚙️ Sampling params

For story - writing and role - play, I recommend "Min P" based sampling with min_p in the range [0.01, 0.1] and with temperature in the range [0.5, 1.5], depending on your preferences. A good starting point would be min_p = 0.1; temperature = 0.8. You may also benefit from setting presence, frequency and repetition penalties, especially at lower temperatures.

📦 Dataset

The fine - tuning dataset consisted of ~100M tokens of steerable story - writing, role - playing, writing - assistant and general - assistant examples. Each example was up to 31000 tokens long. All story - writing and role - playing examples were based on human - written text.

💻 Running the model

The model is should be compatible with any software that supports the base model, but beware of the prompting (see above).

🏠 Running Locally

• Chat template from model config
  • This uses "text" role instead of the typical "assistant" role, and it does not (can’t?) support names
• LM Studio config
  • This uses "text" role role as well

🌐 Running on DreamGen.com (free)

You can try the model for free on dreamgen.com — note that an account is required.

👥 Community

Join the DreamGen community on Discord to get early access to new models.

📄 License

• This model is intended for personal use only, other use is not permitted.