Lucid V1 Nemo

🚀 Lucid: AI Language Models

Lucid is a family of AI language models developed and used by DreamGen, with a focus on role-play and story-writing capabilities. It offers a unique experience for writers and role-play enthusiasts, enabling them to create rich and engaging narratives.

📚 Table of Contents

• Why Lucid
• Prompt Template
• Role-Play & Story-Writing
  • System Prompt
    • Intro
    • Roles
    • Structured Scenario Information
    • Unstructured Scenario Instructions
    • Controlling Response Length
  • Instructions (OOC)
    • Controlling Plot Development
  • Writing Assistance
    • Planning The Next Scene
    • Suggesting New Characters
• Sampling Params
• SillyTavern
  • Role-Play
  • Story-Writing
  • API: Local
  • API: DreamGen (free)
• DreamGen Web App (free)
• Model Training Details

✨ Why Lucid

Is Lucid the right model for you? I'm not sure, but here's what I do know:

• Role-play & Story-writing Focus:
  • Suitable for All Types of Users: Whether you're a world-builder who likes to plan every detail in advance (plot, setting, writing style, etc.) or an intuitive writer who starts with a loose prompt and shapes the narrative as it unfolds, Lucid has you covered.
  • Multi-character Role-plays: The model can automatically switch between characters, enhancing the realism of your role-plays.
  • Inline Writing Instructions (OOC): You can control plot development, pacing, and more by using inline instructions.
  • Inline Writing Assistance: Get help with planning the next scene, suggesting new characters, and other writing tasks.
• Reasoning Support (Opt-in): Lucid offers optional reasoning capabilities, which can be useful for certain types of tasks.
• Detailed Documentation: The README.md provides comprehensive documentation, examples, and configs to help you get started.

If this sounds interesting, keep reading!

📝 Prompt Template

The Lucid prompt template is an extension of the Llama 3 template, with the following enhancements:

Writing

• New writer Role: The template adds a writer role, which is used for writing the story or role-play.
• Message Headers:
  • Story-writing: The writer message header is <|start_header_id|>writer<|end_header_id|>.
  • Role-playing:
    • Character Messages: <|start_header_id|>writer character {{character_name}}<|end_header_id|>, where {{character_name}} is the actual character name.
    • Narrator Messages: <|start_header_id|>writer narrative<|end_header_id|>.
    • The model can generate multiple messages at once and automatically select the appropriate character or narrative.

Reasoning

• New Tokens: The template adds two new tokens for reasoning: <|reasoning_start|> and <|reasoning_end|>.
• Opt-in Reasoning: To enable reasoning, add Think deeply before answering. (or a similar prompt) to your system or user prompt.

Examples

Assistant: Simple

<|start_header_id|>system<|end_header_id|>
You are a reliable, general-purpose AI assistant.<|eot_id|><|start_header_id|>user<|end_header_id|>
Why is the sky blue?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
The sky appears blue due to a phenomenon called **Rayleigh scattering**, a type of light scattering caused by tiny particles in the atmosphere. Here's a simplified breakdown:
...

Assistant: Reasoning

Note that reasoning is mainly intended for assistant tasks (knowledge, math, coding, etc.) and is less useful for writing. Smaller Lucid models (<=12B) can produce plausible reasoning traces, but the improvement in performance is not as significant as in larger models.

<|start_header_id|>system<|end_header_id|>
You are a reliable, general-purpose AI assistant.<|eot_id|><|start_header_id|>user<|end_header_id|>
Why is the sky blue?
Think deeply before answering.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
<|reasoning_start|>Okay, so I need to figure out why the sky is blue. Let me start by recalling what I know...
...<|reasoning_end|>The sky appears blue due to a phenomenon called **Rayleigh scattering**. Here's a concise breakdown:
...

🎭 Role-Play & Story-Writing

Here's a quick summary of how to use Lucid for role-play and story-writing:

• system: Use this role to set up the scenario (plot, setting, writing style, etc.).
• writer: Write the story or role-play using this role.
• user: Provide instructions (OOC) to the model.
• assistant: Get writing assistance from the model.

System Prompt

The system prompt is very flexible, and here are some recommendations and examples:

Intro

It's recommended to start the system prompt with an introduction like this:

You are a skilled {{writing_kind}} writer and writing assistant with expertise across all genres{{genre_suffix}}.

• {{writing_kind}} should be fiction for story-writing and role-play for role-playing.
• {{genre_suffix}} can be empty or something like (but you specialize in horror).

Roles

Explain the writing roles in the system prompt:

• Story-writing:

You will perform several tasks, switching roles as needed:
- Writing: Use the `writer` role to write a story based on the provided information and user instructions.
- Other: Use the `assistant` role for any other tasks the user may request.

• Role-playing:

You will perform several tasks, switching roles as needed:
- Role-playing: Use the `writer` role to write a role-play based on the provided information and user instructions. Use the `writer character <character_name>` role for dialog or when acting as a specific character, use the `writer narrative` role for narration.
- Other: Use the `assistant` role for any other tasks the user may request.

Structured Scenario Information

The model understands structured scenario information, which can include plot, style, setting, characters, etc. (all sections are optional).

Other recommendations:

• Write descriptions as plain sentences, paragraphs, or bullet points.
• If the plot description is open-ended, start with something like this:

[ The following plot description is open-ended and covers only the beginning of the {{writing_kind}}. ]

where {{writing_kind}} is story or role-play.

Example: Science Fiction Story