Lemonaderp 4.5.3 4bpw Exl2

🚀 LemonadeRP-4.5.3 4bpw

Exllama quantization of KatyTheCutie/LemonadeRP-4.5.3. A 7B role - play focused model, with a focus on creativity and less cliché.

🚀 Quick Start

This is an Exllama quantized version of the KatyTheCutie/LemonadeRP-4.5.3 model. It's a 7B role - play focused model aiming for creativity and less cliché.

✨ Features

• Role - play Focused: Specifically designed for role - play scenarios.
• Creativity Emphasis: Tries to generate less cliché responses.

📚 Documentation

Other quants

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt format: Chatml

Based on the models going in to this, Chatml is assumed to be the appropriate format.

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

📄 License

This project is licensed under CC - BY - 4.0.

📞 Contact

You can reach out to Kooten on Discord.

If you would like to support me, visit ko-fi.com/kooten.