%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
L3 SnowStorm V1.15 4x8B B
An experimental role-playing-oriented Mixture of Experts model, aiming to achieve performance in role-playing/emotional role-playing tasks that is comparable to or better than Mixtral 8x7B and its fine-tuned versions.
Downloads 26
Release Time : 5/28/2024
Model Overview
Llama 3 SnowStorm v1.15B is a 4x8B architecture Mixture of Experts model, focusing on role-playing and emotional role-playing tasks, using a random selection gating mode with 2 experts per token.
Model Features
Role-Playing Optimization
Specifically optimized for role-playing and emotional role-playing tasks, with performance comparable to or surpassing Mixtral 8x7B
Mixture of Experts Architecture
Adopts a 4x8B Mixture of Experts architecture, randomly selecting 2 experts per token for inference
Multi-Model Fusion
Integrates 4 different 8B base models, including Poppy_Porpoise, Lumimaid, Soliloquy, and Stheno
Visual Adaptation Support
Optional llama3_mmproj visual adapter supports multimodal input
Model Capabilities
Text Generation
Role-Playing Dialogue
Emotional Expression
Multi-Turn Dialogue
Creative Writing
Use Cases
Entertainment Applications
Role-Playing Games
Serves as a dialogue engine for game NPCs, providing rich character interaction experiences
Virtual Companions
Creates virtual characters with emotional expression capabilities
Creative Writing
Story Generation
Assists writers in character setting and dialogue creation
Featured Recommended AI Models