Q

Qwen1.5 Moe Tiny Random

Developed by yujiepan
This is a small randomly initialized model based on the Qwen1.5-MoE architecture, using float16 precision, suitable for text generation tasks.
Downloads 30
Release Time : 3/30/2024

Model Overview

This model is a smaller-scale randomly initialized version based on the Qwen/Qwen1.5-MoE-A2.7B-Chat configuration, primarily designed for text generation tasks.

Model Features

Compact design
Based on the Qwen1.5-MoE architecture but with a smaller scale, suitable for resource-limited environments.
float16 precision
Uses float16 precision to balance computational efficiency and model performance.
Sliding window support
Configured with sliding window (max_window_layers=1) to optimize long text processing.

Model Capabilities

Text generation
Dialogue systems

Use Cases

Dialogue systems
Simple dialogue
Can be used to build simple chatbots
Text generation
Short text generation
Generates short text content
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase