Minimax Text 01

🚀 MiniMax-Text-01

MiniMax-Text-01 is a high - performance language model with a large number of parameters. It adopts a hybrid architecture and advanced parallel strategies to achieve long - context processing capabilities and excellent performance on various benchmarks.

🚀 Quick Start

For detailed usage and deployment of MiniMax-Text-01, please refer to the official documentation and relevant guides. You can access the official website, API platform, and other resources through the following links:

• Homepage
• API Platform

✨ Features

• Large - scale Parameters: MiniMax-Text-01 has 456 billion total parameters, with 45.9 billion activated per token, providing strong language understanding and generation capabilities.
• Hybrid Architecture: It combines Lightning Attention, Softmax Attention, and Mixture - of - Experts (MoE) to better unlock long - context capabilities.
• Extended Context Length: Leveraging advanced parallel strategies and innovative compute - communication overlap methods, the training context length is extended to 1 million tokens, and it can handle up to 4 million tokens during inference.
• Top - tier Performance: Demonstrates excellent performance on various academic benchmarks.

📚 Documentation

1. Model Architecture

The architecture of MiniMax-Text-01 is briefly described as follows:

2. Evaluation

Core Academic Benchmarks

^* Evaluated following a 0 - shot CoT setting.

Long Benchmarks

4M Needle In A Haystack Test

Ruler

📄 License

• Model License
• Code License