M

Mgpt 1.3B Kazakh

Developed by ai-forever
A Kazakh language model based on mGPT-XL (1.3B) with 1.3 billion parameters, specifically optimized for Kazakh
Downloads 74
Release Time : 8/10/2023

Model Overview

This is a 1.3B-parameter large language model optimized for Kazakh, based on the mGPT-XL architecture, supporting Kazakh text generation and comprehension tasks

Model Features

Multilingual support
Primarily supports Kazakh while retaining English and Russian capabilities
Large context window
Supports context lengths of up to 2048 tokens
Specialized optimization
Fine-tuned with additional Kazakh data for 150,000 steps on the base model

Model Capabilities

Kazakh text generation
Multilingual text comprehension
Long-text processing

Use Cases

Language processing
Kazakh content creation
Generate creative content in Kazakh such as articles, poetry, etc.
Educational applications
Assist in Kazakh language learning and teaching
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
Š 2025AIbase