S

Slovak Gpt J 1.4B

Developed by Milos
A large Slovak language generation model with 1.4 billion parameters, based on the GPT - J architecture
Downloads 90
Release Time : 3/2/2022

Model Overview

This model is a causal language model based on the GPT - J architecture, specifically optimized for the Slovak language and can be used for text generation and feature extraction

Model Features

Large - scale parameters
It has over 1.4 billion trainable parameters and is the largest model in this series
Slovak language optimization
Specifically trained for the Slovak language, using over 40GB of Slovak language corpora
Rotary position embedding
Adopts the RoPE positional encoding technology to enhance the model's ability to process long sequences
Diverse training data
The training data contains various Slovak language contents such as web pages, news, and the Bible

Model Capabilities

Slovak text generation
Poetry creation
Joke generation
Story continuation
Text feature extraction

Use Cases

Creative writing
Poetry creation
Continue writing Slovak poetry based on prompts
Can generate poetry fragments that conform to Slovak cultural characteristics
Entertainment applications
Joke generation
Generate Slovak jokes
May contain politically incorrect content, use with caution
Educational research
Language model research
Research the characteristics of Slovak language models
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase