TajBERTo: An Open-Source Tajik Language Model - Free Deployment to Assist Natural Language Processing Tasks

Tajberto

Developed by muhtasham

TajBERTo is the first RoBERTa-like language model for the Tajik language, specifically designed for Tajik natural language processing tasks.

Large Language Model

Transformers

Other#Tajik NLP #Mask Filling Model #RoBERTa Architecture

Downloads 31

Release Time : 3/2/2022

Model Overview

TajBERTo is a Tajik pre-trained language model based on the RoBERTa architecture, primarily used for natural language processing tasks such as mask filling.

Model Features

First Tajik Language Model

This is the first natural language processing model specifically designed for the Tajik language.

Based on RoBERTa Architecture

Utilizes an advanced RoBERTa-like architecture optimized for Tajik language processing.

Masked Language Modeling

Specially trained and optimized for mask filling tasks.

Model Capabilities

Tajik Text Understanding

Mask Filling

Language Model Prediction

Use Cases

Natural Language Processing

Text Completion

Automatically completes missing parts in Tajik text

Language Understanding

Understands the semantics and context of Tajik sentences

🚀 TajBERTo: RoBERTa-like Language model trained on Tajik

The first ever Tajik NLP model 🔥, offering masked text generation and fine - tuning capabilities.

🚀 Quick Start

You can use the raw model for masked text generation or fine - tune it to a downstream task.

✨ Features

Masked Text Generation: Capable of filling masked tokens in text.
Fine - Tuning: Can be fine - tuned for various downstream NLP tasks.

📦 Installation

No specific installation steps provided in the original README.

💻 Usage Examples

Basic Usage

from transformers import pipeline
fill_mask = pipeline(
    "fill-mask",
    model="muhtasham/TajBERTo",
    tokenizer="muhtasham/TajBERTo"
)
fill_mask("Пойтахти <mask> Душанбе")

# This is the beginning of a beautiful <mask>.

{'score': 0.1952248513698578,
  'sequence': 'Пойтахти шаҳри Душанбе',
  'token': 710,
  'token_str': ' шаҳри'},
 {'score': 0.029092855751514435,
  'sequence': 'Пойтахти дар Душанбе',
  'token': 310,
  'token_str': ' дар'},
 {'score': 0.020065447315573692,
  'sequence': 'Пойтахти Душанбе Душанбе',
  'token': 717,
  'token_str': ' Душанбе'},
 {'score': 0.016725927591323853,
  'sequence': 'Пойтахти Тоҷикистон Душанбе',
  'token': 424,
  'token_str': ' Тоҷикистон'},
 {'score': 0.011400512419641018,
  'sequence': 'Пойтахти аз Душанбе',
  'token': 335,
  'token_str': ' аз'}

📚 Documentation

Dataset

This model was trained on a filtered and merged version of Leipzig Corpora https://wortschatz.unileipzig.de/en/download/Tajik.

Intended Use

You can use the raw model for masked text generation or fine - tune it to a downstream task.

📄 Model Information

Property	Details
Model Name	TajBERTo
Task	Masked Language Modeling (fill - mask)
Generated From	Trainer
Widget Examples	- "Пойтахти Душанбе" - " ба ин сайти шумо медароям." - "Номи ман Акрам "

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご