G

Gujarati XLM R Base

Developed by ashwani-tanwar
This model is based on the base variant of XLM-RoBERTa, fine-tuned using Gujarati language and OSCAR monolingual datasets, suitable for Gujarati natural language processing tasks.
Downloads 22
Release Time : 3/2/2022

Model Overview

The model fine-tunes XLM-R on Gujarati through transfer learning, capable of generating context-dependent word representations, predicting missing words, and further fine-tuning for other NLP tasks.

Model Features

Transfer learning
Fine-tuned based on the pre-trained XLM-R model, leveraging the knowledge of its parent model to enhance performance.
Diverse dataset
Utilizes the Gujarati dataset from the OSCAR corpus, which includes diverse data across multiple languages, outperforming homogeneous datasets.

Model Capabilities

Generate context-dependent word representations for Gujarati words
Predict missing words in Gujarati sentences
Support fine-tuning for Gujarati natural language processing tasks

Use Cases

Natural Language Processing
Missing word prediction
Predict missing words in Gujarati sentences, such as 'เชถเชนเซ‡เชฐ' (city) in the example.
Prediction accuracy as high as 94.6%
Word representation generation
Generate context-dependent word representations for Gujarati words, useful for downstream tasks.
Featured Recommended AI Models
ยฉ 2025AIbase