Gn Bert Base Cased

🚀 BERT-i-base-cased (gnBERT-base-cased)

A pre-trained BERT model for Guarani (12 layers, cased), trained on Wikipedia + Wiktionary (~800K tokens).

🚀 Quick Start

This is a pre - trained BERT model specifically designed for the Guarani language. It has 12 layers and supports cased text. The model was trained on a combined dataset of Wikipedia and Wiktionary, which contains approximately 800K tokens.

📦 Installation

No installation steps were provided in the original document, so this section is skipped.

💻 Usage Examples

No code examples were provided in the original document, so this section is skipped.

📚 Documentation

Datasets

Widget Examples

• "Paraguay ha'e peteĩ táva oĩva [MASK] retãme"
• "Augusto Roa Bastos ha'e peteĩ [MASK] arandu"

Evaluation Metrics

• F1
• Accuracy

📄 License

This project is licensed under the MIT license.

📚 How to Cite

@article{aguero-et-al2023multi-affect-low-langs-grn,
  title={Multidimensional Affective Analysis for Low-resource Languages: A Use Case with Guarani-Spanish Code-switching Language},
  author={Agüero-Torales, Marvin Matías, López-Herrera, Antonio Gabriel, and Vilares, David},
  journal={Cognitive Computation},
  year={2023},
  publisher={Springer},
  notes={Forthcoming}
}