# RoBERTa-large architecture

This is a Polish-language sentence embedding model capable of mapping sentences and paragraphs into a 1024-dimensional vector space, suitable for semantic search and clustering tasks.

BERTIN is a series of Spanish language models based on BERT. This model follows the RoBERTa-large architecture, trained from scratch using the Flax framework, with data sourced from the Spanish portion of the mC4 corpus.

A RoBERTa-large model trained on data from the Spanish National Library (BNE), fine-tuned for Spanish POS tagging on the CAPITEL dataset