Ruroberta Large

🚀 ruRoberta-large

ruRoberta-large是由SberDevices團隊預訓練的模型。該模型架構設計、預訓練和評估的相關內容記錄在我們的預印本論文中：A Family of Pretrained Transformer Language Models for Russian，它能夠解決掩碼填充任務。

📚 詳細文檔

模型信息

作者信息

• NLP核心研發團隊 Telegram頻道：
  • Dmitry Zmitrovich

引用信息

如果您使用了本模型，請按照以下格式引用：

@misc{zmitrovich2023family,
      title={A Family of Pretrained Transformer Language Models for Russian}, 
      author={Dmitry Zmitrovich and Alexander Abramov and Andrey Kalmykov and Maria Tikhonova and Ekaterina Taktasheva and Danil Astafurov and Mark Baushenko and Artem Snegirev and Tatiana Shavrina and Sergey Markov and Vladislav Mikhailov and Alena Fenogenova},
      year={2023},
      eprint={2309.10931},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}