Roberta Small

🚀 KLUE RoBERTa small

KLUE RoBERTa small是一個針對韓語進行預訓練的RoBERTa模型。該模型為韓語自然語言處理任務提供了強大的支持。若想了解更多詳細信息，請查看Github和論文。

模型信息

小工具示例

輸入文本：대한민국의 수도는 [MASK] 입니다.

🚀 快速開始

使用說明

⚠️ 重要提示

使用BertTokenizer而非RobertaTokenizer（AutoTokenizer將加載BertTokenizer）。

💻 使用示例

基礎用法

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("klue/roberta-small")
tokenizer = AutoTokenizer.from_pretrained("klue/roberta-small")

📚 詳細文檔

BibTeX引用信息

@misc{park2021klue,
      title={KLUE: Korean Language Understanding Evaluation},
      author={Sungjoon Park and Jihyung Moon and Sungdong Kim and Won Ik Cho and Jiyoon Han and Jangwon Park and Chisung Song and Junseong Kim and Yongsook Song and Taehwan Oh and Joohong Lee and Juhyun Oh and Sungwon Lyu and Younghoon Jeong and Inkwon Lee and Sangwoo Seo and Dongjun Lee and Hyunwoo Kim and Myeonghwa Lee and Seongbo Jang and Seungwon Do and Sunkyoung Kim and Kyungtae Lim and Jongwon Lee and Kyumin Park and Jamin Shin and Seonghyun Kim and Lucy Park and Alice Oh and Jungwoo Ha and Kyunghyun Cho},
      year={2021},
      eprint={2105.09680},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}