Roberta Base

🚀 KLUE RoBERTa base

基於韓語的預訓練RoBERTa模型，可用於韓語相關的自然語言處理任務。

基本信息

示例展示

{
  "widget": [
    {
      "text": "대한민국의 수도는 [MASK] 입니다."
    }
  ]
}

🚀 快速開始

該模型是在韓語語料上預訓練的RoBERTa模型。更多詳情請查看 Github 和 論文。

💻 使用示例

基礎用法

⚠️ 重要提示

請使用 BertTokenizer 而非 RobertaTokenizer。（AutoTokenizer 會加載 BertTokenizer）

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("klue/roberta-base")
tokenizer = AutoTokenizer.from_pretrained("klue/roberta-base")

📚 詳細文檔

BibTeX引用

如果您在研究中使用了該模型，請使用以下BibTeX條目進行引用：

@misc{park2021klue,
      title={KLUE: Korean Language Understanding Evaluation},
      author={Sungjoon Park and Jihyung Moon and Sungdong Kim and Won Ik Cho and Jiyoon Han and Jangwon Park and Chisung Song and Junseong Kim and Yongsook Song and Taehwan Oh and Joohong Lee and Juhyun Oh and Sungwon Lyu and Younghoon Jeong and Inkwon Lee and Sangwoo Seo and Dongjun Lee and Hyunwoo Kim and Myeonghwa Lee and Seongbo Jang and Seungwon Do and Sunkyoung Kim and Kyungtae Lim and Jongwon Lee and Kyumin Park and Jamin Shin and Seonghyun Kim and Lucy Park and Alice Oh and Jungwoo Ha and Kyunghyun Cho},
      year={2021},
      eprint={2105.09680},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}