Ernie 3.0 Xbase Zh

🚀 ERNIE-3.0-xbase-zh

ERNIE 3.0 is a large-scale knowledge-enhanced pre-training model for language understanding and generation. It offers advanced capabilities in natural language processing tasks.

🚀 Quick Start

ERNIE 3.0 is a powerful pre - trained model for language understanding and generation. You can use it easily with the following steps.

✨ Features

• The released PyTorch model is converted from the officially released PaddlePaddle ERNIE model.
• A series of experiments have been conducted to ensure the accuracy of the conversion.

📦 Installation

There is no specific installation command provided in the original document.

💻 Usage Examples

Basic Usage

from transformers import BertTokenizer, ErnieModel

tokenizer = BertTokenizer.from_pretrained("nghuyong/ernie-3.0-xbase-zh")
model = ErnieModel.from_pretrained("nghuyong/ernie-3.0-xbase-zh")

📚 Documentation

• More details about ERNIE 3.0: https://arxiv.org/abs/2107.02137
• Official PaddlePaddle ERNIE repo: https://paddlenlp.readthedocs.io/zh/latest/model_zoo/transformers/ERNIE/contents.html
• Pytorch Conversion repo: https://github.com/nghuyong/ERNIE-Pytorch

📄 License

No license information is provided in the original document.

📄 Citation

@article{sun2021ernie,
  title={Ernie 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation},
  author={Sun, Yu and Wang, Shuohuan and Feng, Shikun and Ding, Siyu and Pang, Chao and Shang, Junyuan and Liu, Jiaxiang and Chen, Xuyi and Zhao, Yanbin and Lu, Yuxiang and others},
  journal={arXiv preprint arXiv:2107.02137},
  year={2021}
}