Bert Base Chinese Ws

🚀 CKIP BERT Base Chinese

This project offers traditional Chinese transformers models (including ALBERT, BERT, GPT2) and NLP tools (including word segmentation, part-of-speech tagging, named entity recognition).

🚀 Quick Start

This project provides various traditional Chinese transformers models and NLP tools. For detailed usage, please refer to the following content.

✨ Features

• Rich Models: It includes multiple transformers models such as ALBERT, BERT, and GPT2.
• Diverse NLP Tools: Offers NLP tools like word segmentation, part - of - speech tagging, and named entity recognition.

📦 Installation

No specific installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

Please use BertTokenizerFast as the tokenizer instead of AutoTokenizer.

from transformers import (
  BertTokenizerFast,
  AutoModel,
)

tokenizer = BertTokenizerFast.from_pretrained('bert-base-chinese')
model = AutoModel.from_pretrained('ckiplab/bert-base-chinese-ws')

For full usage and more information, please refer to https://github.com/ckiplab/ckip-transformers.

📚 Documentation

• Homepage: https://github.com/ckiplab/ckip-transformers

🔧 Technical Details

No technical details are provided in the original document, so this section is skipped.

📄 License

This project is licensed under the GPL - 3.0 license.

👥 Contributors

• Mu Yang at CKIP (Author & Maintainer)