Bert Tiny Chinese Ws

🚀 CKIP BERT Tiny Chinese

This project offers traditional Chinese transformers models (including ALBERT, BERT, GPT2) and NLP tools (including word segmentation, part-of-speech tagging, named entity recognition). It provides essential resources for Chinese NLP tasks.

🚀 Quick Start

This project provides a series of traditional Chinese transformers models and NLP tools. To get started, follow the steps below.

✨ Features

• Rich Model Selection: Offers multiple transformers models such as ALBERT, BERT, and GPT2 for traditional Chinese.
• Comprehensive NLP Tools: Provides NLP tools including word segmentation, part - of - speech tagging, and named entity recognition.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

Please use BertTokenizerFast as the tokenizer instead of AutoTokenizer.

from transformers import (
  BertTokenizerFast,
  AutoModel,
)

tokenizer = BertTokenizerFast.from_pretrained('bert-base-chinese')
model = AutoModel.from_pretrained('ckiplab/bert-tiny-chinese-ws')

For full usage and more information, please refer to https://github.com/ckiplab/ckip-transformers.

📚 Documentation

• Homepage: https://github.com/ckiplab/ckip-transformers

📄 License

This project is licensed under the GPL - 3.0 license.

👥 Contributers

• Mu Yang at CKIP (Author & Maintainer)