Albert Tiny Chinese

🚀 CKIP ALBERT Tiny Chinese

This project offers traditional Chinese transformers models (including ALBERT, BERT, GPT2) and NLP tools (including word segmentation, part-of-speech tagging, named entity recognition). It provides practical solutions for Chinese natural language processing tasks.

🚀 Quick Start

This project provides traditional Chinese transformers models and NLP tools. You can quickly start using them following the steps below.

✨ Features

• Rich Model Selection: Offers multiple Chinese transformers models such as ALBERT, BERT, and GPT2.
• Comprehensive NLP Tools: Provides natural language processing tools including word segmentation, part - of - speech tagging, and named entity recognition.

💻 Usage Examples

Basic Usage

from transformers import (
  BertTokenizerFast,
  AutoModel,
)

tokenizer = BertTokenizerFast.from_pretrained('bert-base-chinese')
model = AutoModel.from_pretrained('ckiplab/albert-tiny-chinese')

⚠️ Important Note

Please use BertTokenizerFast as tokenizer instead of AutoTokenizer.

For full usage and more information, please refer to https://github.com/ckiplab/ckip-transformers.

📚 Documentation

• Homepage: https://github.com/ckiplab/ckip-transformers

📄 License

This project is licensed under the GPL - 3.0 license.

👥 Contributors

• Mu Yang at CKIP (Author & Maintainer)