Albert Tiny Chinese Ws

🚀 CKIP ALBERT Tiny Chinese

This project offers traditional Chinese transformers models (including ALBERT, BERT, GPT2) and NLP tools (including word segmentation, part-of-speech tagging, named entity recognition), facilitating various NLP tasks in the Chinese language.

🚀 Quick Start

This project provides traditional Chinese transformers models and NLP tools. For more details, you can visit the project's homepage.

✨ Features

• Rich Model Selection: Offers multiple traditional Chinese transformers models such as ALBERT, BERT, and GPT2.
• Comprehensive NLP Tools: Provides NLP tools including word segmentation, part - of - speech tagging, and named entity recognition.

📦 Installation

The README does not provide specific installation steps, so this section is skipped.

💻 Usage Examples

Basic Usage

Please use BertTokenizerFast as the tokenizer instead of AutoTokenizer.

from transformers import (
  BertTokenizerFast,
  AutoModel,
)

tokenizer = BertTokenizerFast.from_pretrained('bert-base-chinese')
model = AutoModel.from_pretrained('ckiplab/albert-tiny-chinese-ws')

For full usage and more information, please refer to https://github.com/ckiplab/ckip-transformers.

📚 Documentation

• Homepage: https://github.com/ckiplab/ckip-transformers

🔧 Technical Details

The README does not provide specific technical details, so this section is skipped.

📄 License

This project is licensed under the GPL - 3.0 license.

👥 Contributors

• Mu Yang at CKIP (Author & Maintainer)