Bert Base En Th Cased

🚀 bert-base-en-th-cased

We're sharing smaller versions of bert-base-multilingual-cased that support a custom number of languages, offering the same accuracy as the original model.

🚀 Quick Start

We are sharing smaller versions of bert-base-multilingual-cased that handle a custom number of languages.

Unlike distilbert-base-multilingual-cased, our versions give exactly the same representations produced by the original model which preserves the original accuracy.

For more information please visit our paper: Load What You Need: Smaller Versions of Multilingual BERT.

📦 Installation

No specific installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("Geotrend/bert-base-en-th-cased")
model = AutoModel.from_pretrained("Geotrend/bert-base-en-th-cased")

Advanced Usage

No advanced usage code examples are provided in the original document, so this part is skipped.

To generate other smaller versions of multilingual transformers please visit our Github repo.

How to cite

@inproceedings{smallermbert,
  title={Load What You Need: Smaller Versions of Mutlilingual BERT},
  author={Abdaoui, Amine and Pradel, Camille and Sigel, Grégoire},
  booktitle={SustaiNLP / EMNLP},
  year={2020}
}

📚 Documentation

📄 License

The project is licensed under the Apache-2.0 license.

Contact

Please contact amine@geotrend.fr for any question, feedback or request.