đ taw-eng Translation Model
This project focuses on the translation between Tai languages and English, providing a transformer-based model with specific pre - processing steps and performance benchmarks.
đ Quick Start
This model is designed for translating Tai languages (including Lao and Thai) to English. You can download the original weights and test set translations from the provided links for further usage.
⨠Features
- Multilingual Support: Supports multiple source languages (Lao and Thai) for translation to English.
- Transformer Model: Utilizes a transformer architecture for translation tasks.
- Pre - processing: Applies normalization and SentencePiece (spm32k, spm32k) for pre - processing.
đĻ Installation
There is no specific installation steps provided in the original document.
đģ Usage Examples
There are no code examples provided in the original document.
đ Documentation
Model Information
Benchmarks
| Testset |
BLEU |
chr-F |
| Tatoeba-test.lao-eng.lao.eng |
1.1 |
0.133 |
| Tatoeba-test.multi.eng |
38.9 |
0.572 |
| Tatoeba-test.tha-eng.tha.eng |
40.6 |
0.588 |
System Info
| Property |
Details |
| hf_name |
taw-eng |
| source_languages |
taw |
| target_languages |
eng |
| opus_readme_url |
https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/taw-eng/README.md |
| original_repo |
Tatoeba-Challenge |
| tags |
['translation'] |
| languages |
['lo', 'th', 'taw', 'en'] |
| src_constituents |
{'lao', 'tha'} |
| tgt_constituents |
{'eng'} |
| src_multilingual |
True |
| tgt_multilingual |
False |
| prepro |
normalization + SentencePiece (spm32k, spm32k) |
| url_model |
https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.zip |
| url_test_set |
https://object.pouta.csc.fi/Tatoeba-MT-models/taw-eng/opus-2020-06-28.test.txt |
| src_alpha3 |
taw |
| tgt_alpha3 |
eng |
| short_pair |
taw-en |
| chrF2_score |
0.5720000000000001 |
| bleu |
38.9 |
| brevity_penalty |
1.0 |
| ref_len |
7630.0 |
| src_name |
Tai |
| tgt_name |
English |
| train_date |
2020-06-28 |
| src_alpha2 |
taw |
| tgt_alpha2 |
en |
| prefer_old |
False |
| long_pair |
taw-eng |
| helsinki_git_sha |
480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535 |
| transformers_git_sha |
2207e5d8cb224e954a7cba69fa4ac2309e9ff30b |
| port_machine |
brutasse |
| port_time |
2020-08-21-14:41 |
đ License
This project is licensed under the Apache-2.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
