đ art-eng Translation Model
This project focuses on translating from artificial languages to English. It provides a transformer - based model with specific pre - processing steps and detailed benchmark results.
đ Quick Start
The art-eng model is designed for translating from various artificial languages to English. You can download the original weights and test set translations from the provided links.
⨠Features
- Multilingual Support: Supports multiple artificial languages as source languages, including
afh_Latn, avk_Latn, dws_Latn, etc.
- Transformer Model: Utilizes a transformer architecture for translation tasks.
- Pre - processing: Applies normalization and SentencePiece (spm32k, spm32k) for pre - processing.
đĻ Installation
No specific installation steps are provided in the original document.
đ Documentation
Model Information
| Property |
Details |
| Model Type |
Transformer |
| Source Languages |
afh_Latn, avk_Latn, dws_Latn, epo, ido, ido_Latn, ile_Latn, ina_Latn, jbo, jbo_Cyrl, jbo_Latn, ldn_Latn, lfn_Cyrl, lfn_Latn, nov_Latn, qya, qya_Latn, sjn_Latn, tlh_Latn, tzl, tzl_Latn, vol_Latn |
| Target Language |
eng |
| Pre - processing |
Normalization + SentencePiece (spm32k, spm32k) |
| Download Original Weights |
opus2m - 2020 - 07 - 31.zip |
| Test Set Translations |
opus2m - 2020 - 07 - 31.test.txt |
| Test Set Scores |
opus2m - 2020 - 07 - 31.eval.txt |
Benchmarks
| testset |
BLEU |
chr - F |
| Tatoeba - test.afh - eng.afh.eng |
1.2 |
0.099 |
| Tatoeba - test.avk - eng.avk.eng |
0.4 |
0.105 |
| Tatoeba - test.dws - eng.dws.eng |
1.6 |
0.076 |
| Tatoeba - test.epo - eng.epo.eng |
34.6 |
0.530 |
| Tatoeba - test.ido - eng.ido.eng |
12.7 |
0.310 |
| Tatoeba - test.ile - eng.ile.eng |
4.6 |
0.218 |
| Tatoeba - test.ina - eng.ina.eng |
5.8 |
0.254 |
| Tatoeba - test.jbo - eng.jbo.eng |
0.2 |
0.115 |
| Tatoeba - test.ldn - eng.ldn.eng |
0.7 |
0.083 |
| Tatoeba - test.lfn - eng.lfn.eng |
1.8 |
0.172 |
| Tatoeba - test.multi.eng |
11.6 |
0.287 |
| Tatoeba - test.nov - eng.nov.eng |
5.1 |
0.215 |
| Tatoeba - test.qya - eng.qya.eng |
0.7 |
0.113 |
| Tatoeba - test.sjn - eng.sjn.eng |
0.9 |
0.090 |
| Tatoeba - test.tlh - eng.tlh.eng |
0.2 |
0.124 |
| Tatoeba - test.tzl - eng.tzl.eng |
1.4 |
0.109 |
| Tatoeba - test.vol - eng.vol.eng |
0.5 |
0.115 |
System Info
- hf_name: art - eng
- source_languages: art
- target_languages: eng
- opus_readme_url: https://github.com/Helsinki - NLP/Tatoeba - Challenge/tree/master/models/art - eng/README.md
- original_repo: Tatoeba - Challenge
- tags: ['translation']
- languages: ['eo', 'io', 'art', 'en']
- src_constituents: {'sjn_Latn', 'tzl', 'vol_Latn', 'qya', 'tlh_Latn', 'ile_Latn', 'ido_Latn', 'tzl_Latn', 'jbo_Cyrl', 'jbo', 'lfn_Latn', 'nov_Latn', 'dws_Latn', 'ldn_Latn', 'avk_Latn', 'lfn_Cyrl', 'ina_Latn', 'jbo_Latn', 'epo', 'afh_Latn', 'qya_Latn', 'ido'}
- tgt_constituents: {'eng'}
- src_multilingual: True
- tgt_multilingual: False
- prepro: Normalization + SentencePiece (spm32k, spm32k)
- url_model: https://object.pouta.csc.fi/Tatoeba - MT - models/art - eng/opus2m - 2020 - 07 - 31.zip
- url_test_set: https://object.pouta.csc.fi/Tatoeba - MT - models/art - eng/opus2m - 2020 - 07 - 31.test.txt
- src_alpha3: art
- tgt_alpha3: eng
- short_pair: art - en
- chrF2_score: 0.287
- bleu: 11.6
- brevity_penalty: 1.0
- ref_len: 73037.0
- src_name: Artificial languages
- tgt_name: English
- train_date: 2020 - 07 - 31
- src_alpha2: art
- tgt_alpha2: en
- prefer_old: False
- long_pair: art - eng
- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
- port_machine: brutasse
- port_time: 2020 - 08 - 21 - 14:41
đ License
This project is licensed under the Apache - 2.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
