đ English to South Slavic Languages Translation Model
This project focuses on translating English into South Slavic languages. It provides a transformer - based model with specific pre - processing steps and offers test set scores for evaluation.
đ Quick Start
The model is designed to translate English to South Slavic languages. You can download the original weights and test set translations from the provided links.
⨠Features
- Language Support: Supports translation from English to multiple South Slavic languages including Bosnian, Bulgarian, Croatian, Macedonian, Serbian, and Slovenian.
- Pre - processing: Uses normalization and SentencePiece (spm32k, spm32k) for pre - processing.
- Benchmark Scores: Provides BLEU and chr - F scores on different test sets for evaluation.
đĻ Installation
No specific installation steps are provided in the original document.
đģ Usage Examples
No code examples are provided in the original document.
đ Documentation
eng - zls
- Source Group: English
- Target Group: South Slavic languages
- OPUS Readme: eng - zls
- Model: Transformer
- Source Language(s): eng
- Target Language(s): bos_Latn, bul, bul_Latn, hrv, mkd, slv, srp_Cyrl, srp_Latn
- Pre - processing: normalization + SentencePiece (spm32k, spm32k)
- Requirement: A sentence initial language token is required in the form of
>>id<< (id = valid target language ID)
- Download Original Weights: opus2m - 2020 - 08 - 02.zip
- Test Set Translations: opus2m - 2020 - 08 - 02.test.txt
- Test Set Scores: opus2m - 2020 - 08 - 02.eval.txt
Benchmarks
| Testset |
BLEU |
chr - F |
| Tatoeba - test.eng - bul.eng.bul |
47.6 |
0.657 |
| Tatoeba - test.eng - hbs.eng.hbs |
40.7 |
0.619 |
| Tatoeba - test.eng - mkd.eng.mkd |
45.2 |
0.642 |
| Tatoeba - test.eng.multi |
42.7 |
0.622 |
| Tatoeba - test.eng - slv.eng.slv |
17.9 |
0.351 |
System Info
| Property |
Details |
| hf_name |
eng - zls |
| source_languages |
eng |
| target_languages |
zls |
| opus_readme_url |
https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-zls/README.md |
| original_repo |
Tatoeba - Challenge |
| tags |
['translation'] |
| languages |
['en', 'hr', 'mk', 'bg', 'sl', 'zls'] |
| src_constituents |
{'eng'} |
| tgt_constituents |
{'hrv', 'mkd', 'srp_Latn', 'srp_Cyrl', 'bul_Latn', 'bul', 'bos_Latn', 'slv'} |
| src_multilingual |
False |
| tgt_multilingual |
True |
| prepro |
normalization + SentencePiece (spm32k, spm32k) |
| url_model |
https://object.pouta.csc.fi/Tatoeba-MT-models/eng-zls/opus2m-2020-08-02.zip |
| url_test_set |
https://object.pouta.csc.fi/Tatoeba-MT-models/eng-zls/opus2m-2020-08-02.test.txt |
| src_alpha3 |
eng |
| tgt_alpha3 |
zls |
| short_pair |
en - zls |
| chrF2_score |
0.622 |
| bleu |
42.7 |
| brevity_penalty |
0.9690000000000001 |
| ref_len |
64788.0 |
| src_name |
English |
| tgt_name |
South Slavic languages |
| train_date |
2020 - 08 - 02 |
| src_alpha2 |
en |
| tgt_alpha2 |
zls |
| prefer_old |
False |
| long_pair |
eng - zls |
| helsinki_git_sha |
480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535 |
| transformers_git_sha |
2207e5d8cb224e954a7cba69fa4ac2309e9ff30b |
| port_machine |
brutasse |
| port_time |
2020 - 08 - 21 - 14:41 |
đ License
This project is licensed under the Apache - 2.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
