đ eng-pqw
- This translation model focuses on converting English to Western Malayo - Polynesian languages.
- It provides a practical solution for cross - language communication between these language groups.
⨠Features
- Translation Direction: Translates from English to multiple Western Malayo - Polynesian languages, including
akl_Latn, ceb, cha, etc.
- Model Type: Utilizes the
transformer model.
- Pre - processing: Applies normalization and SentencePiece (spm32k, spm32k).
- Language Token Requirement: A sentence initial language token in the form of
>>id<< (where id is a valid target language ID) is required.
đĻ Installation
No installation steps are provided in the original document, so this section is skipped.
đģ Usage Examples
No code examples are provided in the original document, so this section is skipped.
đ Documentation
Model Information
| Property |
Details |
| Source Group |
English |
| Target Group |
Western Malayo - Polynesian languages |
| OPUS Readme |
[eng - pqw](https://github.com/Helsinki - NLP/Tatoeba - Challenge/tree/master/models/eng - pqw/README.md) |
| Model Type |
transformer |
| Source Language(s) |
eng |
| Target Language(s) |
akl_Latn, ceb, cha, dtp, hil, iba, ilo, ind, jav, jav_Java, mad, max_Latn, min, mlg, pag, pau, sun, tmw_Latn, war, zlm_Latn, zsm_Latn |
| Pre - processing |
normalization + SentencePiece (spm32k, spm32k) |
| Language Token Requirement |
A sentence initial language token in the form of >>id<< (id = valid target language ID) |
| Download Original Weights |
[opus2m - 2020 - 08 - 01.zip](https://object.pouta.csc.fi/Tatoeba - MT - models/eng - pqw/opus2m - 2020 - 08 - 01.zip) |
| Test Set Translations |
[opus2m - 2020 - 08 - 01.test.txt](https://object.pouta.csc.fi/Tatoeba - MT - models/eng - pqw/opus2m - 2020 - 08 - 01.test.txt) |
| Test Set Scores |
[opus2m - 2020 - 08 - 01.eval.txt](https://object.pouta.csc.fi/Tatoeba - MT - models/eng - pqw/opus2m - 2020 - 08 - 01.eval.txt) |
Benchmarks
| testset |
BLEU |
chr - F |
| Tatoeba - test.eng - akl.eng.akl |
3.0 |
0.143 |
| Tatoeba - test.eng - ceb.eng.ceb |
11.4 |
0.432 |
| Tatoeba - test.eng - cha.eng.cha |
1.4 |
0.189 |
| Tatoeba - test.eng - dtp.eng.dtp |
0.6 |
0.139 |
| Tatoeba - test.eng - hil.eng.hil |
17.7 |
0.525 |
| Tatoeba - test.eng - iba.eng.iba |
14.6 |
0.365 |
| Tatoeba - test.eng - ilo.eng.ilo |
34.0 |
0.590 |
| Tatoeba - test.eng - jav.eng.jav |
6.2 |
0.299 |
| Tatoeba - test.eng - mad.eng.mad |
2.6 |
0.154 |
| Tatoeba - test.eng - mlg.eng.mlg |
34.3 |
0.518 |
| Tatoeba - test.eng - msa.eng.msa |
31.1 |
0.561 |
| Tatoeba - test.eng.multi |
17.5 |
0.422 |
| Tatoeba - test.eng - pag.eng.pag |
19.8 |
0.507 |
| Tatoeba - test.eng - pau.eng.pau |
1.2 |
0.129 |
| Tatoeba - test.eng - sun.eng.sun |
30.3 |
0.418 |
| Tatoeba - test.eng - war.eng.war |
12.6 |
0.439 |
System Info
- hf_name: eng - pqw
- source_languages: eng
- target_languages: pqw
- opus_readme_url: https://github.com/Helsinki - NLP/Tatoeba - Challenge/tree/master/models/eng - pqw/README.md
- original_repo: Tatoeba - Challenge
- tags: ['translation']
- languages: ['en', 'pqw']
- src_constituents: {'eng'}
- tgt_constituents: set()
- src_multilingual: False
- tgt_multilingual: True
- prepro: normalization + SentencePiece (spm32k, spm32k)
- url_model: https://object.pouta.csc.fi/Tatoeba - MT - models/eng - pqw/opus2m - 2020 - 08 - 01.zip
- url_test_set: https://object.pouta.csc.fi/Tatoeba - MT - models/eng - pqw/opus2m - 2020 - 08 - 01.test.txt
- src_alpha3: eng
- tgt_alpha3: pqw
- short_pair: en - pqw
- chrF2_score: 0.42200000000000004
- bleu: 17.5
- brevity_penalty: 1.0
- ref_len: 66758.0
- src_name: English
- tgt_name: Western Malayo - Polynesian languages
- train_date: 2020 - 08 - 01
- src_alpha2: en
- tgt_alpha2: pqw
- prefer_old: False
- long_pair: eng - pqw
- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b
- port_machine: brutasse
- port_time: 2020 - 08 - 21 - 14:41
đ§ Technical Details
No technical implementation details are provided in the original document, so this section is skipped.
đ License
This project is licensed under the apache - 2.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
