Opus Mt Gem Gem

language:

• da
• sv
• af
• nn
• fy
• fo
• de
• nb
• nl
• is
• en
• lb
• yi
• gem

tags:

• translation

license: apache-2.0

gem-gem

• source group: Germanic languages

• target group: Germanic languages

• OPUS readme: gem-gem

• model: transformer

• source language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid

• target language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid

• model: transformer

• pre-processing: normalization + SentencePiece (spm32k,spm32k)

• a sentence initial language token is required in the form of >>id<< (id = valid target language ID)

• download original weights: opus-2020-07-27.zip

• test set translations: opus-2020-07-27.test.txt

• test set scores: opus-2020-07-27.eval.txt

Benchmarks

System Info:

• hf_name: gem-gem

• source_languages: gem

• target_languages: gem

• opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gem-gem/README.md

• original_repo: Tatoeba-Challenge

• tags: ['translation']

• languages: ['da', 'sv', 'af', 'nn', 'fy', 'fo', 'de', 'nb', 'nl', 'is', 'en', 'lb', 'yi', 'gem']

• src_constituents: {'ksh', 'enm_Latn', 'got_Goth', 'stq', 'dan', 'swe', 'afr', 'pdc', 'gos', 'nno', 'fry', 'gsw', 'fao', 'deu', 'swg', 'sco', 'nob', 'nld', 'isl', 'eng', 'ltz', 'nob_Hebr', 'ang_Latn', 'frr', 'non_Latn', 'yid', 'nds'}

• tgt_constituents: {'ksh', 'enm_Latn', 'got_Goth', 'stq', 'dan', 'swe', 'afr', 'pdc', 'gos', 'nno', 'fry', 'gsw', 'fao', 'deu', 'swg', 'sco', 'nob', 'nld', 'isl', 'eng', 'ltz', 'nob_Hebr', 'ang_Latn', 'frr', 'non_Latn', 'yid', 'nds'}

• src_multilingual: True

• tgt_multilingual: True

• prepro: normalization + SentencePiece (spm32k,spm32k)

• url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.zip

• url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.test.txt

• src_alpha3: gem

• tgt_alpha3: gem

• short_pair: gem-gem

• chrF2_score: 0.614

• bleu: 42.7

• brevity_penalty: 0.993

• ref_len: 73459.0

• src_name: Germanic languages

• tgt_name: Germanic languages

• train_date: 2020-07-27

• src_alpha2: gem

• tgt_alpha2: gem

• prefer_old: False

• long_pair: gem-gem

• helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

• transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

• port_machine: brutasse

• port_time: 2020-08-21-14:41