๐ marian-finetuned-multidataset-kin-to-en
This is a fine - tuned model for Kinyarwanda to English machine translation, achieving good results on the evaluation set.
๐ Quick Start
This model is a fine - tuned version of [Helsinki - NLP/opus - mt - rw - en](https://huggingface.co/Helsinki - NLP/opus - mt - rw - en) on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 1.7550
- Bleu: 36.2717
โจ Features
- The model has been fine - tuned to perform machine translation from Kinyarwanda to English.
- The primary intended use of this model is for research purposes.
๐ฆ Installation
No installation steps are provided in the original document, so this section is skipped.
๐ป Usage Examples
No code examples are provided in the original document, so this section is skipped.
๐ Documentation
Model Description
The model has been fine - tuned to perform machine translation from Kinyarwanda to English.
Intended Uses & Limitations
The primary intended use of this model is for research purposes.
Training and Evaluation Data
The model was fine - tuned using a combination of datasets from the following sources:
- [Digital Umuganda](https://huggingface.co/datasets/DigitalUmuganda/kinyarwanda - english - machine - translation - dataset/tree/main)
- [Masakhane](https://huggingface.co/datasets/masakhane/mafand/viewer/en - kin/validation)
- Muennighoff
For the training of the machine translation model, the dataset underwent the following preprocessing steps:
- Text was converted to lowercase
- Digits were removed
The combined dataset was divided into training and validation sets, with a split of 90% for training and 10% for validation.
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e - 05
- train_batch_size: 32
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
- lr_scheduler_type: linear
- num_epochs: 3
Training results
No specific training results are provided in the original document, so details are skipped here.
Framework versions
- Transformers 4.31.0
- Pytorch 2.0.1+cu118
- Datasets 2.14.4
- Tokenizers 0.13.3
๐ง Technical Details
The model is a fine - tuned version of [Helsinki - NLP/opus - mt - rw - en](https://huggingface.co/Helsinki - NLP/opus - mt - rw - en), fine - tuned on multiple datasets for Kinyarwanda - to - English machine translation. The pre - processing of the dataset and the training hyperparameters are described in the documentation section.
๐ License
The model is licensed under the Apache 2.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
