Translation En Pt T5

🚀 T5 Translation for EN - PT Tasks

This repository offers an implementation of T5 for EN - PT translation tasks with a modest hardware setup, bringing improvements through changes in tokenization and post - processing.

🚀 Quick Start

This repository provides an implementation of T5 for English - Portuguese translation tasks using a modest hardware setup. We've made some changes to the tokenizer and post - processing steps, which enhance the translation results. A Portuguese pre - trained model is also utilized for the translation. You can find more information in our repository. Also, check our paper!

✨ Features

• Languages Supported: English and Portuguese.
• Datasets Used:
  • EMEA
  • ParaCrawl 99k
  • CAPES
  • Scielo
  • JRC - Acquis
  • Biomedical Domain Corpora
• Tags: Translation
• Metrics: BLEU

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

Just follow the "Use in Transformers" instructions. It's necessary to add a few words before to define the task for T5. You can also create a pipeline for it. Here's an example with the phrase "I like to eat rice":

from transformers import AutoTokenizer, AutoModelForSeq2SeqLM, pipeline
  
tokenizer = AutoTokenizer.from_pretrained("unicamp-dl/translation-en-pt-t5")

model = AutoModelForSeq2SeqLM.from_pretrained("unicamp-dl/translation-en-pt-t5")

enpt_pipeline = pipeline('text2text-generation', model=model, tokenizer=tokenizer)

enpt_pipeline("translate English to Portuguese: I like to eat rice.")

📚 Documentation

No detailed documentation other than the usage example is provided in the original document.

📄 License

No license information is provided in the original document.

📚 Citation

@inproceedings{lopes-etal-2020-lite,
    title = "Lite Training Strategies for {P}ortuguese-{E}nglish and {E}nglish-{P}ortuguese Translation",
    author = "Lopes, Alexandre  and
      Nogueira, Rodrigo  and
      Lotufo, Roberto  and
      Pedrini, Helio",
    booktitle = "Proceedings of the Fifth Conference on Machine Translation",
    month = nov,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://www.aclweb.org/anthology/2020.wmt-1.90",
    pages = "833--840",
}