T5 Translate En Ru Zh Large 1024

🚀 T5 English, Russian and Chinese multilingual machine translation

This model is a conventional T5 transformer in multitasking mode, precisely configured for machine translation between Russian, Chinese, and English, including pairs like ru-zh, zh-ru, en-zh, zh-en, en-ru, and ru-en.

🚀 Quick Start

This model can perform direct translation between any pair of Russian, Chinese, or English languages. To translate into the target language, specify the target language identifier as a prefix 'translate to :'. The source language doesn't need to be specified, and the source text can be multilingual.

💻 Usage Examples

Basic Usage

Example: Translate Russian to Chinese

from transformers import T5ForConditionalGeneration, T5Tokenizer

device = 'cuda' #or 'cpu' for translate on cpu

model_name = 'utrobinmv/t5_translate_en_ru_zh_large_1024'
model = T5ForConditionalGeneration.from_pretrained(model_name)
model.to(device)
tokenizer = T5Tokenizer.from_pretrained(model_name)

prefix = 'translate to zh: '
src_text = prefix + "Съешь ещё этих мягких французских булок."

# translate Russian to Chinese
input_ids = tokenizer(src_text, return_tensors="pt")

generated_tokens = model.generate(**input_ids.to(device))

result = tokenizer.batch_decode(generated_tokens, skip_special_tokens=True)
print(result)
# 再吃这些法国的甜蜜的面包。

Example: Translate Chinese to Russian

from transformers import T5ForConditionalGeneration, T5Tokenizer

device = 'cuda' #or 'cpu' for translate on cpu

model_name = 'utrobinmv/t5_translate_en_ru_zh_large_1024'
model = T5ForConditionalGeneration.from_pretrained(model_name)
model.to(device)
tokenizer = T5Tokenizer.from_pretrained(model_name)

prefix = 'translate to ru: '
src_text = prefix + "再吃这些法国的甜蜜的面包。"

# translate Russian to Chinese
input_ids = tokenizer(src_text, return_tensors="pt")

generated_tokens = model.generate(**input_ids.to(device))

result = tokenizer.batch_decode(generated_tokens, skip_special_tokens=True)
print(result)
# Съешьте этот сладкий хлеб из Франции.

📚 Documentation

Languages covered

Russian (ru_RU), Chinese (zh_CN), English (en_US)

📄 License

This project is licensed under the Apache-2.0 license.