Original Transformer

🚀 Original Transformer Model

This is a custom Hugging Face model ported from the 2017 PyTorch implementation of the original transformer model, trained for English-to-German translations.

🚀 Quick Start

This is a custom huggingface model port of the PyTorch implementation of the original transformer model from 2017 introduced in the paper "Attention Is All You Need". This is the 65M parameter base model version trained to do English-to-German translations.

💻 Usage Examples

Basic Usage

model = AutoModel.from_pretrained("ubaada/original-transformer", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("ubaada/original-transformer")
text = 'This is my cat'
output = model.generate(**tokenizer(text, return_tensors="pt", add_special_tokens=True, truncation=True, max_length=100))
tokenizer.decode(output[0], skip_special_tokens=True, clean_up_tokenization_spaces=True)
# Output: ' Das ist meine Katze.'

⚠️ Important Note

Remember to set trust_remote_code=True because of the custom modeling file.

📚 Documentation

Training Details

Results

📄 License

This project is licensed under the Apache-2.0 license.