T5 Small Finetuned Xsum

🚀 Rocketknight1/t5-small-finetuned-xsum

This model is a fine - tuned version of t5-small on an unknown dataset. It provides evaluation results such as train loss, validation loss, and various Rouge scores, offering insights into its performance.

🚀 Quick Start

This model is ready for use after fine - tuning. You can load it via the Hugging Face Transformers library to perform tasks like text summarization.

📚 Documentation

Model Information

Evaluation Results

This model achieves the following results on the evaluation set:

• Train Loss: 2.7172
• Validation Loss: 2.3977
• Train Rouge1: 28.7469
• Train Rouge2: 7.9005
• Train Rougel: 22.5917
• Train Rougelsum: 22.6162
• Train Gen Len: 18.875
• Epoch: 0

Training Procedure

Training Hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e - 05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e - 07, 'amsgrad': False, 'weight_decay_rate': 0.01}
• training_precision: float32

Training Results

Framework Versions

• Transformers 4.16.0.dev0
• TensorFlow 2.8.0 - rc0
• Datasets 1.17.0
• Tokenizers 0.11.0

📄 License

This model is licensed under the Apache - 2.0 license.