T5 Small Finetuned Cnn V2

🚀 t5-small-finetuned-cnn-v2

This model is a fine - tuned version of t5-small on the cnn_dailymail dataset. It is designed for text summarization tasks and can generate high - quality summaries.

🚀 Quick Start

This model is a fine - tuned version of t5-small on the cnn_dailymail dataset. It achieves the following results on the evaluation set:

• Loss: 1.5474
• Rouge1: 35.154
• Rouge2: 18.683
• Rougel: 30.8481
• Rougelsum: 32.9638

📄 License

This model is licensed under the Apache 2.0 license.

📚 Documentation

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e - 05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Framework versions

• Transformers 4.14.0
• Pytorch 1.5.0
• Datasets 2.3.2
• Tokenizers 0.10.3

📦 Model Information

📈 Model Index

• name: t5 - small - finetuned - cnn - v2 results:
  • task: name: Sequence - to - sequence Language Modeling type: text2text - generation dataset: name: cnn_dailymail type: cnn_dailymail args: 3.0.0 metrics:
    • name: Rouge1 type: rouge value: 35.154