Bodo Bart Large Summ

🚀 Bodo-BART-Large-Summ

A fine-tuned model based on facebook/bart-large for legal text summarization in the Bodo language.

🚀 Quick Start

This model, bodo-bart-large-summ, is a fine - tuned version of facebook/bart-large on the Mwnthai/bodo-legal-summary-data dataset. It achieves the following results on the evaluation set:

• Loss: 4.1477
• Rouge1: 21.2656
• Rouge2: 7.0402
• Rougel: 19.1943
• Rougelsum: 19.6362
• Gen Len: 128.0

✨ Features

• Fine - tuned on a specific legal summary dataset for better performance in Bodo language legal text summarization.
• Evaluated with Rouge metrics to ensure summarization quality.

📦 Installation

No specific installation steps are provided in the original document.

📚 Documentation

Model Information

Training Hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e - 05
• train_batch_size: 2
• eval_batch_size: 2
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon = 1e - 08 and optimizer_args = No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 3.0

Framework Versions

• Transformers 4.48.3
• Pytorch 2.0.1+cu117
• Datasets 3.2.0
• Tokenizers 0.21.0

📄 License

This project is licensed under the Apache - 2.0 license.