Bart Large Scientific Lay Summarisation

🚀 bart-large-tomasg25/scientific_lay_summarisation

This model is designed for abstractive text summarization, trained with Amazon SageMaker and the new Hugging Face Deep - Learning container. It offers a practical solution for summarizing scientific texts, potentially reducing environmental footprints and providing health - related benefits through dietary pattern analysis.

🚀 Quick Start

This model was trained using Amazon SageMaker and the new Hugging Face Deep Learning container. For more information look at:

• 🤗 Transformers Documentation: Amazon SageMaker
• Example Notebooks
• Amazon SageMaker documentation for Hugging Face
• Python SDK SageMaker documentation for Hugging Face
• Deep Learning Container

✨ Features

• Trained with Advanced Tools: Utilizes Amazon SageMaker and Hugging Face Deep Learning container for training.
• Abstractive Summarization: Specialized in abstractive text summarization tasks.
• Multiple Metrics Evaluation: Evaluated using ROGUE - 1, ROGUE - 2, and ROGUE - L metrics on validation and test datasets.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

from transformers import pipeline
summarizer = pipeline("summarization", model="sambydlo/bart-large-tomasg25/scientific_lay_summarisation")
article = "Food production is a major driver of greenhouse gas (GHG) emissions, water and land use, and dietary risk factors are contributors to non-communicable diseases. Shifts in dietary patterns can therefore potentially provide benefits for both the environment and health. However, there is uncertainty about the magnitude of these impacts, and the dietary changes necessary to achieve them. We systematically review the evidence on changes in GHG emissions, land use, and water use, from shifting current dietary intakes to environ- mentally sustainable dietary patterns. We find 14 common sustainable dietary patterns across reviewed studies, with reductions as high as 70–80% of GHG emissions and land use, and 50% of water use (with medians of about 20–30% for these indicators across all studies) possible by adopting sustainable dietary patterns. Reductions in environmental footprints were generally proportional to the magnitude of animal-based food restriction. Dietary shifts also yielded modest benefits in all-cause mortality risk. Our review reveals that environmental and health benefits are possible by shifting current Western diets to a variety of more sustainable dietary patterns."
summarizer(article)

📚 Documentation

Hyperparameters

{
    "cache_dir": "opt/ml/input",
    "dataset_config_name": "plos",
    "dataset_name": "tomasg25/scientific_lay_summarisation",
    "do_eval": true,
    "do_predict": true,
    "do_train": true,
    "fp16": true,
    "learning_rate": 5e-05,
    "model_name_or_path": "facebook/bart-large",
    "num_train_epochs": 1,
    "output_dir": "/opt/ml/model",
    "per_device_eval_batch_size": 4,
    "per_device_train_batch_size": 4,
    "predict_with_generate": true,
    "seed": 7
}

Results

📄 License

This model is released under the Apache - 2.0 license.