đ LexLM_Longformer_BART_fixed_V1
This is a fine - tuned BART model designed for long, legal document summarization, using a multi - step approach for better results.
đ Quick Start
This model is a specialized tool for summarizing long legal documents. To use it effectively, it's recommended to first compress the source text using an extractive summarization tool, and then feed the extractive summary into this model.
⨠Features
- Multi - step Summarization: Combines extractive and abstractive summarization for long legal documents.
- Fine - tuned BART: Based on the BART model, fine - tuned for specific legal datasets.
- Multiple Evaluation Metrics: Evaluated using ROUGE, BERTScore, BARTScore, and BLANC.
đĻ Installation
To use this model, you need to install the necessary libraries. Here is an example of installing the bert - extractive - summarizer
library:
pip install bert-extractive-summarizer
đģ Usage Examples
Basic Usage
pip install bert-extractive-summarizer
from summarizer import Summarizer
from transformers import pipeline
extractive_model = Summarizer()
text = 'Original document text to be summarized'
extractive_summary = extractive_model(text)
abstractive_model = pipeline('summarization', model = 'MikaSie/LexLM_Longformer_BART_fixed_V1', tokenizer = 'MikaSie/LexLM_Longformer_BART_fixed_V1')
result = abstractive_model(extractive_summary)
đ Documentation
Model Details
Model Description
This model is a fine - tuned version of BART. The research involves a multi - step summarization approach to long, legal documents. Many decisions in the renewables energy space are heavily dependent on regulations. But these regulations are often long and complicated. The proposed architecture first uses one or more extractive summarization steps to compress the source text, before the final summary is created by the abstractive summarization model. This fine - tuned abstractive model has been trained on a dataset, pre - processed through extractive summarization by LexLM_Longformer with fixed ratio. The research has used multiple extractive - abstractive model combinations, which can be found on https://huggingface.co/MikaSie. To obtain optimal results, feed the model an extractive summary as input as it was designed this way!
The dataset used by this model is the [EUR - lex - sum](https://huggingface.co/datasets/dennlinger/eur - lex - sum) dataset. The evaluation metrics can be found in the metadata of this model card.
This paper was introduced by the master thesis of Mika Sie at the University Utrecht in collaboration with Power2x. More information can be found in PAPER_LINK.
- Developed by: Mika Sie
- Funded by: University Utrecht & Power2X
- Language (NLP): English
- Finetuned from model: BART
Model Sources
- Repository: https://github.com/MikaSie/Thesis
- Paper: PAPER_LINK
- Streamlit demo: STREAMLIT_LINK
Uses
Direct Use
This model can be directly used for summarizing long, legal documents. However, it is recommended to first use an extractive summarization tool, such as LexLM_Longformer, to compress the source text before feeding it to this model. This model has been specifically designed to work with extractive summaries.
Out - of - Scope Use
Using this model without an extractive summarization step may not yield optimal results. It is recommended to follow the proposed multi - step summarization approach outlined in the model description for best performance.
Bias, Risks, and Limitations
Bias
As with any language model, this model may inherit biases present in the training data. It is important to be aware of potential biases in the source text and to critically evaluate the generated summaries.
Risks
- The model may not always generate accurate or comprehensive summaries, especially for complex legal documents.
- The model may not generate truthful information.
Limitations
- The model may produce summaries that are overly abstractive or fail to capture important details.
- The model's performance may vary depending on the quality and relevance of the extractive summaries used as input.
Recommendations
- Carefully review and validate the generated summaries before relying on them for critical tasks.
- Consider using the model in conjunction with human review or other validation mechanisms to ensure the accuracy and completeness of the summaries.
- Experiment with different extractive summarization models or techniques to find the most suitable input for the abstractive model.
- Provide feedback and contribute to the ongoing research and development of the model to help improve its performance and address its limitations.
- Any actions taken based on this content are at your own risk.
đ License
No license information provided in the original document.
đ Model Information
Property |
Details |
Model Type |
Fine - tuned BART |
Training Data |
[EUR - lex - sum](https://huggingface.co/datasets/dennlinger/eur - lex - sum) |
Evaluation Metrics |
ROUGE - 1: 0.42498553772738057 ROUGE - 2: 0.15839425914885624 ROUGE - L: 0.20413437189383524 BERTScore: 0.8658945946720059 BARTScore: - 3.6140887003040127 BLANC: 0.09585484599908967 |