%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Long T5 Tglobal Large Pubmed 3k Booksum 16384 WIP15
A large-scale summarization model based on the Long-T5 architecture, specifically optimized for book and long document summarization tasks
Downloads 17
Release Time : 9/20/2022
Model Overview
This model is a variant based on the Long-T5 architecture, specifically designed for summarization tasks involving long documents and books. It is trained on the pubmed and booksum datasets and can handle input texts up to 16,384 tokens in length.
Model Features
Long Text Processing Capability
Supports processing input texts up to 16,384 tokens, making it suitable for book and long document summarization
Domain-Specific Optimization
Specifically trained on the pubmed medical literature and booksum book summarization datasets
Multi-Dataset Performance
Evaluated on multiple summarization datasets, including samsum, booksum, and gov_report
Model Capabilities
Long text summarization generation
Book content summarization
Technical document summarization
Government report summarization
Use Cases
Academic Research
Medical Literature Summarization
Generates concise summaries for medical literature such as pubmed
ROUGE-1 score 35.33 (booksum dataset)
Publishing Industry
Book Content Summarization
Generates chapter or full-book summaries for lengthy books
Average generation length 268 tokens (booksum dataset)
Government Document Processing
Government Report Summarization
Processes lengthy government reports and generates key-point summaries
ROUGE-1 score 37.04 (gov_report dataset)
Featured Recommended AI Models
Š 2025AIbase