DistilBART-XSum-6-6 Open-Source Text Summarization Model - Free to Use, Efficiently Reduce Text Content

Distilbart Xsum 6 6

Developed by sshleifer

DistilBART is a distilled version of the BART model, focusing on text summarization tasks, significantly reducing model size and inference time while maintaining high performance.

Text Generation EnglishOpen Source License:Apache-2.0 #News Summarization #Lightweight Model #Efficient Inference

Downloads 147

Release Time : 3/2/2022

Model Overview

DistilBART is a lightweight text summarization model based on the BART architecture, compressed from the original model using knowledge distillation techniques, suitable for generating concise and accurate summaries.

Model Features

Efficient Inference

2.54x faster inference speed compared to the original BART model

Lightweight

Approximately 45% parameter reduction, from 406M to 222M

Balanced Performance

Achieves a good balance between model size and summarization quality (Rouge scores)

Model Capabilities

Text Summarization Generation

Long Text Compression

Key Information Extraction

Use Cases

News Summarization

News Article Summarization

Automatically compresses lengthy news articles into concise summaries

Achieves Rouge-L of 33.37 on CNN/DailyMail dataset

Content Summarization

Document Summarization

Generates executive summaries for long documents

Property	Details
Model Type	DistilBART for text summarization
Training Data	cnn_dailymail, xsum

Model Name	MM Params	Inference Time (MS)	Speedup	Rouge 2	Rouge-L
distilbart-xsum-12-1	222	90	2.54	18.31	33.37
distilbart-xsum-6-6	230	132	1.73	20.92	35.73
distilbart-xsum-12-3	255	106	2.16	21.37	36.39
distilbart-xsum-9-6	268	136	1.68	21.72	36.61
bart-large-xsum (baseline)	406	229	1	21.85	36.50
distilbart-xsum-12-6	306	137	1.68	22.12	36.99
bart-large-cnn (baseline)	406	381	1	21.06	30.63
distilbart-12-3-cnn	255	214	1.78	20.57	30.00
distilbart-12-6-cnn	306	307	1.24	21.26	30.59
distilbart-6-6-cnn	230	182	2.09	20.17	29.70

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Distilbart Xsum 6 6

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 DistilBART Model

🚀 Quick Start

💻 Usage Examples

Basic Usage

📚 Documentation

Metrics for DistilBART models

📄 License