bart-base-finetuned-pubmed Open-source Model - Freely Used for Medical Literature Abstract Generation Tasks

Bart Base Finetuned Pubmed

Developed by Kevincp560

This model is a fine-tuned version of facebook/bart-base on the pub_med_summarization_dataset, primarily designed for medical literature summarization tasks.

Text Generation

Transformers

Open Source License:Apache-2.0 #Medical Text Summarization #BART Fine-tuning #PubMed Specialized

Downloads 141

Release Time : 3/2/2022

Model Overview

A sequence-to-sequence model based on the BART architecture, specifically fine-tuned for PubMed medical literature summarization tasks, capable of generating concise summaries from medical research documents.

Model Features

Medical Domain Optimization

Specially fine-tuned on PubMed medical literature data, outperforming general models in medical text summarization tasks.

Fixed-Length Output

Generates summaries with a fixed length of 20 tokens, suitable for standardized summary output requirements.

Efficient Training

Utilizes mixed-precision training and linear learning rate scheduling, achieving optimization within 5 epochs.

Model Capabilities

Medical text summarization generation

Sequence-to-sequence transformation

English text processing

Use Cases

Medical Research

Automatic Medical Literature Summarization

Generates concise summaries for medical research papers on PubMed

Achieved a Rouge1 score of 9.3963 on the test set

Rapid Research Browsing

Assists researchers in quickly understanding the core content of papers

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
2.3706	1.0	4000	2.1245	9.1644	3.8264	8.2223	8.718	20.0
2.2246	2.0	8000	2.0811	9.023	3.7716	8.1453	8.5998	20.0
2.1034	3.0	12000	2.0469	9.4412	4.0783	8.4949	8.9977	20.0
2.0137	4.0	16000	2.0390	9.2261	3.9307	8.3154	8.7937	20.0
1.9288	5.0	20000	2.0277	9.3963	4.0473	8.4526	8.9659	20.0

Property	Details
Model Type	Fine - tuned version of facebook/bart - base on pub_med_summarization_dataset
Training Data	pub_med_summarization_dataset
Metrics	Rouge

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Bart Base Finetuned Pubmed

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 bart-base-finetuned-pubmed

🚀 Quick Start

📚 Documentation

Model description

Intended uses & limitations

Training and evaluation data

🔧 Technical Details

Training procedure

Training hyperparameters

Training results

Framework versions

📄 License