mt5-small-finetuned-arxiv-cs Open-source Text Summarization Model - Free Generate Concise Summaries of Technical Content

Mt5 Small Finetuned Arxiv Cs Finetuned Arxiv Cs Full

Developed by shamikbose89

This model is a text summarization model fine-tuned on the arXiv computer science paper dataset based on mt5-small, excelling at generating concise summaries of technical content.

Text Generation

Transformers

Open Source License:Apache-2.0 #Academic Text Summarization #Computer Science Domain #Rouge Optimization

Downloads 16

Release Time : 3/2/2022

Model Overview

This is a small multilingual Transformer model based on the mT5 architecture, specifically fine-tuned for academic paper summarization tasks in the computer science domain.

Model Features

Academic Paper Optimization

Specifically optimized for arXiv papers in the computer science domain, effectively handling technical terms and complex concepts

Efficient Summarization

Generates concise summaries while retaining key information, achieving a ROUGE-1 score of 39.89

Lightweight Model

Based on the mT5-small architecture, maintaining good performance with a compact model size

Model Capabilities

Technical document summarization

Academic paper content condensation

Multilingual text processing

Use Cases

Academic Research

Rapid Paper Reading

Helps researchers quickly grasp the core content of computer science papers

ROUGE-1 score of 39.89 indicates effective capture of key information from the original text

Knowledge Management

Literature Database Summarization

Automatically generates standardized abstracts for academic literature databases

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
1.9675	1.0	500	1.5573	36.4989	18.4839	33.2984	33.2917
1.7523	2.0	1000	1.4972	37.7911	19.0357	33.5725	33.6058
1.6611	3.0	1500	1.4593	38.5822	19.4928	34.215	34.2531
1.6187	4.0	2000	1.4492	39.1219	20.8705	35.1969	35.2255
1.5864	5.0	2500	1.4289	39.7304	21.0654	35.6602	35.6667
1.5553	6.0	3000	1.4184	40.0696	21.0883	35.9536	35.9132
1.5215	7.0	3500	1.4163	39.1956	20.6757	35.5016	35.5196
1.5038	8.0	4000	1.4148	39.2373	20.3114	35.1676	35.1532
1.4929	9.0	4500	1.4064	39.9249	21.0155	35.8247	35.7937
1.4791	10.0	5000	1.4037	39.8923	20.9831	35.8642	35.8511

Property	Details
Model Type	Fine - tuned version of mt5 - small
Training Data	None dataset
Metrics	Rouge
Base Model	shamikbose89/mt5-small-finetuned-arxiv-cs

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Mt5 Small Finetuned Arxiv Cs Finetuned Arxiv Cs Full

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 mt5-small-finetuned-arxiv-cs-finetuned-arxiv-cs-full

🚀 Quick Start

📄 License

🔧 Technical Details

Training hyperparameters

Training results

Framework versions