lyrics - generator: An open - source lyric generation model - Freely create lyric texts based on input

Home

Lyrics Generator

Developed by ECE1786-AG

A GPT-2 fine-tuned lyric generation model capable of generating lyric text based on input

Text Generation

Transformers

Open Source License:MIT #Lyric Writing #GPT-2 Fine-tuning #Text Generation

Downloads 166

Release Time : 12/5/2022

Model Overview

This model is a GPT-2 architecture fine-tuned lyric generator, primarily used for creating and generating lyric content. During training, the model demonstrated a stable downward trend in loss, ultimately achieving a validation loss of 2.1114.

Model Features

Lyric Writing

Optimized specifically for lyric generation tasks, capable of creating lyrics that match musical styles

GPT-2 Foundation

Based on the powerful GPT-2 language model architecture, with excellent text generation capabilities

Stable Training

Training process showed stable decrease in loss values, indicating effective learning of lyric features

Model Capabilities

Text Generation

Lyric Writing

Style Imitation

Use Cases

Music Composition

Lyric Assistance

Provides inspiration and material for musicians in lyric creation

Can generate lyric fragments in various styles

Educational Applications

Used for teaching lyric writing in music education

Training Loss	Epoch	Step	Validation Loss
3.4325	0.36	200	2.3267
2.4121	0.71	400	2.2693
2.3582	1.07	600	2.2401
2.2903	1.42	800	2.2182
2.2738	1.78	1000	2.2046
2.2322	2.14	1200	2.1922
2.1933	2.49	1400	2.1832
2.1944	2.85	1600	2.1736
2.1632	3.2	1800	2.1648
2.1366	3.56	2000	2.1554
2.1492	3.91	2200	2.1491
2.1108	4.27	2400	2.1472
2.0882	4.63	2600	2.1422
2.0971	4.98	2800	2.1343
2.0829	5.34	3000	2.1318
2.042	5.69	3200	2.1280
2.0375	6.05	3400	2.1261
2.0146	6.41	3600	2.1245
2.0551	6.76	3800	2.1217
1.992	7.12	4000	2.1182
1.9994	7.47	4200	2.1170
2.0189	7.83	4400	2.1156
1.9795	8.19	4600	2.1133
2.0101	8.54	4800	2.1143
1.9864	8.9	5000	2.1111
1.9602	9.25	5200	2.1120
1.9899	9.61	5400	2.1117
1.9928	9.96	5600	2.1114

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Lyrics Generator

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 lyrics-generator-v2

🚀 Quick Start

📚 Documentation

Model description

Intended uses & limitations

Training and evaluation data

🔧 Technical Details

Training procedure

Training hyperparameters

Training results

Framework versions

📄 License