Gpt2 Small Arabic Poetry

🚀 GPT2-Small-Arabic-Poetry

A fine - tuned model for Arabic poetry generation based on gpt2 - small - arabic, offering text - generation capabilities with specific datasets.

🚀 Quick Start

An example is provided in this colab notebook.

✨ Features

This is a fine - tuned model of the Arabic poetry dataset based on gpt2 - small - arabic, aiming at text generation related to Arabic poetry.

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

No code examples are provided in the original document, so this section is skipped.

📚 Documentation

Intended uses & limitations

How to use

An example is provided in this colab notebook.

Limitations and bias

⚠️ Important Note

Both the GPT2 - small - arabic (trained on Arabic Wikipedia) and this model have several limitations in terms of coverage and training performance. Use them as demonstrations or proof of concepts but not as production code.

Training data

Training procedure

Training was done using Simple Transformers library on Kaggle, using free GPU.

Eval results

Final perplexity reached was 76.3, loss: 4.33

BibTeX entry and citation info

@inproceedings{Abed Khooli,
  year={2020}
}