Electra Large Synqa

🚀 mbartolo/electra-large-synqa

An ELECTRA-Large based question answering model trained on synthetic and real-world data.

🚀 Quick Start

This is an ELECTRA-Large QA Model trained from https://huggingface.co/google/electra-large-discriminator in two stages. First, it is trained on synthetic adversarial data generated using a BART-Large question generator, and then it is trained on SQuAD and AdversarialQA (https://arxiv.org/abs/2002.00293) in a second stage of fine-tuning.

✨ Features

• Question Answering: Specialized for answering questions based on the input context.
• Two-Stage Training: Trained on synthetic adversarial data first and then fine - tuned on real - world datasets.

📦 Installation

No installation steps are provided in the original document.

📚 Documentation

Data

Training Process

Approx. 1 training epoch on the synthetic data and 2 training epochs on the manually - curated data.

Additional Information

Please refer to https://arxiv.org/abs/2104.08678 for full details. You can interact with the model on Dynabench here: https://dynabench.org/models/109

Model Index

📄 License

This model is licensed under the Apache - 2.0 license.