araber_arabic_covid19 Open Source Model - Free to Process Arabic Text Tasks Related to the Pandemic

Arabert Arabic Covid19

Developed by mohadz

AraBERT model pre-trained on 1.5 million multi-dialect Arabic COVID-19 tweets, specialized for pandemic-related Arabic text tasks

Large Language Model

Transformers

Arabic#Arabic COVID-19 Tweet Analysis #Multi-dialect Arabic Processing #Pandemic Misinformation Detection

Downloads 85

Release Time : 3/2/2022

Model Overview

This model is a fine-tuned version of AraBERT v2, optimized for multi-dialect Arabic tweets related to the COVID-19 pandemic, excelling in tasks such as fake news detection and hate speech recognition

Model Features

Multi-dialect Support

Specifically trained for multi-dialect Arabic environments, effectively handling language variants from different regions

Pandemic Domain Optimization

Pre-trained on 1.5 million COVID-19-related tweets, demonstrating outstanding performance in pandemic-related text understanding

Superior Classification Performance

Significantly outperforms the base model in tasks such as misinformation detection and hate speech recognition

Model Capabilities

Arabic Text Classification

Hate Speech Detection

Misinformation Identification

Pandemic-related Text Analysis

Use Cases

Content Moderation

Hate Speech Detection

Identify hate speech content on social media

Accuracy 86.49% (better than base model's 83.46%)

Information Verification

Fake News Identification

Detect pandemic-related misinformation

Accuracy 77.39% (significantly better than base model's 64.15%)

Public Health

Treatment Method Discussion Analysis

Identify discussions about COVID-19 treatment methods

Accuracy 91.76% (better than base model's 81.93%)

🚀 arabert_c19: An Arabert model pretrained on 1.5 million COVID-19 multi-dialect Arabic tweets

This is a pretrained (fine - tuned) version of the AraBERT v2 model, trained on 1.5 million multi - dialect Arabic tweets about the COVID - 19 pandemic. It can achieve better results for tasks related to COVID - 19 multi - dialect Arabic tweets.

🚀 Quick Start

ARABERT COVID - 19 is a pretrained (fine - tuned) version of the AraBERT v2 model (https://huggingface.co/aubmindlab/bert - base - arabertv02). The pretraining was carried out using 1.5 million multi - dialect Arabic tweets regarding the COVID - 19 pandemic from the “Large Arabic Twitter Dataset on COVID - 19” (https://arxiv.org/abs/2004.04315). The model can achieve better results for the tasks that deal with multi - dialect Arabic tweets in relation to the COVID - 19 pandemic.

✨ Features

Classification results for multiple tasks

This includes fake - news and hate speech detection when using arabert_c19 and mbert_ar_c19. For more details, refer to the paper (link).

Property	arabert	mbert	distilbert multi	arabert Covid - 19	mbert Covid - 19
Contains hate (Binary)	0.8346	0.6675	0.7145	`0.8649`	0.8492
Talk about a cure (Binary)	0.8193	0.7406	0.7127	0.9055	`0.9176`
News or opinion (Binary)	0.8987	0.8332	0.8099	`0.9163`	0.9116
Contains fake information (Binary)	0.6415	0.5428	0.4743	`0.7739`	0.7228

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

from arabert.preprocess import ArabertPreprocessor
model_name="moha/arabert_c19"
arabert_prep = ArabertPreprocessor(model_name=model_name)
text = "للوقايه من عدم انتشار كورونا عليك اولا غسل اليدين بالماء والصابون وتكون عملية الغسل دقيقه تشمل راحة اليد الأصابع التركيز على الإبهام"
arabert_prep.preprocess(text)

Advanced Usage

No advanced usage examples are provided in the original document, so this part is not added.

📚 Documentation

No detailed documentation is provided in the original document, so this section is skipped.

🔧 Technical Details

No technical details are provided in the original document, so this section is skipped.

📄 License

No license information is provided in the original document, so this section is skipped.

👥 Contacts

Hadj Ameur: Github | mohamedhadjameur@gmail.com | mhadjameur@cerist.dz

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご