AraBertMo_base_V10 Open-source Arabic Model - Free Support for Masked Language Modeling Task

Arabertmo Base V10

Developed by Ebtihal

AraBERTMo is an Arabic pre-trained language model based on Google's BERT architecture, supporting fill-mask tasks.

Large Language Model

Transformers

#Arabic Fill-Mask #BERT Architecture Optimization #OSCAR Pretraining

Downloads 39

Release Time : 3/4/2022

Model Overview

AraBERTMo is an Arabic pre-trained model based on the BERT architecture, primarily used for handling fill-mask tasks in Arabic text.

Model Features

Arabic Language Optimization

Specifically pre-trained and optimized for Arabic text

BERT Architecture

Adopts the same architecture and configuration as BERT-Base

Multi-Version Support

Offers 10 different variant models

Model Capabilities

Arabic Text Understanding

Fill-Mask Prediction

Use Cases

Text Processing

Arabic Text Completion

Automatically completes missing parts in Arabic text

Arabic Grammar Checking

Identifies and corrects grammatical errors in Arabic text

🚀 Arabic Model AraBertMo_base_V10

An Arabic pre - trained language model based on Google's BERT architecture, with 10 new variants available.

🚀 Quick Start

You can use this model by installing torch or tensorflow and Huggingface library transformers. And you can use it directly by initializing it like this:

from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("Ebtihal/AraBertMo_base_V10")
model = AutoModelForMaskedLM.from_pretrained("Ebtihal/AraBertMo_base_V10")

✨ Features

Based on BERT Architecture: AraBERTMo is an Arabic pre - trained language model based on Google's BERT architecture. AraBERTMo_base uses the same BERT - Base config.
Multiple Variants: AraBERTMo_base now comes in 10 new variants.
Available on HuggingFace: All models are available on the HuggingFace model page under the Ebtihal name. Checkpoints are available in PyTorch formats.

📦 Installation

Although not explicitly stated in a traditional installation - step way, you need to install torch or tensorflow and the Huggingface library transformers to use this model.

📚 Documentation

Model Information

Property	Details
Model Type	Arabic pre - trained language model based on Google's BERT architecture
Training Data	~3 million words from OSCAR - Arabic version "unshuffled_deduplicated_ar"