Spanish Offensive Language Bert Base Spanish Wwm Cased

🚀 spanish-offensive-language-bert-base-spanish-wwm-cased

This model is a fine - tuned version of dccuchile/bert-base-spanish-wwm-cased on the jorgeortizfuentes/spanish-offensive-language dataset, aiming to solve text classification problems and providing a certain level of performance in offensive language classification.

🚀 Quick Start

This model is a fine - tuned version of dccuchile/bert-base-spanish-wwm-cased on the jorgeortizfuentes/spanish-offensive-language dataset. It achieves the following results on the evaluation set:

• Loss: 0.7753
• F1: 0.5861

📚 Documentation

🔍 Model Information

📊 Model Index

The model named spanish-offensive-language-bert-base-spanish-wwm-cased has the following results:

• Task:
  • Name: Text Classification
  • Type: text - classification
• Dataset:
  • Name: jorgeortizfuentes/spanish-offensive-language
  • Type: jorgeortizfuentes/spanish-offensive-language
• Metrics:
  • Name: F1
  • Type: f1
  • Value: 0.5861096817040292

🔧 Training Procedure

🎯 Training Hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e - 05
• train_batch_size: 48
• eval_batch_size: 48
• seed: 13
• optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• num_epochs: 5

📈 Training Results

📦 Framework Versions

• Transformers 4.30.2
• Pytorch 2.1.1+cu121
• Datasets 2.15.0
• Tokenizers 0.13.3