Roberta Base Bne Finetuned Amazon Reviews Multi

🚀 roberta-base-bne-finetuned-amazon_reviews_multi

This model is a fine - tuned version of [BSC - TeMU/roberta - base - bne](https://huggingface.co/BSC - TeMU/roberta - base - bne) on the amazon_reviews_multi dataset, achieving high accuracy in text classification tasks.

🚀 Quick Start

This model is a fine - tuned version of [BSC - TeMU/roberta - base - bne](https://huggingface.co/BSC - TeMU/roberta - base - bne) on the amazon_reviews_multi dataset. It achieves the following results on the evaluation set:

• Loss: 0.2306
• Accuracy: 0.9307

📚 Documentation

Model Information

Model Index

• Name: roberta - base - bne - finetuned - amazon_reviews_multi
• Results:
  • Task:
    • Name: Text Classification
    • Type: text - classification
  • Dataset:
    • Name: amazon_reviews_multi
    • Type: amazon_reviews_multi
    • Args: es
  • Metric:
    • Name: Accuracy
    • Type: accuracy
    • Value: 0.93075

Training Procedure

Training Hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e - 05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9, 0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• num_epochs: 2

Training Results

Framework Versions

• Transformers 4.9.2
• Pytorch 1.9.0+cu102
• Datasets 1.11.0
• Tokenizers 0.10.3

📄 License

This model is licensed under CC - BY - 4.0.