Finetuning Sentiment Model 3000 Samples

🚀 finetuning-sentiment-model-3000-samples

This model is a fine - tuned version of [distilbert - base - uncased](https://huggingface.co/distilbert - base - uncased) on the imdb dataset, achieving high accuracy and F1 scores in text classification.

🚀 Quick Start

This model is a fine - tuned version of [distilbert - base - uncased](https://huggingface.co/distilbert - base - uncased) on the imdb dataset. It achieves the following results on the evaluation set:

• Loss: 0.3404
• Accuracy: 0.8667
• F1: 0.8734

📚 Documentation

Model Information

Model Index

• Name: finetuning - sentiment - model - 3000 - samples
• Results:
  • Task:
    • Name: Text Classification
    • Type: text - classification
  • Dataset:
    • Name: imdb
    • Type: imdb
    • Args: plain_text
  • Metrics:
    • Name: Accuracy
    • Type: accuracy
    • Value: 0.8666666666666667
    • Name: F1
    • Type: f1
    • Value: 0.8734177215189873

Training Procedure

Training Hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e - 05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• num_epochs: 2

Framework Versions

• Transformers 4.15.0
• Pytorch 1.10.0+cu111
• Datasets 1.17.0
• Tokenizers 0.10.3

📄 License

This model is licensed under the Apache 2.0 license.