Camembert Sentiment Allocine

🚀 camembert-sentiment-allocine

This model is a fine - tuned version of camembert - base, which can perform sentiment analysis on the allocine dataset.

🚀 Quick Start

This model is a fine - tuned version of [camembert - base](https://huggingface.co/camembert - base) on the allocine dataset.

✨ Features

Intended uses & limitations

This model has been trained for a single epoch for testing purposes.

🔧 Technical Details

Training procedure

This model has been created by fine - tuning the TensorFlow version [camembert - base](https://huggingface.co/camembert - base) after freezing the encoder part:

model.roberta.trainable = False

Therefore, only the classifier head parameters have been updated during training.

Training hyperparameters

The following hyperparameters were used during training:

- optimizer: {
     'name': 'Adam', 
     'learning_rate': {
         'class_name': 'PolynomialDecay', 
         'config': {'initial_learning_rate': 5e - 05, 'decay_steps': 15000, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}
      }, 
      'decay': 0.0, 
      'beta_1': 0.9, 
      'beta_2': 0.999, 
      'epsilon': 1e - 07, 
      'amsgrad': False
}
- training_precision: float32
- epochs: 1

Training results

The model achieves the following results on the test set:

Framework versions

• Transformers 4.22.2
• TensorFlow 2.8.2
• Datasets 2.5.2
• Tokenizers 0.12.1

📄 License

This project is under the MIT license.