Wav2vec2 Xls R Adult Child Id Cls

🚀 Wav2Vec2 XLS-R Adult/Child Indonesian Speech Classifier

An audio classification model based on the XLS-R architecture for classifying adult and child Indonesian speech.

This model is an audio classification model based on the XLS-R architecture. It is a fine - tuned version of wav2vec2 - xls - r - 300m on a private adult/child Indonesian speech classification dataset. It was trained using HuggingFace's PyTorch framework on a Tesla P100 provided by Kaggle, and training metrics were logged via Tensorboard.

✨ Features

• Based on the advanced XLS - R architecture for effective audio classification.
• Fine - tuned on a private Indonesian speech dataset for adult/child classification.
• Trained using HuggingFace's PyTorch framework with detailed training metrics logged.

📦 Model Details

📊 Evaluation Results

The model achieves the following results on evaluation:

🔧 Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e - 05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 32
• optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 4

Training results

⚠️ Disclaimer

Do consider the biases which came from pre - training datasets that may be carried over into the results of this model.

👥 Authors

Wav2Vec2 XLS - R Adult/Child Indonesian Speech Classifier was trained and evaluated by Ananto Joyoadikusumo. All computation and development are done on Kaggle.

🛠️ Framework versions

• Transformers 4.18.0
• Pytorch 1.11.0+cu102
• Datasets 2.2.0
• Tokenizers 0.12.1

📄 License

This project is licensed under the Apache - 2.0 license.