WHISPER SMALL SWAHILI ASR CV 14

🚀 Whisper small - Denis Musinguzi

This model is a fine - tuned version of openai/whisper-large on the Common Voice 14.0 dataset. It offers high - quality automatic speech recognition capabilities, achieving impressive results on the evaluation set.

📚 Documentation

Model Information

Evaluation Results

This model achieves the following results on the evaluation set:

• Loss: 0.4428
• Wer: 0.2513
• Cer: 0.0983

Model Index

• Name: Whisper small - Denis Musinguzi
  • Results:
    • Task:
      • Name: Automatic Speech Recognition
      • Type: automatic - speech - recognition
    • Dataset:
      • Name: Common Voice 14.0
      • Type: mozilla - foundation/common_voice_14_0
      • Config: sw
      • Split: None
      • Args: 'config: sw, split: test'
    • Metrics:
      • Name: Wer
      • Type: wer
      • Value: 0.25130933149495305

🔧 Technical Details

Training Hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e - 05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon = 1e - 08
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• training_steps: 10000
• mixed_precision_training: Native AMP

Training Results

Framework Versions

• Transformers 4.38.1
• Pytorch 2.2.1
• Datasets 2.17.0
• Tokenizers 0.15.2

📄 License

This model is licensed under the Apache - 2.0 license.