Wav2vec2 Ser English Finetuned

🚀 Wav2Vec2 Speech Emotion Recognition for English

This model is fine - tuned for English speech emotion recognition using the Wav2Vec2 architecture. It can accurately detect six basic emotions in English speech, offering high - performance results.

✨ Features

• Emotion Recognition: Capable of detecting six emotions including sadness, anger, disgust, fear, happiness, and neutral.
• High Performance: Achieves an accuracy of 92.42% with a loss of 0.219.

🧠 Model Overview

🔹 Model name: dihuzz/wav2vec2-ser-english-finetuned
✨ This model uses the Wav2Vec2 architecture and is fine - tuned to recognize emotions in English speech. The emotions it can detect are:

• 😢 Sadness
• 😠 Anger
• 🤢 Disgust
• 😨 Fear
• 😊 Happiness
• 😐 Neutral

🔧 It was created by fine - tuning r - f/wav2vec-english-speech-emotion-recognition on multiple well - known Speech Emotion Recognition datasets with English emotional speech samples.

📊 Performance Metrics:

• 🎯 Accuracy: 92.42%
• 📉 Loss: 0.219

🏋️ Training Procedure

⚙️ Training Details

📜 Training Results

📦 Installation

pip install transformers torch torchaudio

💻 Usage Examples

Basic Usage

import torch
from transformers import Wav2Vec2ForSequenceClassification, Wav2Vec2FeatureExtractor
import torchaudio  

# Set device
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
print("Using device:", device)

# Load the fine-tuned model and feature extractor
model_name = "dihuzz/wav2vec2-ser-english-finetuned"
model = Wav2Vec2ForSequenceClassification.from_pretrained(model_name).to(device)
feature_extractor = Wav2Vec2FeatureExtractor.from_pretrained(model_name)

# Set the model to evaluation mode
model.eval()

# Load and preprocess the audio file
def predict_emotion(audio_path):
    # Load audio
    waveform, sample_rate = torchaudio.load(audio_path) 
    # Alternatively, librosa can also be used to load the audio file

    # Resample if necessary
    if sample_rate != 16000:
        resampler = torchaudio.transforms.Resample(orig_freq=sample_rate, new_freq=16000)
        waveform = resampler(waveform)

    # Convert to mono if stereo
    if waveform.shape[0] > 1:
        waveform = torch.mean(waveform, dim=0, keepdim=True)

    # Extract features and move them to device
    inputs = feature_extractor(
        waveform.squeeze().numpy(),
        sampling_rate=16000,
        return_tensors="pt",
        padding=True
    )
    inputs = {k: v.to(device) for k, v in inputs.items()}

    # Perform inference (here we are using a batch size of 1 but you can increase batch size for faster inference)
    with torch.no_grad():
        outputs = model(**inputs)
        logits = outputs.logits
        predicted_class_id = torch.argmax(logits, dim=-1).item()

    # Map predicted class ID to emotion label
    label = model.config.id2label[predicted_class_id]
    return label

# Example usage
audio_file = "/path/to/your/audio.wav"
predicted_emotion = predict_emotion(audio_file)
print(f"Predicted Emotion: {predicted_emotion}")

📝 Example Output

The model returns a string representing the predicted emotion:

Predicted Emotion: <emotion_label>

🔧 Technical Details

This model is based on the Wav2Vec2 architecture and is fine - tuned on specific English speech emotion recognition datasets. The fine - tuning process involves adjusting the model's parameters to better fit the task of emotion recognition in English speech.

📄 License

No license information is provided in the original document.

⚠️ Important Note

This model has several important limitations:

• 🌐 Language Specificity: English - only support
• 🗣️ Dialect Sensitivity: Variable performance across accents
• 🎧 Audio Quality Needs: Requires clean, clear recordings
• ⚖️ Potential Biases: May reflect cultural biases in training data
• 6️⃣ Limited Categories: Only detects 6 basic emotions
• 🧠 Context Unaware: Doesn't consider speech content meaning