Whisper Large V3 Turbo German

🚀 Whisper Large v3 Turbo German Model

This model is based on Whisper Large v3 and fine - tuned for German speech recognition. It leverages the powerful Whisper platform developed by OpenAI and is optimized for German language processing.

🚀 Quick Start

You can use the following Python code to utilize the model for automatic speech recognition:

import torch
from transformers import AutoModelForSpeechSeq2Seq, AutoProcessor, pipeline
from datasets import load_dataset
device = "cuda:0" if torch.cuda.is_available() else "cpu"
torch_dtype = torch.float16 if torch.cuda.is_available() else torch.float32
model_id = "primeline/whisper-large-v3-turbo-german"
model = AutoModelForSpeechSeq2Seq.from_pretrained(
    model_id, torch_dtype=torch_dtype, low_cpu_mem_usage=True, use_safetensors=True
)
model.to(device)
processor = AutoProcessor.from_pretrained(model_id)
pipe = pipeline(
    "automatic-speech-recognition",
    model=model,
    tokenizer=processor.tokenizer,
    feature_extractor=processor.feature_extractor,
    max_new_tokens=128,
    chunk_length_s=30,
    batch_size=16,
    return_timestamps=True,
    torch_dtype=torch_dtype,
    device=device,
)
dataset = load_dataset("distil-whisper/librispeech_long", "clean", split="validation")
sample = dataset[0]["audio"]
result = pipe(sample)
print(result["text"])

✨ Features

• Diverse Applications: This model can be applied in multiple areas, such as transcribing spoken German, voice commands and control, automatic subtitling for German videos, German voice - based search queries, and dictation functions in word processing programs.
• Optimized for German: It has been specifically optimized for processing and recognizing German speech.

📦 Installation

The provided code uses the transformers, torch, and datasets libraries. You can install them using the following commands:

pip install transformers torch datasets

📚 Documentation

Summary

This model map provides information about a model based on Whisper Large v3 that has been fine - tuned for speech recognition in German. Whisper is a powerful speech recognition platform developed by OpenAI. This model has been specially optimized for processing and recognizing German speech.

Applications

This model can be used in various application areas, including:

• Transcription of spoken German language
• Voice commands and voice control
• Automatic subtitling for German videos
• Voice - based search queries in German
• Dictation functions in word processing programs

Model family

Evaluations - Word error rate

The data and code for evaluations are available here

Training data

The training data for this model includes a large amount of spoken German from various sources. The data was carefully selected and processed to optimize recognition performance.

Training process

The training of the model was performed with the following hyperparameters:

• Batch size: 12288
• Epochs: 3
• Learning rate: 1e - 6
• Data augmentation: No
• Optimizer: Ademamix

📄 License

This model is published under the Apache 2.0 license.

🔧 Technical Details

Model Index

• Name: whisper - large - v3 - turbo - german by Florian Zimmermeister @primeLine
• Results:
  • Task:
    • Type: automatic - speech - recognition
    • Name: Speech Recognition
  • Dataset:
    • Name: German ASR Data - Mix
    • Type: flozi00/asr - german - mixed
  • Metrics:
    • Type: wer
    • Value: 2.628 %
    • Name: Test WER

Datasets

• flozi00/asr - german - mixed
• flozi00/asr - german - mixed - evals

Base model

• primeline/whisper - large - v3 - german

About us

Your partner for AI infrastructure in Germany. Experience the powerful AI infrastructure that drives your ambitions in Deep Learning, Machine Learning & High - Performance Computing. Optimized for AI training and inference.

Model author: Florian Zimmermeister

Disclaimer

This model is not a product of the primeLine Group. 

It represents research conducted by [Florian Zimmermeister](https://huggingface.co/flozi00), with computing power sponsored by primeLine. 

The model is published under this account by primeLine, but it is not a commercial product of primeLine Solutions GmbH.

Please be aware that while we have tested and developed this model to the best of our abilities, errors may still occur. 

Use of this model is at your own risk. We do not accept liability for any incorrect outputs generated by this model.