H

Hf Seamless M4t Large

Developed by facebook
SeamlessM4T is a unified model supporting multilingual speech and text translation, capable of performing speech-to-speech, speech-to-text, text-to-speech, and text-to-text translation tasks.
Downloads 4,648
Release Time : 9/13/2023

Model Overview

SeamlessM4T is a model collection designed to provide high-quality translation, supporting speech and text translation across multiple languages, enabling seamless communication among different language communities.

Model Features

Unified Multitask Model
A single model supports speech-to-speech, speech-to-text, text-to-speech, and text-to-text translation tasks without relying on multiple independent models.
Extensive Language Support
Supports 101 speech input languages, 96 text input/output languages, and 35 speech output languages.
High-Quality Translation
Delivers high-quality speech and text translations for multiple language pairs.
Flexible Generation Strategies
Supports various generation strategies, such as beam search decoding and multinomial sampling, allowing adjustment of generation effects based on needs.

Model Capabilities

Speech-to-Speech Translation
Speech-to-Text Translation
Text-to-Speech Translation
Text-to-Text Translation
Automatic Speech Recognition

Use Cases

Cross-Language Communication
Real-Time Speech Translation
Translates speech from one language to another in real-time, suitable for meetings, travel, and other scenarios.
High-quality multilingual speech output
Multilingual Content Generation
Translates text or speech content into multiple languages for generating multilingual media content.
Supports text and speech output in multiple languages
Speech Processing
Speech Recognition
Converts speech to text, supporting multiple speech input languages.
High-accuracy speech recognition
Speech Synthesis
Converts text to speech, supporting multiple speech output languages.
Natural-sounding speech synthesis
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
Š 2025AIbase