🚀 Soundwave: Less is More for Speech-Text Alignment in LLMs

Soundwave is a Speech-to-Text model that effectively bridges the gap between speech and text, achieving excellent performance with only 10k hours of training data.

🚀 Quick Start

Load the Soundwave model and run inference with your audio files as shown in the GitHub repository.

✨ Features

• A Speech-to-Text Model Bridging the Gap Between Speech and Text
• Utilizes Data-Efficient Strategy and Unique Architecture, Trained on Only 10k Hours of Data
• Exceptional Performance in Speech Translation and AIR-Bench Speech Tasks
• Retains Intelligence During Conversations, Ideal for Interactive Tasks

📚 Documentation

Model Description

Soundwave is a Speech-to-Text model that bridges the gap between speech and text. It is trained on just 10k hours of data and delivers exceptional performance in speech translation and AIR-Bench speech tasks.

📄 License

This project is licensed under the Apache-2.0 license.

📖 Citation

@article{zhang2025soundwave,
  title={Soundwave: Less is More for Speech-Text Alignment in LLMs},
  author={Zhang, Yuhao and Liu, Zhiheng and Bu, Fan and Zhang, Ruiyu and Wang, Benyou and Li, Haizhou},
  journal={arXiv preprint arXiv:2502.12900},
  year={2025}
}