Mmduet

🚀 MMDuet

MMDuet is a VideoLLM that enables real - time interaction while the video is playing, offering a new way to understand and engage with online videos.

🚀 Quick Start

This section provides the model checkpoint of MMDuet, a VideoLLM allowing real - time interaction during video playback.

📚 Documentation

Model Details

Related Resources

• Paper: VideoLLM Knows When to Speak: Enhancing Time - Sensitive Video Comprehension with Video - Text Duet Interaction Format
• Github: [MMDuet](https://github.com/yellow - binary - tree/MMDuet)
• Video Demo: On Youtube and On Bilibili
• Data: MMDuetIT

📄 License

This project is licensed under the MIT license.

📚 Citation

If you use this work in your research, please consider citing:

@misc{wang2024mmduet,
      title={VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format}, 
      author={Yueqian Wang and Xiaojun Meng and Yuxuan Wang and Jianxin Liang and Jiansheng Wei and Huishuai Zhang and Dongyan Zhao},
      year={2024},
      eprint={2411.17991},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2411.17991}, 
}