Multimodal AI

MOVA: Towards Scalable and Synchronized Video-Audio Generation

SSII-OpenMOSS TeamDDonghua YuMMingshu ChenQQi ChenQQi LuoQQianyi WuQQinyuan ChengRRuixiao LiTTianyi LiangWWenbo ZhangWWenming TuXXiangyu PengYYang GaoYYanru HuoYYing ZhuYYinze LuoYYiyang ZhangYYuerong SongZZhe XuZZhiyu ZhangCChenchen YangCCheng ChangCChushu ZhouHHanfu ChenHHongnan MaJJiaxi LiJJingqi TongJJunxi LiuKKe ChenSShimin LiSSonglin WangWWei JiangZZhaoye FeiZZhiyuan NingCChunguo LiCChenhui LiZZiwei HeZZengfeng HuangXXie ChenXXipeng Qiu
Published
February 9, 2026
Authors
40
Word Count
15,625
Code
Includes code

MOVA enables synchronized video-audio generation at scale through joint modeling instead of cascaded pipelines.

Abstract

Audio is indispensable for real-world video, yet generation models have largely overlooked audio components. Current approaches to producing audio-visual content often rely on cascaded pipelines, which increase cost, accumulate errors, and degrade overall quality. While systems such as Veo 3 and Sora 2 emphasize the value of simultaneous generation, joint multimodal modeling introduces unique challenges in architecture, data, and training. Moreover, the closed-source nature of existing systems limits progress in the field. In this work, we introduce MOVA (MOSS Video and Audio), an open-source model capable of generating high-quality, synchronized audio-visual content, including realistic lip-synced speech, environment-aware sound effects, and content-aligned music. MOVA employs a Mixture-of-Experts (MoE) architecture, with a total of 32B parameters, of which 18B are active during inference. It supports IT2VA (Image-Text to Video-Audio) generation task. By releasing the model weights and code, we aim to advance research and foster a vibrant community of creators. The released codebase features comprehensive support for efficient inference, LoRA fine-tuning, and prompt enhancement.

Key Takeaways

  • 1

    MOVA generates synchronized video and audio jointly rather than sequentially, solving cascading quality issues.

  • 2

    The team built a rigorous three-stage data pipeline that filtered 100k+ hours to 11k hours of high-quality content.

  • 3

    A dual-tower architecture with bridging mechanisms enables two specialized experts to collaborate on simultaneous generation.

Limitations

  • Previous cascaded approaches produced misaligned audio-video with lips moving out of sync and sound effects landing incorrectly.

  • Most open-source systems focused on either video or audio in isolation, lacking joint generation capabilities at scale.

Keywords

Mixture-of-ExpertsMoEaudio-visual contentlip-synced speechsound effectscontent-aligned musicIT2VAefficient inferenceLoRA fine-tuningprompt enhancement

More in Multimodal AI

View all
MOVA: Towards Scalable and Synchronized Video-Audio Generation | Paperchime