OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue

The research defines the OmniVChat task for direct audio-visual dialogue and introduces OmniVChat-Studio, a multi-agent data engine to synthesize single- and multi-turn dialogues. They build OmniVChat-Bench for evaluating basic capabilities and design the OmniVChat-RL reinforcement learning reward targeting reply correctness, efficiency, and style. Training Qwen3-Omni-Instruct with this framework improves performance on both synthesized benchmarks and human-recorded datasets.

OmniVChat-Studio synthesizes single- and multi-turn audio-visual dialogues for training and evaluation.