Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL

The paper proposes Adaptive Reward Routing to address fixed routing and reward weight limitations in reinforcement learning for joint audio-video diffusion models. The method consists of cross-modal influence-guided routing for localizing updates via attention responses and preference-preserving modality-aware reweighting for coordinating rewards as residual corrections. Experiments demonstrate consistent improvements in modality quality, semantic consistency, and audio-video synchronization over strong baselines.

Extensive experiments demonstrate consistent improvements in modality quality, semantic consistency, and audio-video synchronization over strong RL baselines.