World Observer: Joint Actor-Observer Generation for Persistent World Modeling

The paper introduces World Observer, a method that decouples observing from acting to address the limitation where video world models lose track of objects leaving an agent's view. The system jointly generates a perspective actor view for agent-centric tasks alongside one or more panoramic observers monitoring selected world regions. By warping from a shared panoramic source for geometric correspondence and using an Observer Sink to restore high-resolution references upon re-entry, World Observer allows out-of-view objects to continue evolving visually, improving dynamics while remaining competitive in visual fidelity and camera control.

World Observer decouples observing from acting by jointly generating a perspective actor view with panoramic observers.

The method uses an Observer Sink of high-resolution perspective references to restore fine appearance upon re-entry.

World Observer substantially improves out-of-view dynamics while remaining competitive in visual fidelity and camera control.