Beyond the Timeline: Augmenting Long-Video Memory with Grounded Entity Biographies

This work introduces Grounded Entity Biographies (GEB), a long-video memory framework designed to overcome how text descriptions and chronological timelines leave physical identity unresolved across hours or days. GEB groups visually grounded observations of the same physical instance across clips into retrievable biographies while preserving the context of each moment. During question answering, the biography is retrieved alongside episodic evidence, enabling the model to follow an entity through events using identity links. Evaluations across four benchmarks demonstrate improvements over prior memory frameworks in both multiple-choice and open-ended question answering.

On EgoLifeQA, GEB achieves 72.0% accuracy, 4.4 percentage points above the best published result.

The framework groups visually grounded observations of the same physical instance across clips into retrievable biographies.

Ablations show that grounded identity association and biography reading both contribute to the gains.