The Past Frames the Future: Memory for Autoregressive Video Generation

This paper presents a systematic and comprehensive review of memory mechanisms in autoregressive (AR) video generation. As generated sequences expand, models face strict constraints on context windows, storage, and compute, causing critical historical information to leave the active context. The authors formulate memory operationally as persistent historical information maintained across outer AR steps to influence future generation. The literature is organized through five complementary perspectives: Forms, Functions, Operations, Learning, and Evaluation, establishing a structured foundation for building reliable memory-conditioned video generation systems.