JEPA-Anything: Learning Predictive Models across Different Worlds

The authors introduce JEPA-Anything, a domain-agnostic framework using orthogonal predictive factorization (OPF) to extend joint-embedding predictive architectures by decomposing latent targets into complementary factors learned through dedicated pathways. Evaluated across seven domains including vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather, JEPA-Anything improves reported metrics across 10 dynamics tasks and reduces single-intervention prediction error on Interventional Pong by 34.8%. It also achieves the lowest one-step and 100-step molecular errors among compared methods in all four systems.

JEPA-Anything improves reported metrics on all 10 dynamics tasks against matched JEPA baselines.

Reduces single-intervention prediction error on Interventional Pong by 34.8%.

Latent orbital modes recover the Keplerian scaling exponent with a fitted slope of -1.4991.