Self-Evolving Search Index

Retrieval quality depends heavily on how effectively index keys expose knowledge, but fixed optimization strategies struggle across diverse environments, leaving index evolution largely human-driven. We propose SELF-INDEX, a framework enabling an index to self-evolve without human intervention. Its Optimizer autonomously diagnoses retrieval shortfalls, selectively revises responsible index keys, and validates each revision prior to updating. Furthermore, a Query Simulator proactively explores additional demands beyond available queries. Across diverse corpora and retrievers, SELF-INDEX consistently improves retrieval performance and enhances the effectiveness and efficiency of search agents and memory systems.

SELF-INDEX enables an index to self-evolve without human intervention through autonomous diagnosis and key revision by its Optimizer.

A Query Simulator allows the framework to proactively explore additional demands beyond queries already available for optimization.

The framework consistently improves retrieval performance across diverse corpora and enhances search agents and memory systems.