RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments

01 · agents

RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments

QuestionHow can digital agents autonomously explore and recursively self-improve in new environments without updating model parameters?

The authors introduce RSIAgent, a training-free multi-agent framework designed for recursive self-improvement through autonomous memory construction. RSIAgent coordinates curriculum, actor, and verifier agents to continually explore unknown environments, validate outcomes, and retain environment-specific knowledge like reusable causal relationships. It utilizes a broad-then-deep exploration strategy to discover diverse structures and uncover hard cases or hidden constraints. The resulting memory is frozen and directly reused for downstream tasks without altering model parameters. Experiments on OSWorld-v2 and Agent's Last Exam demonstrate that RSIAgent enables open-source models like Kimi-K3 and GLM-5.3 to outperform frontier closed-source models including GPT-6.

RSIAgent is a training-free multi-agent framework enabling recursive self-improvement through autonomous memory construction.

It employs a broad-then-deep exploration strategy combining parallel broad exploration and focused deep self-exploration.

Experiments on OSWorld-v2 and Agent's Last Exam show that Kimi-K3 and GLM-5.3 outperform frontier closed-source models including GPT-6.

Shichengf 78 upvotes 14 Sept 2026 read the original ↗