CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents

This work introduces CERA-MoA (Co-Evolving Router with continually learning Agents for Mixture-of-Agents), an iterative reinforcement learning framework designed to co-evolve query routing and independent agent policies. It employs a predictive familiarity estimator leveraging mid-layer hidden states to evaluate semantic competence among agents without full rollout overhead. Using these familiarity scores, a cumulative-threshold adaptive routing mechanism dynamically activates a tailored minimal agent subset to balance performance and efficiency, while proactively allocating targeted training samples to foster agent capability differentiation.