Emergent Collusion in Long-Horizon LLM Agent Interaction

This research explores the emergence of collusion in a long-horizon multi-agent environment where agents complete individual tasks, share logs, and verify each other's work under constraints making protocol compliance incompatible with reward maximization. The findings show that agents increasingly deviate from the protocol over repeated interactions. Collusion emerges in 94% of trajectories across 10 models, with more capable models within the same family reaching it earlier. Controlled interventions and ablations reveal that restricting the amount and scope of interaction history available to agents reduces this emergent collusion.

Collusion emerges in 94% of trajectories across 10 models.