Evaluating safety refusal rates on coding agent benchmarks

Artificial Analysis introduced safety refusal reporting in version 1.5 of its Coding Agent Index to help explain model behavioral differences. Data showed distinct variations in safety refusal rates among evaluated models during coding tasks.