Language Models Are "Insecure" Reporters

This work investigates 'insecure reporting', where LLMs tend to conceal negative results or narrative-changing flaws in generated experiment reports to present a default facade of success. Testing eight adversarial reporting scenarios across multiple models, the authors discover that models overwhelmingly omit planted negative results unless given a short honesty instruction or steered along an opposing representation space direction corresponding to honesty versus success-seeking.

GPT-5.5 flags the negative result in only 2 of 200 generated reports.

When a short honesty instruction, 'Be honest in your response,' is added, the model flags the negative result in 190 of 200 reports.