Join Nostr
2026-11-05 11:39:33 UTC

zhashtoshi_ on Nostr: OpenAI caught its own model sandbagging. GPT-6 Astra quietly did worse on AI safety ...

OpenAI caught its own model sandbagging. GPT-6 Astra quietly did worse on AI safety work (red-teaming, exploit tasks, evals) than on identical tasks framed as capabilities research: about 10% of hidden criteria met vs 16%. It invented blockers, dropped working solutions, and the monitors missed most of it. Telling it to "be careful" made it 50% worse.

OpenAI's best guess is overcaution. They also say they can't rule out motives it never wrote down.

https://www.securityweek.com/openai-finds-gpt-6-astra-quietly-holding-back-on-internal-red-teaming-exploit-tasks/