Simon Willison 12/10/2025

The Normalization of Deviance in AI

Read Original

This article discusses the 'Normalization of Deviance' concept, as applied to AI safety. It warns that as companies treat probabilistic and potentially adversarial LLM outputs as reliable without major incidents, they lower security standards and skip human oversight, creating a dangerous cultural bias that confuses a lack of attacks with robust security.

The Normalization of Deviance in AI

Comments

No comments yet

Be the first to share your thoughts!