← Back to AI News
AI News

Sycophantic AI tells users they're right 49% more than humans do, and a Stanford study claims it's making them worse people

•Fortune • 2 min read
Share
Sycophantic AI tells users they're right 49% more than humans do, and a Stanford study claims it's making them worse people news cover image

The study found flattering AI makes people less likely to take responsibility for their actions and more likely to think they are right.

AI models are affirming people’s worst behaviors even when other humans say they’re in the wrong, and users can’t get enough.

A new study out of the Stanford computer science department and published in the journal Science revealed that AI affirms users 49% more than a human does on average when it comes to social questions—a worrying trend especially as people increasingly turn to AI for personal advice and even therapy.

Of the 2,400 who participated in the study, mostly preferred being flattered. The number of test subjects more likely to use the sycophantic AI again was 13% higher compared to those who said they would return to the non-sycophantic chatbot, suggesting AI developers may have little incentive to change things up, according to the study.

While sycophantic chatbots have been previously shown to contribute to negative outcomes such as self-harm or violence in vulnerable populations, the Stanford study shows it may also be extending some effects to everyone else.

The study found subjects exposed to just one affirming response to their bad behavior were less willing to take responsibility for their actions and repair their interpersonal conflicts while also making them more likely to believe they were right.

To obtain this result, researchers conducted a three-part study in which they measured AI’s sycophancy based on a dataset of nearly 12,000 social prompts which they ran through 11 leading AI models including Anthropic’s Claude, Google’s Gemini, and OpenAI’s ChatGPT. Even when researchers asked the AI models to judge posts from the subreddit AITA (Am I The Asshole) in which Reddit users had said the poster was wrong, the large language models still said the poster was right 51% of the time.

Related Coverage

Related AI news

View all news