Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence
- View PDF HTML (experimental) Abstract:Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users.
- Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI.
- Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI.
Unverified
- View PDF HTML (experimental) Abstract:Both the general public and academic communities have raised concerns about sycophancy, the phenomenon of artificial intelligence (AI) excessively agreeing with or flattering users.
- Yet, beyond isolated media reports of severe consequences, like reinforcing delusions, little is known about the extent of sycophancy or how it affects people who use AI.
- Here we show the pervasiveness and harmful impacts of sycophancy when people seek advice from AI.
Sources: Arxiv