WSJ:
AI is trained in part on what people like, and people prefer the brown-nosing, says Myra Cheng, a computer-science Ph.D. candidate at Stanford University and lead author of a March study on agreeable AI. Participants rated sycophantic AI responses significantly higher in quality and, after interacting with a more obsequious model, said they were more likely to return to the AI.
This bodes ill.