By Jared Perlo
Publication Date: 2025-12-22 21:56:00
Weil, the academy’s CEO, agrees with the need for greater skepticism toward AI systems and advocates for a ban on companion AI chatbots or systems for students under 18.
“These algorithms are written to be sycophantic, and so they seem like your friend because they are trained to be your friend. They are not trained to tell you the truth.”
Many AI companies admit that their models can be creepy. In late April, OpenAI released a regular update that dramatically increased ChatGPT’s sycophancy before reverting back to a model “with more balanced responses.” OpenAI said in a statement that it recognized that this behavior could appear “uncomfortable or disturbing” and “raise security concerns.”
More importantly, Weil said, “AI should not be a replacement for human interaction and human relationships. Human relationships can be messy and really problematic and difficult, but that’s the beauty of humanity.”
Faced with an often overwhelming lack of…
