By ynet Global
Publication Date: 2026-10-18 13:48:00
As artificial intelligence moves beyond answering questions to performing tasks inside corporate systems, a new security threat is emerging as attackers seek to manipulate AI assistants into following malicious instructions instead of carrying out their users’ legitimate requests.
Israeli AI companies Alice and AI21 have tested one approach to that problem, using specially designed training scenarios to make NVIDIA’s open AI models more resistant to manipulation. In a separate project with US-based Inflection AI, Alice examined a different risk: conversational chatbots that become overly agreeable or encourage unhealthy emotional dependence among users.
The companies reported improvements in both areas while maintaining the models’ usefulness, although the findings are based on tests described by the companies rather than independently verified evaluations.
Alice is an AI safety and security company that helps developers identify weaknesses in artificial intelligence systems before they are exploited. Its work includes “red teaming,” in which researchers deliberately try to manipulate or break AI models to expose vulnerabilities, and developing training data based on real-world threats.
The company says it works with eight of the 10 leading foundation model laboratories and AI-native companies.
The projects used NVIDIA’s Nemotron family of…
