Anthropic claims new AI security method blocks 95% of jailbreaks, invites red teamers to try

Two years after ChatGPT hit the scene, there are numerous large language models (LLMs), and nearly all remain ripe for jailbreaks — specific prompts and other workarounds that trick them into producing harmful content. 

Model developers have yet to come up with an effective defense — and, truthfully, they may never be able to deflect such attacks…