Cisco tried using AI to write security incident reports — and things didn’t really go as planned

• Cisco warns AI‑generated incident reports are often inaccurate, inconsistent, and prone to data loss due to LLM limitations
• The company advises granular, single‑task prompts, fixed source documents, and strict formatting rules to improve reliability
• Cross‑contamination between reports remains a challenge, with researchers recommending fresh sessions for each new incident report to avoid errors

Any companies looking to utilize AI tools for their security reporting may want to read a new report from Cisco outlining its experience using AI-generated incident reporting.

The company has warned those using AI to create long-form technical content should expect “significant inaccuracies, unusual conclusions, and inconsistent writing styles,” mostly because of the probability-driven nature of Large Language Models (LLM).