By @IBMResearch
Publication Date: 2025-12-02 13:00:00
In a few short years, we’ve seen a proliferation of AI use cases that are already upending how the world lives. And in the world of enterprise, we’re beginning to see that revolution take hold.
Much like any other software, though, an AI system integrated into a business’s workflow needs to work reliably at scale. But for today’s AI tasks, it isn’t always easy to verify that the models and agents being implemented are doing exactly what engineers expect them to do.
It’s something IBM has been working to resolve. Earlier this year, IBM Research released a new set of benchmarks, called ITBench, that aimed to bring scientific rigor to showing how IT automation agents are making work easier for enterprises. More recently, researchers at IBM did the same with AssetOpsBench, a set of tools to help developers and AI practitioners build and evaluate AI agents for asset management software.
Today, IBM is partnering with Kaggle to bring those realistic enterprise benchmarks to…
