Nvidia and CoreWeave rethink agentic AI infrastructure – SiliconANGLE

Agentic AI infrastructure must support the work between a model’s decisions as agents move from answering questions to executing tasks.

Central processing units handle much of that execution, while graphics processing units power model reasoning. Those complementary roles shape Nvidia Corp.’s planned Vera CPU deployment with CoreWeave Inc., according to Hannah Coutand (pictured, right), director of product marketing, Vera CPU, at Nvidia.

“The reason why Vera is so important is because we recognize that extreme co-design means that we look across the AI factory and we want to make sure we solve for any inefficient bottlenecks,” she said. “We recognized the CPU was becoming one of them. We didn’t set out to say, ‘Let’s go and build CPUs.’ We set out to solve this bottleneck.”

Coutand and Harsh Banwait (left), senior director of product at CoreWeave, spoke with theCUBE Research’s Dave Vellante and John Furrier at the Fully Connected event, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed CPU requirements, sandbox performance and infrastructure security. (* Disclosure below.)

Agentic AI infrastructure puts CPU performance under pressure

As training and inference become increasingly intertwined, infrastructure must accommodate both model computation and the environments where agents act. Tool calls, application programming interface calls and SQL queries increase the execution work handled by CPUs,…