By @venturebeat
Publication Date: 2026-10-22 18:57:00
In VentureBeat Intelligence’s September VB Pulse survey, most companies running AI in production reported using half their GPU capacity or less — and most of those companies still plan to adopt new AI infrastructure.
Of the 102 qualified respondents, 68 were running AI in production and provided a GPU utilization figure. Fifty-five of those (81%) reported average utilization of 50% or less, and 71% of that group planned to adopt a new, additional or replacement AI infrastructure platform within 12 months.
Those findings raise a useful question about what buyers expect their next platform to solve. A replacement could improve scheduling, integration, or the economics of an existing workload. A new platform could support work the current environment handles poorly.
That question comes as Nvidia CEO Jensen Huang is urging companies to build their own AI factories. At his October 21 GTC Berlin keynote, he said, “To be part of this AI economy, you don’t want to just be consuming the AI; you want to be producing the AI.”
The AI factory pitch is expanding beyond compute. HPE is emphasizing governed APIs and Model Context Protocol (MCP) integration, while VAST has announced an Agent Sandbox Foundation Stack with Nvidia designed to preserve agent state, data access and audit trails as the underlying compute scales up and down. In my conversation with Nebius ahead of the event, its security team highlighted GPU confidential computing as a way to protect data and model weights…
