Nvidia stacks up agentic AI infrastructure

Nvidia stacks up agentic AI infrastructure

By Gyana Swain
Publication Date: 2026-06-01 17:50:00

The centerpiece of the stack is Nvidia Agent Toolkit, a collection of software components that combines Nemotron AI models, agent-development blueprints, CUDA-accelerated libraries, and a new secure runtime called OpenShell.

Nvidia said companies including Cadence, Siemens, Dassault Systèmes, CrowdStrike, Palantir, Microsoft, Red Hat, and Canonical are already integrating parts of the stack into products and enterprise platforms.

OpenShell may be the most significant element for enterprise technology leaders: It places governance and security controls beneath the agent layer rather than inside the model or orchestration framework itself. The runtime enforces access policies across filesystems, networks, and processes, while also providing sandboxed execution and privacy controls for AI workloads.

This architectural approach reflects a broader shift occurring across the enterprise AI market as organizations grapple with how to secure agents that can access applications, invoke tools, and perform actions autonomously.