By Hassan Mujtaba
Publication Date: 2026-06-14 12:25:00
NVIDIA’s Blackwell GB300 has posted record performance in AA-AgentPerf, a new benchmark that measures Agentic AI workflows.
NVIDIA Blackwell Ultra GB300 is 20 Times Faster Than Hopper In Agentic AI, Records Highest Performance In Latest Benchmarks
Artificial Analysis has a new benchmark out called AA-AgentPerf, which measures how many active agents an inference deployment can support under realistic workloads, which include:
- Real agentic trajectories — multi-turn coding sessions with interleaved reasoning, tool calls, and variable context lengths (not synthetic uniform prompts).
- Sustained concurrent load — simulated agents maintain continuous in-flight requests, stressing KV cache reuse, speculative decoding, and scheduler behavior.
- Market-derived SLO tiers — performance thresholds based on Artificial Analysis serverless API benchmarking data, reflecting quality-of-service levels observed across providers.
- Continuously updated — results are updated on an ongoing basis as new hardware, software stacks, and model versions become available.
- Production-ready — models are tested with realistic optimizations enabled and production-scale deployment topologies.
The AA-AgentPerf benchmark is used to measure three key metrics, which form the basis of modern-day AI deployments, such as:
- Time to First Token (TTFT): Per-request latency from sending the request to receiving the first output token.
- Output…
