How NVIDIA DSX MaxLPS Maximizes AI Factory Throughput and Efficiency | NVIDIA Technical Blog
By Sarah McKenney Publication Date: 2026-09-28 01:00:00 Every unused watt is capacity left on the table. AI factories are typically…
Tag: throughput
Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput | Amazon Web Services
When you post-train a Mixture-of-Experts (MoE) model with Reinforcement Learning from Human Feedback (RLHF) or Group Relative Policy Optimization (GRPO)…
VMware vDefend Claims 75Tbps Distributed Firewall Throughput in Broadcom VCF 9.1 Update
Broadcom has issued updates for VMware vDefend and VMware Avi Load Balancer, enhancing security, performance, deployment, and automation features for…
WEKA and Oracle Cloud Infrastructure validate 10x throughput increases for long-context AI inference
By PR Newswire Asia Publication Date: 2026-06-09 22:00:00 Common OCI H100 infrastructure benchmarks showed 10x more concurrent users, 10x higher…
WEKA and Oracle Cloud Infrastructure validate 10x throughput increases for long-context AI inference
By WEKA Publication Date: 2026-06-09 13:00:00 Common OCI H100 infrastructure benchmarks showed 10x more concurrent users, 10x higher token throughput,…
Amazon unveils ‘Resilient Network Graphs’ data center network that cuts hardware by 69% and boosts throughput by 33% — now the default for most AWS workloads
Amazon has unveiled a new data center networking architecture that it claims delivers up to 33% higher throughput while reducing…
AWS details new RNG data center network design that boosts throughput, reliability – SiliconANGLE
Amazon Web Services Inc. has started using a new data center network design that significantly improves the throughput and reliability…
Nvidia: AI Agents Break the Data Center Throughput Model
By DataCenterKnowledge Publication Date: 2026-04-24 15:01:00 A recent wave of releases – including OpenAI’s GPT-5.5 model and new Nvidia guidance…
Researchers from MIT, NVIDIA, and Zhejiang University Propose TriAttention: A KV Cache Compression Method That Matches Full Attention at 2.5× Higher Throughput
By Asif Razzaq Publication Date: 2026-04-11 20:10:00 Long-chain reasoning is one of the most compute-intensive tasks in modern large language…
Nvidia’s new open weights Nemotron 3 super combines three different architectures to beat gpt-oss and Qwen in throughput
By Carl Franzen Publication Date: 2026-03-11 23:42:00 Multi-agent systems, designed to handle long-horizon tasks like software engineering or cybersecurity triaging,…