By Colleen Cabili
Publication Date: 2026-04-20 19:00:00
Google $GOOGL is developing new chips dedicated to AI inference in partnership with Marvell Technology, positioning Alphabet to more directly compete with Nvidia $NVDA in a semiconductor category driven by surging demand for AI software, according to Bloomberg.
After a model is trained, inference is the stage where it actually does its job — fielding queries and producing outputs. Google plans to announce a new generation of its tensor processing units, known as TPUs, at the Google Cloud Next conference in Las Vegas this week, with inference-focused chips expected to follow.
“The battleground is shifting towards inference,” Gartner analyst Chirag Dekate told Bloomberg. Google Chief Scientist Jeff Dean said in an interview that as AI demand grows, “it now becomes sensible to specialize chips more for training or more for inference workloads.”
Amin Vahdat, who oversees Google‘s AI infrastructure and chip work, declined to comment on specific inference chip plans but said more details…
