OpenAI Jalapeño chip design: where AI played a role | NeoTeo

OpenAI’s Jalapeño is a custom accelerator for large language model (LLM) inference: running a trained model to generate responses. OpenAI says its models assisted selected design, optimization and verification tasks, while engineers remained responsible for decisions and Broadcom handled physical design. The work was AI-assisted, not an end-to-end automated chip design.

Where AI helped in Jalapeño’s design

OpenAI says its models helped engineers explore different implementations, shorten design, measurement and verification loops, and optimize arithmetic circuits. The assistance fit especially well in software-like front-end work: the early stages where engineers describe and refine what a chip should do.

That workflow used XLS, a high-level synthesis system. High-level synthesis turns a higher-level description of hardware into a design that can be implemented as circuitry. Because this work resembles software development, it offered a natural place for AI assistance….