What's happened
OpenAI and Broadcom have unveiled Jalapeño, a purpose-built ASIC for large language model inference in data centers. Early results show improved performance per watt; deployment is slated with Microsoft and partners by year’s end as OpenAI pursues more stack control.
What's behind the headline?
Context and implications
- OpenAI is moving to own more of its stack, citing efficiency and cost as key drivers. This shifts competitive dynamics away from Nvidia-dominated infrastructure toward vertically integrated AI platforms.
- The Jalapeño design emphasizes inference performance and energy efficiency, signaling a focus on real-time services like Codex-powered queries and chat interactions.
- If Jalapeño scales, it could lower marginal costs and accelerate deployment of models, potentially pushing a broader shift in AI infrastructure strategy across the industry.
What readers should watch
- Whether OpenAI expands from inference to training workloads on homegrown silicon.
- How other hyperscalers respond with their own chips or mixed hardware strategies.
- Real-world performance, cooling, and reliability data once broader deployment begins.
How we got here
The joint project aims to reduce dependence on Nvidia by creating in-house silicon tailored for inference workloads. The collaboration follows a long-running trend of hyperscalers building custom chips to boost efficiency and cost savings as demand for AI compute climbs.
Our analysis
Ars Technica, TechCrunch, Axios, CNBC, Bloomberg, The Japan Times, The Verge (aggregated in coverage). Direct quotes reflect company statements on efficiency, stack control, and deployment timelines.
Go deeper
- How soon will Jalapeño be deployed at scale in data centers?
- Will OpenAI extend chip design to training workloads?
- How will this affect Nvidia’s role in OpenAI’s compute stack?
More on these topics
-
Nvidia - Computer game company
Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California.
-
OpenAI - Artificial intelligence company
OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc.
-
Broadcom - American semiconductor company
Broadcom Inc. is an American multinational designer, developer, manufacturer, and global supplier of a wide range of semiconductor and infrastructure software products. Broadcom's product offerings serve the data center, networking, software, broadband...
-
Google - Technology company
Google LLC is an American multinational technology company that specializes in Internet-related services and products, which include online advertising technologies, a search engine, cloud computing, software, and hardware.
-
Amazon - E-commerce company
Amazon.com, Inc., is an American multinational technology company based in Seattle, Washington. Amazon focuses on e-commerce, cloud computing, digital streaming, and artificial intelligence.
-
Tan Hock Eng - CEO Of Broadcom, Inc
Tan Hock Eng (Chinese: 陳福陽; pinyin: Chén Fúyáng; Pe̍h-ōe-jī: Tân Hok-iâng; born 1951 or 1952) is a Malaysian-born Chinese-American business executive. He is the CEO of Broadcom Inc. He was the highest-earning CEO in the US in 2017, earning U
-
Tesla, Inc. - Vehicle manufacturer
Tesla, Inc. is an American electric vehicle and clean energy company based in Palo Alto, California. The company specializes in electric vehicle manufacturing, battery energy storage from home to grid scale and, through its acquisition of SolarCity, solar
-
Greg Brockman - American entrepreneur, investor, and software developer
Gregory Brockman (born November 29, 1987) is an American entrepreneur and software engineer. He is co-founder and president of OpenAI. He began his career at Stripe in 2010, upon leaving MIT, and became CTO in 2013. He left Stripe in 2015 to co-found...
-
Sam Altman - President of Y Combinator
Samuel H. Altman is an American entrepreneur, investor, programmer, and blogger. He is the CEO of OpenAI and the former president of Y Combinator.