← Back to live feed1 story
The AI startup announced that its new Broadcom-designed processor delivered faster response times and greater power efficiency than Nvidia's GB300 in internal tests for AI inference. Named Jalapeno, the chip runs at 700 watts and aims to reduce the infrastructure costs associated with deploying large-scale models. OpenAI plans to deploy the hardware later this year to support its own models.
The company stated that the performance lead expanded on larger workloads, including Moonshot’s Kimi model, though Jalapeno was not tested against Nvidia’s upcoming Vera Rubin generation. A second-generation chip is currently approaching tape-out, and work has already begun on a third generation.
Sign in to suggest edits
Key sources
- SOURCE@edludlow“OAI's Richard Ho is on Bloomberg Tech today”x.com
- SUPPORT@deitaone“However, Jalapeno wasn’t tested against Nvidia’s newer Vera Rubin chips.”x.com
- SUPPORT@wallstengine“The company says the performance advantage widened on larger workloads, including Moonshot’s Kimi model”x.com
- SUPPORT@stocksavvyshay“Jalapeno reportedly delivered more AI work per watt and faster response times as inference becomes a larger share of AI compute.”x.com
- DISCUSSIONbmulhollandnews.ycombinator.com
- SOURCEhnnewsletter.semianalysis.com