Faster and More Power-Efficient, OpenAI's JALAPENO Chip Challenges Nvidia GB300

OpenAI claims its self-developed AI chip, Jalapeno, surpasses Nvidia's GB300 in power efficiency and response latency, targeting inference scenarios, with development support from Broadcom. The chip achieves high performance at a low power draw of 700 watts, aiming to reduce computing costs. OpenAI states it combines high throughput with low latency, particularly suited for large models. However, OpenAI has no intention of fully replacing Nvidia and will maintain multi-vendor collaboration.