OpenAI seems to have used its current spate of models that run on NVIDIA GPUs to design the Jalapeno chip, and paired it with its own Gluon kernel programming language, thereby daring to threaten NVIDIA’s legendary CUDA moat. How the tables have turned! The architecture of OpenAI’s Jalapeno chip SemiAnalysis has just provided a detailed breakdown of OpenAI’s Jalapeno ASIC, describing a somewhat novel architecture that delivers substantial economies of scale. As such, the Jalapeno pairs a single reticle-sized compute die – built on TSMC’s N3P node – with an N3E I/O chiplet and HBM4 memory (likely from Samsung), delivering […]
