NVIDIA-acquired firm Groq is reportedly planning to produce next-gen memory chips using 3D stacked DRAM technology. Groq Aims To Roll Out 3D Stacked DRAM Memory Technology In Next-Gen Chips, Pushing Capacity Over Speed Earlier this year, NVIDIA announced Groq LPX racks, which are part of the Vera Rubin ecosystem to boost inference performance. The LPX racks entered full production back in August, and early results showcase a record 3,400 Tokens Per Second of performance when coupled with NVL72 servers. The current generation of Groq LPUs packs 500 MB of SRAM, achieving a blistering-fast bandwidth rate of 150 TB/s while the […]
Read full article at https://wccftech.com/nvidia-groq-moving-next-gen-lpus-from-sram-to-3d-stacked-dram/