NVIDIA’s next-gen Vera Rubin AI systems are projected to consume millions of terabytes in SSD capacity in the upcoming years, potentially triggering a NAND supply shock. NVIDIA’s New Storage Solution Could Alone Take Up a Massive Portion of the Global NAND Output One of the biggest bottlenecks in agentic AI environments is that query processing generates a huge temporary memory log for context building called the KV Cache, and currently, the data is stored in HBM modules. However, considering how rapidly data requirements within AI clusters are scaling up, HBM cannot hold the capacity onboard, which is why at CES […]
Read full article at https://wccftech.com/nvidia-next-generation-of-ai-systems-could-gobble-up-millions-of-terabytes-of-nand-ssd/