NVIDIA has just announced its custom HBM solution called NVHBM, which will be used in future GPUs, offering higher bandwidth & lower power. NVHBM Is A Custom HBM Solution Designed By NVIDIA & Amazon’s Annapurna Labs To Speed Up DRAM Capabilities For Future Agentic & Physical AI Workloads The NVIDIA NVHBM DRAM solution is an extension of NVLink Fusion, offering higher memory performance and efficiency to XPUs at a time when memory bandwidth is becoming critical as model sizes increase tremendously into the trillion-parameter era. NVIDIA says that its NVHBM solution offers better bandwidth and efficiency than standard HBM solutions […]
Read full article at https://wccftech.com/nvidia-develops-custom-nvhbm-memory-for-ai-more-bandwidth-lower-power-than-hbm4e/