It seems that the AI industry is now focusing on creating an inference-optimized AI SSD through NAND chips, as SK hynix plans to introduce a solution by 2027. NVIDIA & SK hynix Are Co-Developing an “AI SSD” That Could Bring Massive Benefits to Inference Workloads As traditional AI workloads shift from training to inference, there’s a need to switch up the tech stack to ensure a low-latency, high-throughput environment. One of the reasons for this is how NVIDIA has decided to integrate general-purpose GDDR7 memory into the Rubin CPX GPU for prefill. Now, according to a report by Chosun Biz, […]
Read full article at https://wccftech.com/after-gobbling-up-dram-nvidia-sk-hynix-plan-to-introduce-an-ai-ssd/