Intel’s AutoRound achieves faster and efficient LLM serving across Intel CPUs and GPUs, while Crescent Island is ready with MXFP8 & MXFP4 support. Intel AutoRound Algorithm Boosts LLM Delivery On Intel CPUs, GPUs, CUDA Platforms, Crescent Island Gets MXFP8 and MXFP4 Support Press Release: We’re excited to announce that AutoRound, a state‑of‑the‑art post‑training quantization(PTQ) algorithm developed by Intel, is now integrated into LLM Compressor. This collaboration delivers: Broader quantization schemes and model coverage are coming next—try it now and help shape what we build. What Is AutoRound? AutoRound is an advanced post-training quantization (PTQ) algorithm designed for Large Language Models(LLMs) and Vision-Language Models […]
Read full article at https://wccftech.com/intel-autoround-faster-more-efficient-llm-models-intel-gpus-cuda-cresent-island-fp8-mxfp8-mxfp4/