The Mac mini popularized the small form factor for running AI agents, thanks to powerful chipsets and adequate unified memory. Adopting this approach, Singaporean startup Acrab believes it has the perfect competitor in the form of an AI chip called Gelix 1. Sporting a 20-core ARM CPU and fabricated on the 5nm process, the company claims that it can beat Apple’s older M4 Pro in AI inference and run up to 100-billion-parameter models. Acrab’s own benchmarks reveal that the Gelix 1 achieved a pre-fill rate of 1,416 tokens per second when running Gemma 26B The AI inference capabilities of the Gelix […]
Read full article at https://wccftech.com/acrab-gelix-1-ai-chip-beats-mac-mini-m4-pro-in-inference/