1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5 | Jeff Geerling

This blog post explores the capabilities of a Mac Studio cluster with RDMA over Thunderbolt 5, focusing on its performance in AI tasks and creative applications. The author tests the cluster's efficiency and speed using Exo 1.0, an open-source private AI clustering tool, and compares it to other high-performance computing systems. While the Mac Studio cluster shows promise, the author notes challenges with stability and scalability, and questions Apple's future directions for Mac Pro and Mac Studio.