Introducing RDMA over USB4® on Windows: run larger local AI models across PCs | Microsoft Community Hub

techcommunity.microsoft.com8 min read

Microsoft has announced a developer preview of RDMA over USB4 on Windows, enabling users to connect two or more Windows PCs via USB4 cables to split large open-weight AI models across their combined memory and GPU compute. Using the standard NetworkDirect API and a new open-source provider, the system achieves significantly lower round-latency than traditional Ethernet over USB4 links. Initial tests by silicon partners like AMD and Intel demonstrated running massive multi-billion-parameter models across consumer and mini-PC clusters. Open article →

More on this topic