Modern high-performance GPU kernels increasingly rely on subgroup-level execution, including subgroup-level communication, subgroup operations, and matrix operations. These features are essential for workloads such as matrix multiplication and FlashAttention, but […]
Modern software increasingly relies on distributed systems to provide accessible, scalable, and reliable services. Choreographic programming brings a global perspective to distributed system development: programmers write a single program that describes the behavior of a whole system, and a compiler projects that global description into local programs run by each node. By making distributed control […]
Edge computing and distributed AI systems increasingly operate under heterogeneous resources, dynamic workloads, and frequent failures, requiring both adaptivity and fault tolerance for efficient execution. In heterogeneous edge clusters, nodes differ significantly in CPU throughput, memory capacity, and network bandwidth, while modern distributed GPU clusters supporting agentic LLM inference must recover large amounts of runtime […]
A community gathering of people interested in PyTorch and the projects that use it – not an official PyTorch organization. Sponsored by Red Hat and University of California Santa Cruz Location: Engineering 2, Room 180 Food, Socializing, and Excellent talks from the PyTorch Ecosystem 5:30 – 6:30 Food and Socializing 6:30 – 7:00 Talk 1 […]