Arjun Parthasarathy

ThunderKittens: Simple, Fast, and $\textit{Adorable}$ Kernels

The challenge of mapping AI architectures to GPU hardware is creating a critical bottleneck in AI progress. Despite substantial efforts, hand-written custom kernels fail to meet their theoretical performance thresholds, even on well-established operations like linear attention. The diverse capabilit…