CUDA for LLMs

Get the eBook free when you register your print book at Manning.

CUDA (Compute Unified Device Architecture) provides a powerful parallel programming model AI engineers can use to tap the massive processing power of NVIDIA GPUs. CUDA delivers direct control, debugging power, and acceleration at the GPU level that can’t be matched by other types of optimizations.

This book shows you how to work within the CUDA ecosystem, from your first kernel to implementing advanced LLM features like Flash At...