What do you think?
GPU-Accelerated Computing with Python 3 and CUDA: From low-level kernels to real-world applications in scientific computing and machine learning
Accelerate your Python code on the GPU using CUDA, Numba, and modern libraries to solve real-world problems faster and more efficiently.
Key FeaturesBuild a solid foundation in CUDA with Python, from kernel design to execution and debuggingOptimize GPU performance with efficient memory access, CUDA streams, and multi-GPU scalingUse JAX, CuPy, RAPIDS, and Numba to accelerate numerical computing and machine learningCreate practical GPU applications, from PDE solvers to image processing and transformersBook DescriptionWriting high-performance Python code doesn’t have to mean switching to C++. This book shows you how to accelerate Python applications using NVIDIA’s CUDA platform and a modern ecosystem of Python tools and libraries. Aimed at researchers, engineers, and data scientists, it offers a practical yet deep understanding of GPU programming and how to fully exploit modern GPU hardware.
You’ll begin with the fundamentals of CUDA programming in Python using Numba-CUDA, learning how GPUs work and how to write, execute, and debug custom GPU kernels. Building on this foundation, the book explores memory access optimization, asynchronous execution with CUDA streams, and multi-GPU scaling using Dask-CUDA. Performance analysis and tuning are emphasized throughout, using NVIDIA Nsight profilers.
You’ll also learn to use high-level GPU libraries such as JAX, CuPy, and RAPIDS to accelerate numerical Python workflows with minimal code changes. These techniques are applied to real-world examples, including PDE solvers, image processing, physical simulations, and transformer models.
Written by experienced GPU practitioners, this hands-on guide emphasizes reproducible workflows using Python 3.10+, CUDA 12.3+, and tools like the Pixi package manager. By the end, you’ll have future-ready skills for building scalable GPU applications in Python.
What you will learnUnderstand GPU execution, parallelism, and the CUDA programming modelWrite, launch, and debug custom CUDA kernels in Python with CUDAProfile GPU code with NVIDIA Nsight and optimize memory accessUse CUDA streams and async execution to overlap compute and transfersApply JAX, CuPy, and RAPIDS to numerical computing and machine learningScale GPU workloads across devices using Dask and multi-GPU strategiesAccelerate PDE solvers, simulations, and image processing on the GPUBuild, train, and run a transformer model from scratch on the GPUWho this book is forPython developers, (data) scientists, engineers, and researchers looking to accelerate numerical computations without switching to low-level languages. This book is ideal for those with experience in scientific Python (NumPy, Pandas, SciPy) and a basic understanding of computing fundamentals who want deeper control over performance in GPU environments.
Table of ContentsWhy GPU programming with CUDA in Python 3?Setting up a GPU programming environment locally and in the cloudWriting and executing a CUDA kernel with numba Profiling and debugging CUDA codeOptimize memory access patterns and other tricksUsing CUDA Streams for Asynchronous Data TransfersScaling to multiple GPUsBringing NumPy and SciPy to the GPU with CuPyBringing Pandas and Scikit-learn to the GPU with RapidsSolving Optimiz
Key FeaturesBuild a solid foundation in CUDA with Python, from kernel design to execution and debuggingOptimize GPU performance with efficient memory access, CUDA streams, and multi-GPU scalingUse JAX, CuPy, RAPIDS, and Numba to accelerate numerical computing and machine learningCreate practical GPU applications, from PDE solvers to image processing and transformersBook DescriptionWriting high-performance Python code doesn’t have to mean switching to C++. This book shows you how to accelerate Python applications using NVIDIA’s CUDA platform and a modern ecosystem of Python tools and libraries. Aimed at researchers, engineers, and data scientists, it offers a practical yet deep understanding of GPU programming and how to fully exploit modern GPU hardware.
You’ll begin with the fundamentals of CUDA programming in Python using Numba-CUDA, learning how GPUs work and how to write, execute, and debug custom GPU kernels. Building on this foundation, the book explores memory access optimization, asynchronous execution with CUDA streams, and multi-GPU scaling using Dask-CUDA. Performance analysis and tuning are emphasized throughout, using NVIDIA Nsight profilers.
You’ll also learn to use high-level GPU libraries such as JAX, CuPy, and RAPIDS to accelerate numerical Python workflows with minimal code changes. These techniques are applied to real-world examples, including PDE solvers, image processing, physical simulations, and transformer models.
Written by experienced GPU practitioners, this hands-on guide emphasizes reproducible workflows using Python 3.10+, CUDA 12.3+, and tools like the Pixi package manager. By the end, you’ll have future-ready skills for building scalable GPU applications in Python.
What you will learnUnderstand GPU execution, parallelism, and the CUDA programming modelWrite, launch, and debug custom CUDA kernels in Python with CUDAProfile GPU code with NVIDIA Nsight and optimize memory accessUse CUDA streams and async execution to overlap compute and transfersApply JAX, CuPy, and RAPIDS to numerical computing and machine learningScale GPU workloads across devices using Dask and multi-GPU strategiesAccelerate PDE solvers, simulations, and image processing on the GPUBuild, train, and run a transformer model from scratch on the GPUWho this book is forPython developers, (data) scientists, engineers, and researchers looking to accelerate numerical computations without switching to low-level languages. This book is ideal for those with experience in scientific Python (NumPy, Pandas, SciPy) and a basic understanding of computing fundamentals who want deeper control over performance in GPU environments.
Table of ContentsWhy GPU programming with CUDA in Python 3?Setting up a GPU programming environment locally and in the cloudWriting and executing a CUDA kernel with numba Profiling and debugging CUDA codeOptimize memory access patterns and other tricksUsing CUDA Streams for Asynchronous Data TransfersScaling to multiple GPUsBringing NumPy and SciPy to the GPU with CuPyBringing Pandas and Scikit-learn to the GPU with RapidsSolving Optimiz
794 pages, Kindle Edition
Published March 31, 2026
Ratings & Reviews
Friends & Following
Create a free account to discover what your friends think of this book!
Community Reviews
No one has reviewed this book yet.