Performance Analysis and Tuning for General Purpose Graphics Processing Units

by Kim Hyesoon, Richard Vuduc, Sara Baghsorkhi

General-purpose graphics processing units (GPGPU) have emerged as an important class of shared memory parallel processing architectures, with widespread deployment in every computer class from high-end supercomputers to embedded mobile platforms. Relative to more traditional multicore systems of today, GPGPUs have distinctly higher degrees of hardware multithreading (hundreds of hardware thread contexts vs. tens), a return to wide vector units (several tens vs. 1-10), memory architectures that deliver higher peak memory bandwidth (hundreds of gigabytes per second vs. tens), and smaller caches/scratchpad memories (less than 1 megabyte vs. 1-10 megabytes). In this book, we provide a high-level overview of current GPGPU architectures and programming models. We review the principles that are used in previous shared memory parallel platforms, focusing on recent results in both the theory and practice of parallel algorithms, and suggest a connection to GPGPU platforms. We aim to provide hints to architects about understanding algorithm aspect to GPGPU. We also provide detailed performance analysis and guide optimizations from high-level algorithms to low-level instruction level optimizations. As a case study, we use n-body particle simulations known as the fast multipole method (FMM) as an example. We also briefly survey the state-of-the-art in GPU performance analysis tools and techniques. Table of GPU Design, Programming, and Trends / Performance Principles / From Principles to Analysis and Tuning / Using Detailed Performance Analysis to Guide Optimization

96 pages, Paperback

First published November 1, 2012

About the author

Born in Ulijin, South Korea, Kim Hyesoon (1955-) received her PhD in Korean Literature from Konkuk University, and began as a poet in 1979 with the publication of Poet Smoking a Cigarette. She began to receive critical acclaim in the late 1990s and she attributes this to the strong wave of interest in poetry by woman poets; currently she is one of South Korea’s most important contemporary poets, and she now lives and teaches in Seoul. Her poetry aims to strive for a freedom from form, by experimenting with language focusing on the sensual - often female - body, in direct opposition to male-dominated lyrical poetry. ‘They are direct, deliberately grotesque, theatrical, unsettling, excessive, visceral and somatic. This is feminist surrealism loaded with shifting, playful linguistics that both defile and defy traditional roles for women.’

Having published more than ten poetry collections, a number of these have been translated into English recently: When the Plug Gets Unplugged (2005); Mommy Must be a Fountain of Feathers (2008); All the Garbage of the World, Unite! (2011); Sorrowtoothpaste Mirrorcream (2014) and I’m O.K., I’m Pig (2014). Tinfish has also published a small chapbook of three essays entitled Princess Abandoned (2012).

Throughout her career she has gained nearly all of South Korea’s most prestigious literary awards, named after the country’s greatest poets, such as Kim Su-yông Literature Award (1997), the Sowol Poetry Literature Award (2000) and the Midang Literature Award (2006). She was also the first female to win the Daesan Literary Award in 2008.