GPU Parallel Program Development Using CUDA

Description

GPU Parallel Program Development using CUDA teaches GPU programming by showing the differences among different families of GPUs. This approach prepares the reader for the next generation and future generations of GPUs. The book emphasizes concepts that will remain relevant for a long time, rather than concepts that are platform-specific. At the same time, the book also provides platform-dependent explanations that are as valuable as generalized GPU concepts. The book consists of three separate parts; it starts by explaining parallelism using CPU multi-threading in Part I. A few simple programs are used to demonstrate the concept of dividing a large task into multiple parallel sub-tasks and mapping them to CPU threads. Multiple ways of parallelizing the same task are analyzed and their pros/cons are studied in terms of both core and memory operation. Part II of the book introduces GPU massive parallelism. The same programs are parallelized on multiple Nvidia GPU platforms and the same performance analysis is repeated. Because the core and memory structures of CPUs and GPUs are different, the results differ in interesting ways. The end goal is to make programmers aware of all the good ideas, as well as the bad ideas, so readers can apply the good ideas and avoid the bad ideas in their own programs. Part III of the book provides pointer for readers who want to expand their horizons. It provides a brief introduction to popular CUDA libraries (such as cuBLAS, cuFFT, NPP, and Thrust),the OpenCL programming language, an overview of GPU programming using other programming languages and API libraries (such as Python, OpenCV, OpenGL, and Apple’s Swift and Metal,) and the deep learning library cuDNN.

Get the book

Amazon.com

Search the book

eBay.com

Search the book

Other editions

• 

  GPU Parallel Program Development Using CUDA

  • 2018-01-19
  • 440 pages
  • Paperback
  • CRC Press

Similar books

• 

  Integral Geometry and Tomography: Proceedings of the AMS-IMS-SIAM Joint Summer Research Conference, Held June 24-30, 1989, with Support from the...

  By Eric Grinberg, Eric Todd Quinto

  In Section 2 we will deal with the “discrete” case. Let S be a locally finite tree T endowed with the natural integer-valued distance function: the ...

• 

  Ordinary Differential Equations and Linear Algebra: A Systems Approach

  By Todd Kapitula

  ... for in this case [yp](s)=s[yp](s), [yp](s)=s2[yp](s). As we will see in the examples, this assumption also makes it possible to deal with the initial ...

• 

  Cognition and Intractability: A Guide to Classical and Parameterized Complexity Analysis

  By Iris van Rooij, Mark Blokpoel, Johan Kwisthout

  x,y∈S δ(x,y) is maximum. u(x) + ADDITIVE SUBSET CHOICE Input: A set X = {x1 ,x2 ... F Tractability cycle Test 8.2 How (Not) to Deal with Intractability 173.

• 

  Mymathlab -- Standalone Access Card

  By Pearson Education, David P Pearson Education, Hall H Pearson Education

  Several versions of Pearson's MyLab & Mastering products exist for each title, including customized versions for individual schools, and registrations are not transferable.

• 

  Mymathlab Student Acc Kit + Intro Alg Wrkshts

  By Inc. Pearson Education

  Mymathlab Student Acc Kit + Intro Alg Wrkshts

• 

  Pearson Mathematics 7: H.P

  By Pearson Education Australia Staff

  Pearson Mathematics homework program for Year 7 provides tear-out sheets which correspond with student book sections, providing systematic and cumulative skills revision of basic skills and current class topics in the form of take-home ...

• 

  Worksheets for Classroom Or Lab Practice for Intermediate Algebra: Graphs & Models

  By Addison-Wesley

  Worksheets for Classroom Or Lab Practice for Intermediate Algebra: Graphs & Models

• 

  Pearson Mathematics New South Wales 8 Student Book: Australian Curriculum

  By Pearson Education Australia Staff, Gael McLeod, David Coffey

  The Student Book provides an easy-to-use 'nuts and bolts' book at each year level.

• 

  Matrix Iterative Analysis

  By Richard S. Varga

  ... partial differential equations have received a great deal of attention. For excellent bibliographical coverage, see Todd (1956), Richtmyer (1957), ...

• 

  Mathematical Modelling: Education, Engineering and Economics - ICTMA 12

  By C Haines, P Galbraith, W Blum

  Todd, P. A., McKeen, .l. ... ANALYTICAL SUPPORT PROBLEM SOLVING Cognitive Perspectives on Modelling HOW DO STUDENTS AND TEACHERS DEAL Sodhi and Son 219 NOTE ...