Parallel Programming for Modern High Performance Computing Systems
- ISBN-10
- 1351385801
- ISBN-13
- 9781351385800
- Category
- Business & Economics
- Pages
- 304
- Language
- English
- Published
- 2018-03-05
- Publisher
- CRC Press
- Author
- Pawel Czarnul
Description
In view of the growing presence and popularity of multicore and manycore processors, accelerators, and coprocessors, as well as clusters using such computing devices, the development of efficient parallel applications has become a key challenge to be able to exploit the performance of such systems. This book covers the scope of parallel programming for modern high performance computing systems. It first discusses selected and popular state-of-the-art computing devices and systems available today, These include multicore CPUs, manycore (co)processors, such as Intel Xeon Phi, accelerators, such as GPUs, and clusters, as well as programming models supported on these platforms. It next introduces parallelization through important programming paradigms, such as master-slave, geometric Single Program Multiple Data (SPMD) and divide-and-conquer. The practical and useful elements of the most popular and important APIs for programming parallel HPC systems are discussed, including MPI, OpenMP, Pthreads, CUDA, OpenCL, and OpenACC. It also demonstrates, through selected code listings, how selected APIs can be used to implement important programming paradigms. Furthermore, it shows how the codes can be compiled and executed in a Linux environment. The book also presents hybrid codes that integrate selected APIs for potentially multi-level parallelization and utilization of heterogeneous resources, and it shows how to use modern elements of these APIs. Selected optimization techniques are also included, such as overlapping communication and computations implemented using various APIs. Features: Discusses the popular and currently available computing devices and cluster systems Includes typical paradigms used in parallel programs Explores popular APIs for programming parallel applications Provides code templates that can be used for implementation of paradigms Provides hybrid code examples allowing multi-level parallelization Covers the optimization of parallel programs
Get the book
Other editions
-
- 2018-03-05
- 261 pages
- Paperback
- CRC Press
Similar books
-
Taxation for Decision Makers, Binder Ready Version
By Shirley Dennis-Escoffier, Karen A. Fortin[LO 8.2] The Timberlake Corporation has an opportunity to sell its manufacturing facility to Carroll Corporation for $4,500,000. The property has a basis of ...
-
Taxation for Decision Makers, 2019 Edition
By Shirley Dennis-Escoffier, Karen A. Fortin[LO 9.2] The Timberlake Corporation has an opportunity to sell its manufacturing facility to Carroll Corporation for $4,500,000. The property has a basis of ...
-
Taxation for Decision Makers, 2020
By Shirley Dennis-Escoffier, Karen A. Fortin[LO 9.2] The Timberlake Corporation has an opportunity to sell its manufacturing facility to Carroll Corporation for $4,500,000. The property has a basis of ...
-
Keeping House in Lusaka
By Karen Tranberg Hansen1934. Memorandum on the Native Tribes and Tribal Areas of Northern Rhodesia . Lusaka : Government Printer . Timberlake , Michael , ed . 1985.
-
Encyclopedia of Community: From the Village to the Virtual World
By DAVID LEVINSON, KAREN CHRISTENSENTimberlake, L. (1987). Only one Earth. London: BBC Books: Earthscan. Tinker, I. (1987). Street foods: Testing assumptions about informal sector by women and ...
-
Taxation for Decision Makers 2006
By Shirley Dennis-Escoffier, Karen FortinThe Timberlake Corporation has an opportunity to sell its manufacturing facility to Carroll Corporation for $ 4,500,000 . The property has a basis of ...
-
Handbook of Organizational Performance: Behavior Analysis and Management
By William K Redmon, Thomas C Mawhinney, Carl Merle JohnsonTimberlake (1980, 1984) promulgated a behavioral-regulation analysis of learned performance that emphasizes the importance of behavioral.
-
Money and the Rule of Law: Generality and Predictability in Monetary Institutions
By Peter J. Boettke, Alexander William Salter, Daniel J. Smith190; Timberlake 1993, pp. 356–357). By increasing fiscal expenditures, President Carter may have successfully cornered the Fed into delaying tighter ...
-
Economic Politics: The Costs of Democracy
By William R. Keech, William R Keech( Timberlake , 1993 , p . 4 ) The same was true of the second Bank of the United States , which was chartered in 1816. However , under the leadership of ...
-
Handbook of Organizational Performance: Behavior Analysis and Management
By William K Redmon, Thomas C Mawhinney, Carl Merle JohnsonSchlinger, H. and Blakely, E. (1987). Function-altering effects of ... Timberlake, W. and Allison, J. (1974). Response deprivation: An empirical 48 HANDBOOK ...