Heterogeneous Parallel Programming
Rahul Ravindran1, Riya Suchdev2, Yash Tanna3
1Rahul Ravindran, Computer Engineering, Mumbai University, India.
2Riya Suchdev, Computer Engineering, Mumbai University, Mumbai, India.
3Yash Tanna, Computer Engineering, Mumbai University, Mumbai, India.
Manuscript received on May 03, 2014. | Revised Manuscript received on May 03, 2014. | Manuscript published on May 05, 2014. | PP: 54-59 | Volume-4 Issue-2, May 2014. | Retrieval Number: B2202054214/2014©BEIESP
Open Access | Ethics and Policies | Cite
©The Authors. Published By: Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/

Abstract: This paper presents Heterogeneous Parallel Computing (HPC), which is a well-orchestrated and co-ordinated effective use of a suite of diverse high performance machines to provide super-speed processing for computationally demanding tasks with diverse computational needs. GPUs are accoutered with a much more throughput oriented design as compared to that of the CPUs thus making them a powerful alternative to boast overall performance. It is now used all the way from mobile computing to supercomputing, like in Blue Star Super Computers. Upcoming Exascale and Petascale systems have embraced even heterogeneity in order to overcome power limitations. This paper also illustrates programming example using CUDA C to demonstrate the efficiency achieved in problems like matrix multiplication using a more heterogeneous approach as compared to that of sequential approach. It also explains how Heterogeneous Parallel Programming is a plausible, novel technique which allows to exploit inherent capabilities of a wide range of computational machines to solve computationally intensive problems that have several types of embedded parallelism by breaking it into separate modules. This paper also puts light on the challenges and concerns which exist when programming in HPC environment and some techniques to alleviate them.
Keywords: About four key words or phrases in alphabetical order, separated by commas.