Covers the spectrum parallel architectures, parallel APIs, parallel application development and evaluation. Presents Flynn Classification and elaboration on MIMD architectures shared (UMA, NUMA, cc-NUMA) and distributed memory. GPUs as HPC. Measures of speed-up, efficiency, cost, Amdahl and Gustafson Laws. Foster design methodology, data and domain parallelism. Parallel programming APIs MPI, openMp, CUDA and hybrid combinations. Parallel Programming techniques for HPC applications. Profiling tools for evaluating and improving performance.
Basic Book Peter S. Pacheco, Introduction to Parallel Programming (Greek edition)
Supportive Book Drimakopoulos V parallel systems and programming (on-line) http://hdl.handle.net/11419/3209
Notes, presentaions, tutorials on Parallel programming and tools