High Performance Systems and Computing
Course title: High Performance Systems and Computing
Code: 3ФЕИТ07З031
Number of credits (ECTS): 6
Weekly number of classes: 2+2+1+0
Prerequisite for enrollment of the subject: None
Course Goals (acquired competencies): Introduction to high-performance computing systems and parallel programming. Upon completion of the course, students will be able to independently use high performance computing systems and write appropriate software solutions.
Total available number of classes: 180
Course Syllabus: Introduction. Concepts of parallel processing. Basic concepts for design of parallel processing. Synchronization. Deployment. Process dependency. Mapping parallel algorithms of parallel architectures. Models with shared memory. Shared memory and threads. Parallel algorithms: ideal and realistic models. Introduction to OpenMP. Introduction to Distributed Memory and MPI. Practical examples with MPI. Introduction to GPUs. Introduction to GPU programming. GPU programming and CUDA. Advanced concepts for parallel programming. Parallel Pattern Templates. Examples of parallel algorithms. Algorithms for processing (sparse) matrices. Fast Furier Transformation Algorithms (FFT). Algorithms for matrices and graphs. Performance measurement.
Literature:
|
Required Literature |
||||
|
No. |
Author |
Title |
Publisher |
Year |
|
1 |
Peter Pacheco |
An Introduction to Parallel Programming |
Morgan Kaufmann |
2011 |
|
2 |
G. Hager, G. Wellein |
Introduction to High Performance Computing for Scientists and Engineers |
CRC Press |
2010 |
|
3 |
David A. Patterson |
Computer Architecture: A Quantitative Approach, 5th Ed. |
Morgan Kaufmann |
2011 |
|
Additional Literature |
||||
|
No. |
Author |
Title |
Publisher |
Year |
|
1 |
A. Grama, G. Karypis, V.Kumar, A. Gupta |
Introduction to Parallel Computing, 2nd Ed.) 2nd Edition by |
Pearson |
2003 |
|
2 |
David A. Bader |
Petascale Computing: Algorithms and Applications |
Chapman and Hall/CRC |
2007 |
|
3 |
D. Storti, M. Yurtoglu |
CUDA for Engineers: An Introduction to High-Performance Parallel Computing |
Addison-Wesley Professional |
2015 |
