High Performance Computing

Course: High Performance Computing

Code: 3ФЕИТ07013

ECTS points: 6 ECTS

Number of classes per week: 3+0+0+3

Lecturer: Prof. Dr. Marija Kacarska

Course Goals (acquired competencies): Architectures, techniques and technologies for high performance calculations. Acquired knowledge for all possible aspects and applicability to high performance calculations.

Course Syllabus: Architectures for high-performance computing. Compilers for High Performance Systems. Removal of program loops. Parallelization. High performance systems. Mass memories. Coupling networks and clusters. Switching networks and clusters. Grid structures. Grid computing. Pipelining. Performance estimation and optimization. Applications for grid environment. High-performance microprocessors. Design and evaluation of modern parallel processors. Principles of parallelism. Instruction level parallelism. Multiprocessor systems. Multicore processors. Memory hierarchy design. Scalable parallel computing. Highly parallel systems. Parallel programming models. Communication primitives, techniques for programming and compiling. Fundamental concepts of parallel algorithms. 2D algorithms. Hypercube algorithms. Hypercube architectures. Мessage passing еnvironment (Message Passing Interface-MPI), parallel virtual machine (Parallel Virtual Machine-PVM). Managing the space for data storage. Deadlock. Techniques for synchronization and load balancing.

Literature: