munotes®
Sign in
Home / Syllabus / B.E. (Computer Engineering) / Fourth Year CE / Semester 8 / High Performance Computing

B.E. (Computer Engineering) High Performance Computing Syllabus - Mumbai University 2026

The University has moved this degree onto NEP 2020 one year at a time. The first and second years are NEP 2020 syllabi; the third and fourth years are still examined on the REV-2019 'C' Scheme, which is what the University sets for them this year.

High-Performance-Computing.pdf
Semester 8 · Fourth Year CE

Loading syllabus...

Syllabus for High Performance Computing

Semester 8 · Fourth Year CE

Module 1: Introduction to Parallel Computing

  • 1.1 Parallelism (What, Why, Applications), Levels of parallelism(instruction, transaction, task, thread, memory, function)
  • 1.2 Classification Models: Architectural Schemes(Flynn’s, Shore’s, Feng’s, Handler’s)
  • 1.3 Memory Access: Distributed Memory, Shared Memory, Hybrid Distributed Shared Memory
  • 1.4 Parallel Architecture: Pipeline Architecture: Arithmetic pipelines, Floating Point, Array Processor

Module 2: Parallel Programming Platform and Algorithm Design

  • 2.1 Parallel Programming Platform: Physical Organization of Parallel Platforms, Communication Costs in Parallel Machines
  • 2.2 Algorithm Design: Preliminaries, Decomposition Techniques, Characteristics of Tasks and Interactions, Mapping Techniques for Load Balancing, Methods for Containing Interaction Overheads, Parallel Algorithm Models.

Module 3: Performance Measures

  • Performance Measures: Speedup, execution time, efficiency, cost, scalability, Effect of granularity on performance, Scalability of Parallel Systems, Amdahl‘s Law, Gustavson‘s Law, Performance Bottlenecks, The Karp Flatt Metric.

Module 4: HPC Programming: OpenMP and MPI

  • HPC Programming: OpenMP
  • 4.1 Introduction: Threads, Share memory Architecture, Multi-core processors and Hyperthreading, Fork and join model.
  • 4.2 OpenMP directives: #pragma omp parallel, Hello world with openMP, #pragma omp for, #pragma omp for schedule.Serial vs Parallel PI program.
  • 4.3 Synchronisation: Introduction, Private vs Shared variables. Critical section, #pragma omp critical, #pragma omp atomic, #pragma omp barrier, #pragma omp reduction HPC Programming: MPI
  • 4.4 Introduction: Processes, Multiprocessor programming model, Distributed system programming model, Inter-process communication using message passing: Asynchronous and Synchronous
  • 4.5 MPI Programming: Hello world problem, mpi_initMPI_sendMPI_Recv, Synchronisation: MPI_Barrier
  • 4.6 Hybrid (MPI + OpenMP) programming, Hardware requirement, Threads inside Processes, Hybrid Matrix multiplication
  • 4.7 Message passing vs Share memory communication: Advantages and disadvantage

Module 5: Parallel programming using accelerators

  • An Overview of GPGPUs, Introduction to CUDA, Introduction to Heterogeneous Computing using OpenCL, An Overview of OpenCL API, Heterogeneous Programming in OpenCL.

Module 6: High Performance Computing in the Cloud

  • Virtualization and Containerization, Parallel Computing Frameworks, Scaling, HPC in the Cloud Use Cases.

Textbooks

  • 1 AnanthGrama, Anshul Gupta, George Karypis, Vipin Kumar “Introduction to Parallel Computing”, 2nd edition, Addison Wesley, 2003.
  • 2 Shane Cook, Morgan Kaufmann “CUDA Programming: A Developer's Guide to Parallel Computing with GPUs”, 2012.
  • 3 M. R. Bhujade “Parallel Computing”,2nd edition, New Age International Publishers, 2009.
  • 4 Kai Hwang, Naresh Jotwani, “Advanced Computer Architecture: Parallelism, Scalability, Programmability” McGraw Hill, Second Edition, 2010.
  • 5 Georg Hager, Gerhard Wellein, Chapman “Introduction to High Performance Computing for Scientists and Engineers” Hall/CRC Computational Science Series, 2011.
  • 1 Michael J. Quinn “Parallel Programming in C with MPI and OpenMPI” by, McGraw Hill Education, 2008.
  • 2 Kai Hwang ,Zhiwei, “Scalable Parallel Computing: Technology, Architecture, Programming”, McGraw-Hill Education, 1998.
  • 3 Laurence T. Yang, Minyi Guo, “High-Performance Computing: Paradigm and Infrastructure”, by, Wiley, 2006.
  • 1 https://nptel.ac.in/courses/112105293
  • 2 https://archive.nptel.ac.in/courses/128/106/128106014/

Reproduced from the University of Mumbai syllabus for B.E. (Computer Engineering) under REV-2019 'C' Scheme, in force from the academic year 2022-23. Wording is as printed in that syllabus. Module numbering is as printed there too.

The complete syllabus

This subject is cut from the University circular for its year. Open a document here if you want the whole thing rather than a single subject.

PDF 7.9 (R-A) B.E. (Computer Engineering) Sem I & II (Revised, NEP 2020) NEP 2020 syllabus Read full PDF Read
PDF 6.24 (N) B.E. (Computer Engineering) Sem III & IV (NEP 2020) NEP 2020 syllabus Read full PDF Read
PDF 6.15 B.E. (Computer Engineering) Third Year, Sem V & VI (REV-2019 'C' Scheme) REV-2019 'C' Scheme syllabus Read full PDF Read
PDF 6.41 (R) B.E. (Computer Engineering) Fourth Year, Sem VII & VIII (REV-2019 'C' Scheme) REV-2019 'C' Scheme syllabus Read full PDF Read
Report or request
Done!