Parallel and Distributed Computing Overview

1
Parallel and Distributed Computing Overview

• Professors Johnnie Baker and Robert Walker

2
Instructors

• Professor Johnnie W. Baker
• Primary Lecturer
• Professor Robert Walker
• Particularly Architecture Lectures
• Guest Lecturers from Parallel Processing Group
• Lecture in areas of expertise
• Occasionally cover classes when I am away

3
Textbook and References

• Textbook
• Parallel Programming in C with MPI and OpenMP
• Michael Quinn, author
• Published by McGraw Hill in 2004
• Used in both PDC and PDA
• References for Supplementary Reading
• Other textbooks and reference books
• Conference and journal papers
• Assigned reading will either be handed out or
  posted on course website

4
Two Complementary Courses

• Parallel Distributed Computing (Fall)
• Architectures
• Languages
• Parallel Programming
• Algorithm Examples for some architectures
• Parallel Distributed Algorithms (Spring)
• Important Models of Computation
• Designing Efficient Algorithms for Various Models
• PDC and PDA can be taken in either order
• Preference is for PDC to be taken first

5
Specific Topics

• Fundamental concepts in parallel computation.
• Synchronous Computation
• SIMD, Vector, Pipeline Computing
• Associative and Multi-Associative Computing
• ASC Language and Programming
• MultiC Language and Programming
• Fortran 90 and HPF Languages
• Asynchronous (MIMD) Shared Memory Computation
• OpenMP language
• Symmetric Multiprocessors or SMPs
• Asynchronous (MIMD) Distributed Memory
  Computation
• Communications
• MPI Language and Programming
• Architectures
• Interconnection Networks (synchronous and
  asynchronous)
• Specific Computer Examples for above computation
  paradigms
• MIMD-SIMD Comparisons in Real-Time Applications

6
Assignments and Grading

• Homework assignments
• Problems assigned for most chapters
• Probably 5-7 different assignments
• Some assignments will involve programming
• Course Grade
• Based on homework, midterm, and final
• Approximate weights (assuming grader)
• Homework 40
• Midterm Exam 30
• Final Exam 30