Explorations into Parallel Programming with MPI

1
Explorations into Parallel Programming with MPI
lol
By Michael Chen Period 3
2
MPI?

• Message passing interface
• Works with C, C, and Fortran
• De facto standard in parallel programming

3
Embarrassingly Parallel!

• AKA Naturally Parallel
• Only master-slave communication
• Simplest type

4
Divide and Conquer

• Splits up work into groups
• Continually divides works into smaller parts
• Usually recursive

5
Other types...

• Pipeline problems that are sequential in nature
• Synchronous all processes are synchronized at
  certain points
• Load Balancing distributes all computations
  equally across processors termination detection

6
Code and Future Ideas?

• Wind velocity problem
• Mandelbrot
• Game of Life
• GRAND CHALLENGE!
• Best number of processors?