Parallel%20Architectures%20Based%20on%20Parallel%20Computing,%20M.%20J.%20Quinn

1
Parallel ArchitecturesBased on Parallel
Computing, M. J. Quinn
CIS 5930-04 Spring 2006 Parallel Computing

• Ashok Srinivasan
• www.cs.fsu.edu/asriniva
• Florida State University

2
Outline

• Interconnection Networks
• Mesh
• Binary Tree
• Hypercube
• Architectures
• Processor Arrays
• Multiprocessors
• Centralized Multiprocessors
• Distributed Multiprocessors
• Multicomputers
• Flynns Taxonomy
• SISD
• SIMD
• MIMD

3
Mesh

• 2-D Mesh
• N d2
• Diameter 2 N0.5
• Bisection width N0.5
• Edges/node 4
• 2-D Mesh with wraparound (2-D torus)
• 3-D Mesh
• 3-D torus

4
Binary Tree

• Binary Tree
• Diameter 2 log N
• Bisection width 1
• Edges/node 3
• Fat Tree
• Double the number of edges at each level up the
  tree

5
Hypercube

• Hypercube
• N 2d
• Diameter log N
• Bisection width N/2
• Edges/node log N

6
Processor Arrays
7
Centralized Multiprocessors

• Also called SMP/UMA

8
Cache Coherence Problem

• Solve through snooping

9
Distributed Multiprocessors

• Also called NUMA

10
Cache Coherence - Directory Based Solution
11
Multicomputers

• Also called a distributed memory system

12
Flynns Taxonomy

• SISD
• Single Instruction, Single Data
• Traditional computer
• SIMD
• Single Instruction, Multiple Data
• MIMD
• Multiple Instruction, Multiple Data