Parallel Processing

1
Parallel Processing

• Group Members
• PJ Kulick
• Jon Robb
• Brian Tobin

2
Topics

• Theory of parallel computers
• SUPERCOMPUTERS
• Distributed Computing

3
What is parallelism???

• Parallelism is the process of performing tasks
  concurrently.

• Real life examples
• Definition

• A pack of wolves hunting its prey.
• An orchestra.

4
Flynns Hardware Taxonomy
Processor Organizations
Single instruction, single data (SISD) stream
Multiple instruction, single data (MISD) stream
Single instruction, multiple data (SIMD) stream
Multiple instruction, multiple data (MIMD) stream
Uniprocessor
5
Taxonomy of parallel computing paradigms
Parallel Computer
Synchronous
Asynchronous
Vector/Array
MIMD
SIMD
Systolic
6
Interconnection Networks(IN)
IN topology
Distributed Memory
Shared Memory
Static
Dynamic
7
Distributed Memory Static Networks
Linear array (1-d)
2-dimensional networks
ring
tree
star
mesh
8
Distributed Memory Static Networks (contd)
Fully connected network
9
Hypercube
10
Distributed Memory

• Dynamic configurations

multi-stage
single-stage
cross-bar
11
Deep Blue

• First computer to defeat a world chess champion
• 32-node IBM Power Parallel SP2
• 6-move look ahead capability

12
SP2 Architecture

• The IBM SP2 is a general-purpose scalable
  parallel system based on a distributed memory
  message passing architecture.
• 2 to 128 nodes
• POWER2 technology RISC System/6000 processor

13
SP2 Architecture
14
SP2 Architecture
15
Super Computers Real World

• RISC System technology
• Running a high-volume scalable WWW server
• Forecasting the weather
• Designing cars
• Compaq AlphaServer technology
• Human Genome Project

16
Sun Systems

• MAJC Chip

17
MAJC

• Implements parallel processing on one chip
• Can operate in standalone or with up to several
  hundred others in parallel
• First version contains two separate processors
• As time goes many more will be included on one
  chip

18
Features

• Four function units per processor
• Each function unit contains local registers
• Global registers can be accessed by all FUs
• Operates as SIMD

• Multiple function units allow multiple
  instructions to be done simultaneously
• Each function unit can act as RISC/DSP processor
  itself

19
Architecture
20
Instruction Word
21
SGI
Onyx 3000
22
Onyx 3000 Series

• Developed for visualization and supercomputing
• Modular design allows for scalability ease
• Snap together approach

• Growth in multiple dimensions
• NUMAFlex architecture
• Designed for different generations to work
  together

23
Road Map
24
Available configurations
25
Applications of Onyx 3000

• High speed processing
• Real time graphic to video
• High-definition editing
• Integral support for virtual reality, real-time
  six degrees of freedom (6DOF) interaction, and
  sensory immersion

26
Real World Example

• The Cave(Iowa State University)
• Recreation of Forbidden City
• John Dear Factory
• Molecular Structuring

27
References

• http//www.sun.com
• http//www.sgi.com
• http//www.ibm.com
• http//www.vrac.iastate.edu
• Stallings, Williams. Computer Organization and
  Architecture,5th Edition.Upper Saddle River, New
  Jersey Prentice Hall 2000
• Lewis, Ted G. Introduction to Parallel Computing.
  Englewood Cliffs, New Jersey Prentice Hall 1992
• Kumar, Vippin. Introduction to Parallel
  Computing. Redwood City,California The
  Benjamin/Cummings Publishing Company 1994
• Moldovan,Dan I. Parallel Processing From
  Applications to Systems. San Mateo, California
  Morgan Kaufmann 1993