Streaming Compute Engine Demonstration

1
Streaming Compute Engine

• Performing a Simpsons Rule Integration in
  Parallel

2
Description

• We perform a Simpsons Rule integration on sin(x)
  from 0 to 17, returning results dynamically
• The processing is done in turn on 1, 2 and 3
  worker nodes
• Using 2 workers cuts time by around 40
• Using 3 workers cuts time by around 62

3
One Worker

• Client and Master programs run in own processes
  on one machine
• Worker program runs on a remote server (actually
  a VM instance on Google Cloud Platform)

4
(No Transcript)
5
Results for One Worker

• Answer 1.275163338088577330
• Time to transfer data to worker
• 6.97 seconds
• Time to process and return results
• 27.28 seconds
• Total time taken
• 34.26 seconds

6
Two Workers

• Client and Master programs run in own processes
  on one machine
• Worker programs run in separate VM instances in
  the cloud

7
(No Transcript)
8
Results for Two Workers

• Answer 1.275163338088577330
• Time to transfer data to worker
• 5.54 seconds
• Time to process and return results
• 15.12 seconds
• Total time taken
• 20.66 seconds

9
Three Workers

• Client and Master programs run in own processes
  on one machine
• Worker programs run in separate VM instances in
  the cloud

10
(No Transcript)
11
Results for Three Workers

• Answer 1.275163338088577330
• Time to transfer data to worker
• 5.69 seconds
• Time to process and return results
• 7.25 seconds
• Total time taken
• 12.95 seconds

12
Comparison
One Worker Two Workers Three Workers
Upload Time (s) 6.97 5.54 5.69
Processing/Return Time (s) 27.28 15.12 7.25
Total Time (s) 34.26 20.66 12.95
Speedup (time decrease as of single-worker time) 0 39.70 62.20