Cataclysm: Handling Extreme Overloads in Internet Services

1
Cataclysm Handling Extreme Overloads in Internet
Services

• Bhuvan Urgaonkar and Prashant Shenoy
• University of Massachusetts Amherst

2
Overloads in Internet Applications
Bottleneck!
Ecommerce app

• Internet apps experience overloads
• E.g. 20 fold increase in CNN traffic on 9/11
• Goal Handle overloads without app downtime

• Key idea Scalable policing provisioning

3
Cataclysm Components

• Provisioner Queuing theoretic app models
• Add servers to overloaded apps
• Policer Differentiated service and scalability
• Admit important requests during overload

d2 gt d1
d1
Admitted
Admission Control
d2
Dropped
Classifier

• Switch to approx. admission control at high
  loads
• Even higher loads gt multiple sentries, DNS RR

4
Cataclysm Policer

• Admits important requests during overloads
• Admitted requests see good response time

• Single policer arrival rates upto 19,000 req/s
• Can add more policers at higher loads

5
Concluding Remarks

• The Cataclysm hosting platform
• Scalable policer
• Dynamic provisioning of servers
• Implementation on Linux cluster of size 20
• Experimentation with variety of workloads

6
Thank you!

• More information
• http//lass.cs.umass.edu/papers.html