Title: MAKING
1MAKING MULTICORE SYSTEMS PERFORM!
Read IDCs Insight Report (211311) on
www.exludus.com Extreme Computing eXludus
Reinvents Job Scheduling and Promises Improved
Multicore System Utilization. Published March
28th, R. Walsh, S. Conway, E. Joseph
2Multi-Core Application Performance Predictability
and Throughput
Under normal operating conditions an application
run time determines the throughput capacity of
systems.
But on multi-core processor systems applications
tend to interfere randomly with one another
causing an effective loss of capacity to sustain
performance level expectations.
Node-Level Capacity Management, as per Multi-Core
Optimizer, is designed to eliminate job
interference performance impacts and optimize
throughput.
3MCore OptimizerDynamic Operational Research
- Given aircraft fleet (processor cores)
- Given hubs to service (jobs)
- Find optimal flight schedule to carry most
passengers (throughput)
4MCore OptimizerResource Allocation
With MCore Optimizer
Without MCore Optimizer
CPU
Memory
Memory
CPU
- No OS / Application Change
- Real-time optimal job mix search
- Prevents job interference
- Blocks resource conflicts
- Learns job resources needed
Time
Throughput Gain
Each color represents one of eleven jobs, white
spaces represent unused resources.
5MCore OptimizerPre-Emptible Backfilling
6MCore OptimizerFeedback Scheduling
past run history
user
qsub A.sh
past run history
qsub -l 500MB,1cpu,300sec A.sh
MCore Optimizer
this run data
- Tracks job resource use
- Provides WLM with resource expectations
- Prevents job interference with resource
expectations - Supports LSF, PBS Pro, Moab, Torque, Open PBS, SGE
A.sh
MCore Optimizer
7RepliCatorVMScalable VM Provisioning Performance
Re-provision a 3 GB VM image on 1,000 systems in
60 seconds on a 1 Gbit network!
8benoit.marchand_at_exludus.com 1 514 885 1270
(cell) dale.geldart_at_exludus.com 1 514 227 8411
(direct) 1 514 409 6143 (cell)
9MCore Optimizer Software Architecture
- Virtualization technology jobs run in an
encapsulated environment - Cooperating Socially Responsible resource
consumption - Aligns and synchronizes resource use across
software layers - Transparent to OS, Workload Manager Application
- No single point of failure
MCore Optimizer
10Cluster Capacity Management Limit