Efficient Power Consumption in the modern Datacenter

1
Efficient Power Consumption in the modern
Datacenter

• William A Hammond
• Senior Technology Planner
• Digital Enterprise Group
• March 1, 2005

2
Server focused Agenda

• Power Consumption Review
• Showcase where technology focus can have impact
• Datacenter Modular Power Issues
• Intel Power Utilities
• Demand Based Switching to save power
• Power Calculator to increase rack utilization
• Power Monitor to provide DC wide interactions
• Power reduction in future
• Continuous capability and impact in future

Intel, SpeedStep and XEON are trademarks or
registered trademarks of Intel Corporation or its
subsidiaries in the United States or other
countries.
3
Power Consumption Review
4
Where the Power Goes Facility View
Power Consumption Review

• 50 incoming DC power consumed in HVAC and
  Power Delivery subsystems before reaching system
• AHU to Chiller to Tower efficient closed-loop
  systems
• Continued analysis of variable efficiency AHUs
• General over-blowing of DC ambient
• Focus on Efficient UPSs

Grid3-Phase
Diesel BackupGenerator
Panel
5
Where the Power Goes Platform View
Power Consumption Review

• Remaining 50 DC power consumed in Servers
• 50 of which is internal AC Conversion
  Cooling
• 30 is the processors themselves (but 50
  leakage)

System average based on Intel Dual Processor
1U and 2U reference Server Board Power Budgets.
Actual end user power profile may vary depending
on manufacturer and configuration.
6
Power Reduction Facility View
Power Consumption Review

• Critical that Server and building industry come
  together for operational expense reductions
• Fast T-rise prohibits sensors alone
• Early warning/feedback from servers key

7
Power Reduction Platform View
Power Consumption Review

• Server manufacturers and PS/VRM vendors together
• Determine optimum efficiency points
• Investing in new technologies for efficiency

8
Power Reduction Processor View
Power Consumption Review

• Intel is bringing dramatic reductions starting
  this year
• Leakage fraction last years on new 2005 silicon
  process
• Core power and leakage reductions continue
  unabated

These values are listed by Intel as a
convenience to Intel's general customer base, but
Intel does not make any representations or
warranties whatsoever regarding quality,
reliability, functionality, or compatibility of
these devices. This list and/or these devices
may be subject to change without notice.
9
Power Reduction Planar View
Power Consumption Review

• Intel technology investments paying off
• DDR2-400 30 to 40 lower power than DDR1-400
• Continued planar component integrations

http//www.elecdesign.com/Articles/Index.cfm?Art
icleID3189pg3
10
Power Reduction - Summary
Power Consumption Review

• Intel delivering a holistic platform response to
  impact all areas of power consumption
• Dramatic reduction in processor power consumption
  
• Intel silicon processes and leakage reductions
• Architecture and design carryover from mobile
  line
• System Level Enhancements
• High Efficiency Power Supplies and VRMs
• Demand Based Switching
• Datacenter Level Intel Power Utilities
• Power Calculator Maximize existing CapEx
• Power Monitor Minimize ongoing OpEx

11
Datacenter Modular Power Issues
12
Todays Datacenter Profile

• While Datacenters (DC) vary considerably
• Almost all utilize air for heat removal
• Most new builds are in the 90-135 W/sq.ft.
• Approximately 6-10 kW/rack
• Most are power-out limited vs. power-in limited
• Some rare ones in the 500 W/sq.ft. (ROI?)
• Are large capital 10 year investments

13
Issue Rack System Power Profile
1082 W AC total
894 W AC total

• 2U system (average config)
• Unrestricted Rack21.6KW (20)
• 40 total Processors
• 721W/sq ft _at_ 30sq ft/rack
• 6 sys at 90W/sq ft, 12 Processors

• 1U system (average config)
• Unrestricted Rack 35.7KW (40)
• 80 total Processors
• 1192W/sq ft _at_ 30sq ft/rack
• 7 sys at 90W/sq ft, 14 Processors

14
Issue Power doesnt track Utilization
A day in Exchange Workload
Processor utilization indicates how busy a server
is.
System power continues to be high during low
processor utilization.
DP-500W .NET Web Server
Average Power 170 Watt despite big variation in
processor utilization
15
Issue Rack Utilization
Nameplatepower

• Power consumption varies widely and not well
  understood by End Users
• Wide variance based on configuration and
  utilization
• Full Nameplate typically leaves rack space,
  power, and cooling headroom under many
  configurationslost ROI
• Simple nameplate de-rating under-predicts full
  configuration consumption, tripped breakers and
  downtime result!

Rackutilization gap
TypicalPower Draw
SystemPower Range
Need reliable industry methodology to close the
rack utilization gap
16
Intel Power Utilities

• Demand Based Switching
• Power Calculator
• Power Monitor

17
Intel Power Utilities - Summary
Intel Power Utilities

• Demand Based Switching reduces active power

18
Solution Demand Based Switching
Server system power without DBS
processor utilization
Server system power with DBS
AC power as of max AC power
Assumptions All components except processor
consume fixed amount of power
Estimated power profile for the hypothetical
example
DBS gives application the power when it is needed
William Hammond
19
Demand Based Switching (DBS)
Intel Power Utilities

• Utilizes Enhanced Intel SpeedStep Technology
• Dynamically reduces processor speed/power based
  on demand
• Reduces system power up to 24 for typical CPU
  utilizations

Lower operating costs with DBS
System based on Intel Server Board SE7520JR2
board, 4 GB DDR2-400 memory. 24 power savings
at approximately 46 CPU utilization with DBS OFF
running WeBench. See backup for full system
configuration. Customer results may vary
depending on hardware and software configuration.
20
DBS - System Power Benefits
Intel Power Utilities
You can reduce power and save operating costs
with DBS
Customer results may vary depending on hardware
and software configuration.
21
Intel Power Utilities
Intel Power Utilities

• Power Monitor
• Utility measures actual power consumption
• Real time data collection instead of worst case
  assumptions
• Power Calculator
• Utility estimates worst case system power
• Uses actual system components versus nameplate
  (full configuration)

Reliable, standardized approach to help optimize
rack utilization
22
Intel Power Utilities Sample GUI
Intel Power Utilities
23
Intel Power Utilities - Standards
Intel Power Utilities
Potential Future Consoles
Unified Mgt Module (UMM)
BMC Patrol CA UnicenterEnigmatec
DR-Orchestator HP Open View IBM
TivoliIntel Server ConsoleMS Operations
Manager
Policy Mgr
Scripting Engine
CIM-XML
CIMOM
IPMI provider
SNMP provider
CIM schema
Chassis mgt
IPMI/CIM
PSMI Enabled Power Supply
BMC Firmware
IPMI engine
CIM engine
SMB-I
Line Power
Load Power (n)
PXE/ EFI
Predictive Fail
Critical Events
LED Control
Other names and brands may be claimed as the
property of others. These vendors, devices are
listed by Intel as a convenience to Intel's
general customer base, but Intel does not make
any representations or warranties whatsoever
regarding quality, reliability, functionality, or
compatibility of these devices. This list and/or
these devices may be subject to change without
notice.
24
Intel Power Utilities - DC Rack Benefits
System average based on Intel Dual Processor
1U reference Server Board 2005 Power Budgets.
Actual end user power profile may vary depending
on manufacturer and configuration.
25
Intel Power Utilities - Summary
Intel Power Utilities

• Intel Power Utilities provide reliable,
  standardized approach to help optimize rack
  utilization and minimize OpEx

Other names and brands may be claimed as the
property of others. These vendors, devices are
listed by Intel as a convenience to Intel's
general customer base, but Intel does not make
any representations or warranties whatsoever
regarding quality, reliability, functionality, or
compatibility of these devices. This list and/or
these devices may be subject to change without
notice.
26
DC Power Futures Attacking the OpEx problem
27
Operational Expense - Problem
DC OpEx futures

• Business needs not aligned with power consumption
  neither platform nor DC
• Little capability to minimize OpEx
• Little capability to fully maximize CapEx
• Pre-defined Service Level Agreements (SLA) are
  measured historically

Power Utilities is part of the solution
28
Operational Expense - Solutions
DC OpEx futures

• Web services type interaction is the future for
  both platform and traditional facilities
• Service Oriented Enterprise control
• Service Oriented Infrastructure communication
• Service Oriented Architecture compute/facility
• All assets will report capabilities via CIMXML
• CoD/grid deployments used to match to SLA
• Highest business needs will get priority systems
• Lower business needs will be OpEx optimized

Power Utilities will grow with your DC
29
Future Directions
DC OpEx futures

• Datacenter as a full feedback system
• Cooling supplied as needed, to the systems req
• Goes after the 50 utility cooling costs
• Model ROI/TCO for multiple traditional DC
  capability
• Open ballroom with minimum racks
• 1 AHU 3 Racks, 3x3 active grid, 210 Servers
• Rack utilization matched to current thermal
  planning
• 1 AHU 22 racks, 1 active / 2 inactive tiles,
  210 Servers
• Monitor/Enable new cooling models
• Cold plate technologies enable dense server
  configs
• Emergent DCs enabling spot solutions (non-air)
• ROI models for super dense DCs

30
Summary
31
Summary
Summary

• Intel delivering a holistic platform response to
  impact all areas of power consumption
• Intel Power Utilities provide reliable,
  standardized approach to help optimize rack
  utilization and minimize OpEx
• Intel Power Utilities will grow with your DC
• Intel Processors The processor for your DC

32
Thank You!
33
Backup
34
Modern Datacenter (DC) Terms
Power Consumption Review

• AHU Air Handling Unit, part of cooling system
• HVAC Heating/Ventilating/Air Conditioning
• PDU Power Distribution Unit
• PS Power Supply
• SNMP Simple Network Management Protocol
• UPS Uninterruptible Power Supply

Grid3-Phase
Diesel BackupGenerator
CoolingTower
Panel
UPSs
Condenser loop
Chiller
Other names and brands may be claimed as the
property of others
35
Computer/Financial Industry Terms
Power Consumption Review

• ACPI Advanced Configuration and Power
  Interface, www.acpi.info
• BMC Baseboard management Controller
• CapEx Capital Expenses (like DC itself)
• CIM Common Information Module see DMTF
• DMTF Distributed Management Task Force,
  www.dmtf.org
• GUI Graphical User Interface
• I2C Baseboard Interface Controller from
  Philips Semiconductor
• IMPI Intelligent Platform Management
  Interface, www.intel.com/design/servers/impi
• OpEx Operational Expenses (like power)
• PSMI Power Supply Management Interface,
  www.ssiforum.org
• ROI Return on Investment
• SMB-I System Management Bus Interface,
  www.smbus.org
• UPS Uninterruptible Power Supply
• WS Web Services
• XML Extensible Markup Language

Other names and brands may be claimed as the
property of others