Calit2

1
Calit2CSEs Living Laboratory for the Future
Applications of Information Technology

• UCSD CSE 292 Lecture Series (Fall 2009)
• Calit2_at_ UCSD
• November 30, 2009

Dr. Larry Smarr Director, California Institute
for Telecommunications and Information
Technology Harry E. Gruber Professor, Dept. of
Computer Science and Engineering Jacobs School of
Engineering, UCSD Follow me on Twitter lsmarr
2
Abstract
The California Institute for Telecommunications
and Information Technology (Calit2) is a UC San
Diego/UC Irvine partnership which allows for
research into the applications of the continued
exponential growth of telecom and IT. I will
review the specialized Calit2 facilities which
are available to professors and students in CSE
and then describe several emerging disciplines in
which we have teamed application scientists and
computer scientists. These include microbial
metagenomics, remote ocean observatories,
cosmological supercomputing simulations, Green
IT, and global telepresence.
3
Californias Institutes for Science and
Innovation A Bold Experiment in Collaborative
Research
California Institute for Bioengineering,
Biotechnology, and Quantitative Biomedical
Research
Center for Information Technology Research in
the Interest of Society
UCD
UCM
UCB
UCSF
California NanoSystems Institute
UCSC
California Institute for Telecommunications and
Information Technology
www.ucop.edu/california-institutes
4
What Is Calit2?

• Research on the Future of the Internet and its
  Transformation of Our Society
• Core Partnership Between UCSD and UCI
• Several Hundred Faculty
• Alliances With Other Campuses
• Prototyping Of Infrastructure Through Living
  Laboratories
• From Campus to Planetary Scale
• Partnerships With Multiple Levels of Government
  and Industry
• Secret Sauce Technical Professionals to Move
  Projects Forward
• Multidisciplinary Research Teams
• Faculty, Postdocs, Staff, Students
• Industry Partners
• From Giants to Start-up Companies
• Community Partners
• Emergency Responders

5
Two New Calit2 Buildings Provide New
Laboratories for Living in the Future

• Convergence Laboratory Facilities
• Nanotech, BioMEMS, Chips, Radio, Photonics
• Virtual Reality, Digital Cinema, HDTV, Gaming
• Over 1000 Researchers in Two Buildings
• Linked via Dedicated Optical Networks

UC Irvine
Preparing for a World in Which Distance is
Eliminated
www.calit2.net
100M From State for New Facilities
6
Calit2 UCSD Affiliated CentersLoci for Innovation
7
The UCSD Center for Networked SystemsA Calit2
Affiliated Center
Research Interests

• Diverse Research Projects
• Multiple Faculty
• Multiple Students
• Multidisciplinary
• CNS Research Theme

Member Companies
Center Faculty
Project Proposals
http//cns.ucsd.edu/
8
Advanced Multimedia Facilities
Synthesis Center

• Audio Spatialization
• Motion Capture
• Gaming Lab

High Definition Studio
9
First Trans-Pacific Super High Definition
Telepresence Meeting Using Digital Cinema 4k
Streams
Streaming 4k with JPEG 2000 Compression ½
gigabit/sec
100 Times the Resolution of YouTube!
Lays Technical Basis for Global Digital
Cinema Sony NTT SGI
10
Ultra Resolution Virtual Reality Toward a 3D
Global Collaboratory
15 Meyer Sound Speakers Subwoofer
Connected at 50 Gb/s to Quartzite
30 HD Projectors!
Varrier Showing 360 degree Mars Rover Images
StarCAVE Showing Biomolecules and GreenLight
Project
Source Tom DeFanti, Greg Dawe, Calit2
Cluster with 30 Nvidia 5600 cards-60 GB Texture
Memory
11
Calit2 Has Advanced Facilities for Building
Prototypes

• Calit2 Laboratories
• Millimeter Wave
• Microwave/PA
• Circuits
• Embedded Systems
• Photonics

12
Calit2 Microbial Metagenomics Cluster-Used by
Over 3000 Scientists in 70 Countries
13
Calit2 is Creating CAMERA 2.0 --Advanced
Cyberinfrastructure Service Oriented Architecture
Source CAMERA CTO Mark Ellisman
14
The NSF-Funded Ocean Observatory Initiative With
a Cyberinfrastructure for a Complex System of
Systems
Source Matthew Arrott, Calit2 Program Manager
for OOI CI
15
NSF OOI is a 400M Program -OOI CI is 34M Part
of This
30-40 Software Engineers Housed at Calit2_at_UCSD
Source Matthew Arrott, Calit2 Program Manager
for OOI CI
16
OOI-CI Needs Service-Oriented-Architecture
Frameworks to Address Several Service Composition
Challenges

• A Scientist is Trying to Setup a Facility out of
  Resources (Instruments, Computing Capabilities,
  Storage) Spread Over a Variety of Authority
  Domains

• Some of the Integration Challenges
• Resource Discovery (Instruments, Storage,
  Computation)
• Resource Access (Seamlessly Across
  Infrastructure)
• Resource Model (Adding/Removing an Instrument,
  ...)
• Authentication, Authorization, And Other
  Policies,
• Governance Across Multiple Authorities
• Need for Agility and Flexibility
• High availability with active failure management

Source Ingolf Krueger, CSE, Calit2
17
OOI CIResearch Topics

• Semantic Foundations
• Formal Service Notion
• Composition Operators
• Refinement Notions for Services
• Mapping from Services to Components
• Description Techniques for Services and
  Components
• Message Sequence Charts
• Architecture Definition Languages
• Service-Oriented Development Process
• Requirements Engineering
• Logical vs. Deployment Architectures
• Verification and Validation
• Integrated Development Process and Tool Support

Source Ingolf Krueger, CSE, Calit2
18
Exploring Cosmology With Supercomputers,
Supernetworks, and Supervisualization
Source Mike Norman, SDSC
Intergalactic Medium on 2 GLyr Scale

• 40963 Particle/Cell Hydrodynamic Cosmology
  Simulation
• NICS Kraken (XT5)
• 16,384 cores
• Output
• 148 TB Movie Output (0.25 TB/file)
• 80 TB Diagnostic Dumps (8 TB/file)

Science Norman, Harkness,Paschos
SDSC Visualization Insley, ANL Wagner SDSC

• ANL Calit2 LBNL NICS ORNL SDSC

19
Project StarGate Network Hardware
Source Mike Norman, SDSC
ALCF
ESnet
DOE Eureka 100 Dual Quad Core Xeon Servers 200
NVIDIA Quadro FX GPUs in 50 Quadro Plex S4 1U
enclosures 3.2 TB RAM
Science Data Network (SDN) gt 10 Gb/s fiber optic
network Dynamic VLANs configured using OSCARS
rendering
SDSC
NICS
visualization
simulation
NSF TeraGrid Kraken Cray XT5 8,256 Compute
Nodes 99,072 Compute Cores 129 TB RAM
Calit2/SDSC OptIPortal1 20 30 (2560 x 1600
pixel) LCD panels 10 NVIDIA Quadro FX 4600
graphics cards gt 80 gigapixels 10 Gb/s network
throughout
ANL Calit2 LBNL NICS ORNL SDSC
20
OptIPortals Scaling up the Personal
ComputerFor Supernetwork Connected
Data-Intensive Users
Mike Norman, SDSC October 10, 2008
Two 64K Images From a Cosmological Simulation
of Galaxy Cluster Formation
log of gas temperature log of gas density
21
How Can Computer Science and Engineering Research
Help Meet the Greatest Challenge of Our Time?

• American College and University Presidents
  Climate Commitment
• 659 Presidents Have Signed So Far
• Commitment for Taking Steps Toward Climate
  Neutrality

We believe colleges and universities must
exercise leadership in their communities and
throughout society by modeling ways to minimize
global warming emissions
www.presidentsclimatecommitment.org
22
ICT is a Critical Element in Achieving
Greenhouse Gas Emission Reduction Targets

• GeSI member companies
• Bell Canada,
• British Telecomm.,
• Plc,
• Cisco Systems,
• Deutsche Telekom AG,
• Ericsson,
• France Telecom,
• Hewlett-Packard,
• Intel,
• Microsoft,
• Nokia,
• Nokia Siemens Networks,
• Sun Microsystems,
• T-Mobile,
• Telefónica S.A.,
• Telenor,
• Verizon,
• Vodafone Plc.

www.smart2020.org
23
The Global ICT Carbon Footprint isAlready
Significant Today and Growing Rapidly
ICT Emissions are Growing at 6 Annually!

• Note--the assumptions behind the growth in
  emissions expected in 2020
• takes into account likely efficient technology
  developments that affect the power consumption of
  products and services
• and their expected penetration in the market in
  2020

www.smart2020.org
24
Reduction of ICT Emissions is a Global Challenge
U.S. and Canada are Small Sources
U.S. and Canada Together Fall From 25 to 14 of
Global ICT Emissions by 2020
www.smart2020.org
25
The Global ICT Carbon Footprint by Subsector-The
Internet, Data Centers, and PCs
The Number of PCs (Desktops and Laptops) Globally
is Expected to Increase from 592 Million in 2002
to More Than Four Billion in 2020
www.smart2020.org
26
First, Reduce Physical Energy and Cooling--UCSD
Has Two Sun Microsystems Modular Data Centers

• Sun Has Shown up to 40 Reduction in Energy Using
  Active Management of Disks, CPUs, etc.
• Sun Measures Temperature at 40 Points in the Air
  Stream (5 Spots on 8 Racks) Plus
• Internal Humidity and Temperature at the Sensor
  Module,
• External Temperature and Humidity,
• Incoming and Exiting Water Temperature and Power
  Utilization in Each of the 8 Racks

27
The NSF-Funded UCSD GreenLight Project How
Software Can Make Data Centers More Efficient?

• Focus on 5 Communities with At-Scale Computing
  Needs
• Metagenomics
• Ocean Observing
• Microscopy
• Bioinformatics
• Digital Media
• Goal Measure, Monitor, Web Publish Real-Time
  Sensor Outputs
• Via Service-Oriented Architectures
• Allow Researchers Anywhere to Study Computing
  Energy Cost
• Enable Scientists to Explore Tactics for
  Maximizing Work/Watt
• Develop Middleware that Automates Optimal Choice
  of Compute/RAM Power Strategies for Desired
  Greenness

28
Research Needed on How to Deploy a Green CI

• Computer Architecture
• Rajesh Gupta/CSE
• Software Architecture
• Amin Vahdat, Ingolf Kruger/CSE
• CineGrid Exchange
• Tom DeFanti/Calit2
• Visualization
• Falko Kuster/Structural Engineering
• Power and Thermal Management
• Tajana Rosing/CSE
• Analyzing Power Consumption Data
• Jim Hollan/Cog Sci
• Direct DC Datacenters
• Tom Defanti, Greg Hidley

MRI
http//greenlight.calit2.net
29
Machine Learning for Dynamic Power and Thermal
Management to Reduce Energy Requirements

• NSF Project Greenlight
• Green Cyberinfrastructure in Energy-Efficient
  Modular Facilities
• Closed-Loop Power Thermal Management

• Dynamic Power Management (DPM)
• Optimal DPM for a Class of Workloads
• Machine Learning to Adapt
• Select Among Specialized Policies
• Use Sensors and Performance Counters to Monitor
• Multitasking/Within Task Adaptation of Voltage
  and Frequency
• Measured Energy Savings of Up to 70 per Device

• Dynamic Thermal Management (DTM)
• Workload Scheduling
• Machine learning for Dynamic Adaptation to get
  Best Temporal and Spatial Profiles with
  Closed-Loop Sensing
• Proactive Thermal Management
• Reduces Thermal Hot Spots by Average 60 with No
  Performance Overhead

CNS
System Energy Efficiency Lab (seelab.ucsd.edu) Pro
f. Tajana Šimunic Rosing, CSE, UCSD
30
But, If IT is Used in New WaysCarbon Savings Can
Be Much Larger!
While the sector plans to significantly step up
the energy efficiency of its products and
services, ITs largest influence will be by
enabling energy efficiencies in other sectors,
an opportunity that could deliver carbon savings
five times larger than the total emissions from
the entire ICT sector in 2020. --Smart 2020
Report

• Major Opportunities for the United States
• Smart Buildings
• Virtual Meetings
• Smart Transportation Systems
• Smart Electrical Grids
• Smart 2020 United States Report
  Addendum
• www.smart2020.org

31
Developing Greener Smart Campuses as Societal
Prototypes Calit2 (UCSD UCI)

• Coupling the Internet and the Electrical Grid
• Measuring Electrical Demand Per Building Across
  Campus
• Measuring Demand at Sub-Building Levels
• Reducing Computer Energy Usage in Buildings
• Travel Substitution
• Next Generation Global Telepresence
• Beyond Cisco Telepresence
• Enabling Continuous Collaboration Without Travel

Student Video -- UCSD Living Laboratory for
Real-World Solutions www.gogreentube.com/watch.php
?vNDc4OTQ1 on UCSD UCI Named Best Overall' in
Flex Your Power Awards www.today.uci.edu/news/rel
ease_detail.asp?key1859
32
Real-Time Monitoring of Building Energy
UsageUCSD Has 34 Buildings On-Line
http//mscada01.ucsd.edu/ion/
33
Comparision Between UCSD BuildingskW/sqFt Year
Since 1/1/09
Calit2 and CSE are Very Energy Intensive Buildings
34
Power Management in Mixed Use BuildingsThe UCSD
CSE Building is Energy Instrumented

• 500 Occupants, 750 Computers
• Detailed Instrumentation to Measure Macro and
  Micro-Scale Power Use
• 39 Sensor Pods, 156 Radios, 70 Circuits
• Subsystems Air Conditioning Lighting
• Conclusions
• Peak Load is Twice Base Load
• 70 of Base Load is PCs and Servers
• 90 of That Could Be Avoided!

Source Rajesh Gupta, CSE, Calit2
35
Today Dedicated 10Gbps Lightpaths Tie Together
State and Regional Fiber Infrastructure
Interconnects Two Dozen State and Regional
Optical Networks
Internet2 Dynamic Circuit Network Under
Development
NLR 40 x 10Gb Wavelengths Expanding with
Darkstrand to 80
36
Linking the Calit2 Auditoriums at UCSD and UCI
with HD for Shared Seminars
September 8, 2009
September 8, 2009
Avoiding Travel Between Campuses
Photo by Erik Jepsen, UC San Diego
37
The OptIPuter Project Creating High Resolution
Portals Over Dedicated Optical Channels to
Global Science Data
Scalable Adaptive Graphics Environment (SAGE)
13.5M Over Five Years
Picture Source Mark Ellisman, David Lee, Jason
Leigh
Calit2 (UCSD, UCI) and UIC Lead CampusesLarry
Smarr PI Univ. Partners SDSC, USC, SDSU, NW,
TAM, UvA, SARA, KISTI, AIST Industry IBM, Sun,
Telcordia, Chiaro, Calient, Glimmerglass, Lucent
38
Rocks/CGLX OptIPortalUses OpenGL Hardware
Accelerated

• CGLX features
• Cross-Platform Hardware Accelerated Rendering
• Synchronized Multi-Layer OpenGL Context Support
• Distributed Event Management
• Scalable Multi Display Support

Source Kai-Uwe Doerr, Falko Kuester, Calit2
39
High Definition Video Connected
OptIPortalsVirtual Working Spaces for Data
Intensive Research
LifeSize HD
NASA Ames Lunar Science Institute Mountain View,
CA
NASA Interest in Supporting Virtual Institutes
Source Falko Kuester, Kai Doerr Calit2 Michael
Sims, NASA
40
Multi-User Global WorkspaceSan Diego, Chicago,
Saudi Arabia
Source Tom DeFanti, KAUST Project, Calit2