Grid Power (to the People)

1
Grid Power(to the People)

• Scott Lathropscott_at_ncsa.uiuc.eduAN-MSI Meeting
• February 26, 2002

2
Overview

• What is computational science?
• What is supercomputing?
• What is the GRID?
• EOT-PACI Programs and Activities
• NPACI and Alliance All Hands Meetings
• National Computational Science Institute (NCSI)
• Join the HPC Community at SC2002!

3
What is Computational Science?
Interdisciplinary Research and Education
4
21st Century Science Engineering

• The three fold way
• theory
• experiment
• computational simulation
• Supported by
• multimodal collaboration systems
• distributed, multi-petabyte data archives
• leading edge computing systems
• distributed experimental facilities
• internationally distributed multidisciplinary
  teams
• Collectively defining a new future
• creation of 21st century IT infrastructure
• sustainable, multidisciplinary communities

Simulation
Experiment
Theory
Source Dan Reed, NCSA
5
Science and Engineering Opportunities
NVO and ALMA
Climate Change
ATLAS and CMS
LIGO
The number of nation-scale projects is growing
rapidly!
6
Some 2010 Visions

• Multilevel biological modeling
• from molecules and structures to organisms and
  ecologies
• petascale systems and beyond
• Personalized, in situ medicine
• drug design tailored to individual DNA with
  embedded micro-transfusers
• Distributed, virtual astronomy
• real-time data analysis and multi-modal data
  fusion from distributed archives
• High-energy physics/cosmology fusion
• dark matter, the standard model, and the theory
  of everything
• Integrated climate change urban/social planning
• multidisciplinary data fusion, modeling, and
  analysis

To see the universe in a grain of sandAnd
heaven in a wildflower,Hold infinity in the palm
of your hand And eternity in an
hour. William Blake
7
Emerging Application Attributes

• Emerging scientific application characteristics
• remote instruments (large and small)
• virtual organizations
• terabytes to petabytes of data
• data unification and fusion
• high-end computation
• results presentation
• We must add maximal value via
• resource access without regard to location
• access to remote instruments and sensors
• mining of distributed data archives
• coupling of individuals, groups, and resources
• recognizing disparate reward metrics
• This is the PACI and TeraGrid mandate and vision

Source Dan Reed, NCSA
8
The PACI TeraGrid Blazing A Trail
Internet circa 1969
Internet circa 1999
9
What is the Grid?

• Computational Grid supports
• access to digital libraries, distributed
  computing resources, and modeling and
  visualization tools
• calculations on distributed high performance
  systems
• Access Grid supports
• large-scale distributed meetings, collaborative
  work sessions, seminars, lectures, tutorials, and
  training
• multimedia displays, presentation and
  interactions environments, and interfaces to
  visualization environments

10
From Leading Edge to Consumer Electronics
What is Supercomputing?
1985
Cray X-MP 1.2Gflop Cost8,000,000 60,000 watts
of power No Built in Graphics 56 kbps NSFnet
Backbone
2002 Playstation 2 6.2 Gflops
Cost 299 10 watts of power
3D Graphics (66M P/S) (HS ethernet)
Source Larry Smarr, NCSA
National Center for Supercomputing Applications
National Computational Science
11
The High-Performance Conundrum

• The conundrum
• large NRE costs
• particularly software
• modest size markets
• TMC, KSR, Cray, SGI,
• NCSAs previous vendors
• almost all RIP
• Implications
• 1980s-1990s market shakeout
• limited base to amortize software costs
• Rescue
• open source
• commodity clusters

1980s
Expansion
1990s
Shakeout
2001
12
The Computing Continuum
Tightly Coupled
Loosely Coupled
Clusters
SETI
SMPs
Grids

• Each strikes a different balance
• computation/communication coupling
• Implications for execution efficiency

13
Why Linux Clusters and IPF?

• Everyone is building them
• application scientists
• inexpensive computation engines
• computer scientists
• software and system research vehicles
• NCSA experiences with IBM
• two terascale Linux clusters (stay tuned)
• Thriving open source community
• community code development
• applications, system software, and tools
• vendor support
• Itanium processor family (IPF)
• IA-32 successor with market penetration
• excellent floating point performance

Similar ad campaigns for other vendors
14
PACI Terascale Clusters

• 1 TF IA-32 Pentium III cluster (Platinum)
• 512 1 GHz dual processor nodes
• Myrinet 2000 interconnect
• 5 TB of RAID storage
• 41 on November 2001 Top500 list, 594 GF
• 1 TF IA-64 Itanium cluster (Titan)
• 164 800 MHz dual processor nodes
• Myrinet 2000 interconnect
• 34 on November 2001 Top500 list, 678 GF
• Breakthrough calculations on both
• molecular dynamics (Schulten)
• first nanosecond/day calculations
• gas dynamics (Woodward)
• others underway
• NCSA clusters provide lessons for
• TeraGrid deployment
• community clusters

• NCSA machine room expansion
• capacity to 100 TF and expandable
• dedicated September 5, 2001

15

• Created by Argonne
• Over 70 global sites
• On-line tutorials

http//webct.ncsa.uiuc.edu8900/public/AGIB/
16
Some AG Nodes
17
Scalable Display Walls

• Large format with human scale
• commodity components
• projectors, Linux cluster, cheap frames
• high resolution (8192 x 3840 pixels)
• now doubling in size

18
Alliance X-in-a-Box Initiatives

• Access Grid
• Stevens/Childers (ANL)
• Display Wall
• Baker (NCSA)
• Clusters
• OSCAR/Pennington (NCSA)
• http//oscar.sourceforge.net
• http//www.ncsa.uiuc.edu/TechFocus/Deployment/CiB/
  index.html
• Grid
• Butler (NCSA) and Foster (ANL)
• Data
• Welge/Folk (NCSA)
• Applications
• Crutcher (NCSA)

19
The Grid Is the Force
Connecting PACI and the national community to
address community needs

• Opportunity the grid can empower
  underrepresented communities and individuals to
  make dramatic and rapid strides forward!
• The dark side (default)the power of the grid
  will amplify existing inequities!

20
EOT-PACIEducation Outreach and Training
Partnership for Advanced Computational
Infrastructure
21
Creation of EOT-PACI

• The Education, Outreach and Training aspects of
  each of the two PACI awardees is an example of an
  area where the combined efforts of both
  partnerships will be coordinated into a
  Program-wide activity which will have stronger
  national impact.

22
EOT-PACI Mission Goals

• MissionTo develop human resources to understand
  and solve problems through the innovative use of
  emerging technologies.

• Demonstrate the use of NSF PACI technologies and
  resources among diverse audiences by leveraging
  NSF PACI thrust/team efforts.
• Increase participation of underrepresented
  groups, including persons with disabilities, in
  computer science and engineering, information
  technology, and NSF PACI.
• Enable broad national impact in education,
  government, science, business, and society with
  systemic, sustainable, scalable programs.

23
EOT-PACI Organization
EOT-PACI is a partnership of 30 national
organizations.
24
Success built on commitment to

• Strength in diversity
• High standards for projects
• Sharing resources and knowledge
• Open and frequent communication
• Project support, evaluation, and scaling
• Whole is greater than sum of its parts

25
Strategies for Success

• Evaluate EOT-PACIs
  efforts and strategies
• Create a bridge between
  scientific research and educational applications
• Build collaborations with people outside EOT-PACI

26
LEAD Center evaluates EOT to

• Provide key EOT projects with assessments and
  feedback
• Share projects successful strategies and
  perceived obstacles
• Support projects' national visibility and scaling
  to other sites
• Guide efforts by regularly reflecting upon our
  overarching goals and strategies
• Develop metrics to measure progress of all
  individual projects

27
EOT-PACI projects evaluated

• Distributed Mentor Project
• Spend a Summer with a Scientist program
• GirlTECH program
• Girls Are GREAT program
• eTEACH application in CS curriculum reform
• Education Center on Computational Science and
  Engineering
• Graduate Engineering Research Scholars program
  (SaS scale-up)
• EOT-NPACIs efforts to form collaborations with
  NPACIs Alpha Projects

28

• EOT-PACI in Action

29
Educating Educators Educators

• Modeling and Visualization in Teacher Preparation
  and Certification Programs
• High Leverage, High Impact K-12/(UG)
• Teams organized and built by EOT-PACI partners
• Support from NSF,
  DoED, State/Local

30
Building Active Partnerships

• Gender Equity and Technology
• Evaluation of GirlTech Program
• Basis for scaling
• TeacherTech
• Scaled-up in 2001/2002 Houston, Boston, San
  Diego, Chicago, Washington DC

31
Science and Education Bridges

• Authentic Science Tools in Education
• Biology Workbench
• Inquiry-based Science
• Envison, Explore, Engage CD
• People
• SCXY Programs Education, Participation

32
Building Collaborations

• Advanced Networking with MSIs
• EDUCAUSE/EOT-PACI supported by NSF
• CRA-W and CDC
• Tapia Symposium
• Girl Scouts

33
EOT-PACI/AN-MSI

• The overarching goal of EOT-PACI sponsored events
  within AN-MSI is to foster collaborative
  relationships between faculty and administrators
  at participating MSIs and computational research
  scientists at research centers, thus increasing
  awareness and exposure to relevant and current
  HPC technologies as well as increasing
  computational science research and education at
  MSIs.

34
EOT-PACI/AN-MSI Activities

• GridForum participation
• AG node deployment
• HPC Cluster workshops
• Regional Cluster Workshops
• SC Minority Participation Program
• PACI All Hands meetings

35
The EOT-PACI Impact

• The EOT-PACI mission recognizes that people are
  at the center of our highly complex technological
  and scientific world.
• EOT-PACI's dedication to this mission grows as we
  witness the positive results of our efforts.

36
PACI All Hands Meetings

• NPACI March 6-8 in San Diego
• CDC and CRA-W meetings
• EOT-PACI March 9
• AN-MSI Cluster Workshop March 10
• Alliance May 8-10

37
National Computational Science Institute
To introduce the hands-on use of computational
science, numerical models, and data visualization
tools across the undergraduate curriculum.
The Shodor Education Foundation, Inc. The
National Science Foundation
38
What will NCSI do?

• Offer an expanded set of in-person,
  video-conferenced, and web-accessible workshops,
  seminars, and support activities.
• With supplemental funding, NCSI plans to offer
  computational science workshops and sponsor
  educational activities for in-service teachers,
  business and government leaders, and the general
  public.
• NCSI participants will then assist others on
  their own campuses and at neighboring
  institutions to introduce computational science
  in their own classes.

39
PULL Workshops
NCSI will conduct regionally distributed
workshops to PULL faculty for a week of intense
interdisciplinary training, collaboration, and
curriculum development in computational science.

• Participants will
• Explore the use of modeling and visualization
  tools in existing courses
• Stimulate the creation of new courses and
  promoting new modes of undergraduate research

40
PUSH Activities
NCSI will Proactively PUSH computational science
and computational science education onto the
agendas of professional and discipline-specific
societies.

• This will be accomplished by
• offering workshops
• conducting tutorials
• presenting papers and posters
• serving on program committees

41
PERMEATE Courseware
To sustain these efforts, NCSI will PERMEATE
on-going and proposed undergraduate curriculum
efforts by

• Providing interdisciplinary and discipline
  specific web-accessible courses for faculty
  enhancement
• Provide resource for interactive exploration
  including an interactive curriculum,
  problem-based modeling modules, tools, and
  tutorials, leveraging Shodors award-winning
  Computational Science Education Reference Desk.

42
NCSI Partnerships

• Education, Outreach and Training Partnership for
  Advanced Computational Infrastructure (EOT-PACI)
• North Carolina Super Computing Center (MCNC)
• Burroughs Wellcome Fund
• High Performance Systems, Inc.
• Fujitsu, CAChe Group
• National Computational Science Education
  Consortium (NCSEC)
• Sigma Xi
• Over a dozen academic institutions and high
  performance computing centers

43
NCSI 2002 Workshops

• 26 May - 1 June Orientation for Instructors ,
  Appalachian State University, NC
• 2 June - 8 June Appalachian State University, NC
• 16 June - 22 June Ohio Supercomputer Center,
  Ohio State University, OH
• 23 June - 29 June Oregon State University, OR
• 14 July - 20 July San Diego State University, CA
• 21 July - 27 July Rochester Institute of
  Technology, NY
• 28 July - 3 August Texas AM at Corpus Christi,
  TX
• 16 November - 22 November SC2002, Baltimore, MD
• Register at www.computationalscience.net

44
For More Information

• Dr. Robert M. Panoff, Director
• The Shodor Education Foundation, Inc.
• 923 Broad Street, Suite 100
• Durham, NC 27705
• Phone [phone]
• Fax [phone]
• www.computationalscience.net

45
Baltimore Maryland, November 16-22
www.sc-conference.org/sc2002
46
15th Annual SC Conference

• Building on the past 14 years
• Technical Program
• Papers, Invited Speakers, Tutorials, Posters,
  Panels, BOFs,
• Exhibits
• Education Program
• Activities, Competitions, Awards
• SC Global / SciNet
• to provide an exceptional experience for
  attendees and exhibitors

47
SC 01 MSI Participants

• Funding provided by SC Sponsors IEEE and ACM for
  approximately 30 MSI Participants.
• www.sc-conference.org/sc2002

48
Share the Vision of HPCs Impact

• Networking Computing Data

Display Wall Demo
49
SC2002 as a Data Space

• Global network linkage
• Terascale Distributed Computing
• Ubiquitous Sensors Devices

50
Participate in the Community!

• Attendees
• Industry, Scientists, Engineers, Educators,
  Students, Policy Makers
• Exhibitors
• Industry
• Research

51
SC2002 Education Program

• Teams of educators
• Teams of 2 to 6 undergraduate faculty whose
  students are next generation of scientists,
  engineers and/or K-12 teachers
• K-12 teachers are welcome to be members of these
  teams
• Faculty from two- and four-year colleges,
  primarily undergraduate institutions, and
  minority serving institutions are encouraged to
  participate
• Apply at
  www.sc-conference.org/sc2002/education

52
SC Opportunities for Faculty

• Attend SC technical sessions, papers, panels, etc
• Participate in Research Exhibits booth or
  Academic Village booth
• Faculty and Students may present
• Research round-table sessions

53
SC Opportunities for Students

• Student Volunteer Program
• Students volunteer for 20-25 hours
• Students receive free registration, housing, most
  meals, goodies
• Students cover own travel costs
• Student Days (Wed and Thurs)
• Students learn about career opportunities in
  education, research and industry
• Students participate in presentations and
  discussions

54
Building the future of High Performance Computing

• is what you can help make happen on your
  campuses.

55
Some Resources
PACI www.paci.org (NSF portal)www.eot.org (EOT-PACI)
SC2002 www.sc-conference.org/sc2002
AN-MSI www.anmsi.org
iAAEC www.iaaec.org
AccessGrid www.accessgrid.org
Gridforum www.gridforum.org
NCSI www.computationalscience.net
56
EOT-PACI/AN-MSI Sponsored Activities

• EOT-PACI/AN-MSI has reached 39 institutions and
  120 people since 1999. EOT-PACI outreach has
  occurred through PACI activities, meetings,
  workshops, conferences and discussions.

57
Participants from Hispanic Serving Hispanic
Serving (8)

• University of Houston-Downtown
• Florida International University
• University of Texas at El Paso
• University Puerto Rico Mayaquez
• California State University San Bernardino
• Our Lady of the Lake University
• Lehman College/CUNY
• California State University-LA

58
HBCU 20

• Florida AM University
• Dillard University
• Bethune-Cookman College
• Clark Atlanta University
• Jackson State University
• Prairie View AM University
• North Carolina AT State University
• Morehouse College
• Spelman College
• Morris Brown College

• The Morehouse School of Medicine
• Interdenominational Theological Center
• Morgan State University
• Florida AM University
• Emory University
• Howard University
• Norfolk State University
• Langston University
• Winston-Salem University
• Rust College

59
Tribal Colleges 11

• Northwest Indian College
• Fond du Lac Tribal Community College
• Little Priest Tribal College
• Fort Belknap College
• Blackfeet Community College
• Lac Courte Oreilles Ojibwa Community College
• Northwest Indian College
• Salish Kootenai College
• Sinte Gleska University
• Oglala Lakota College
• White Earth Tribal Community College
•  

60
SC 2001 MSI Participation Grant Program

Awarded 30 SC01 MSI Grants

HBCU 18
HSIs 8
TCU 4
61
SC MSI Activities

• General Program
• BOFs
• Grid Power to the People
• Increasing MSI Participation in HPC
• Reception

62
Winston-Salem State University Supercomputing
Conference

What ANMSI and EOT are doing is giving me a
national platform to understand these issues and
the clout to pursue them. Joyce
Williams-Green, CIO
63
SC01 MSI Reception
64
SC2002

• Roscoe Giles Conference Chair
• -Baltimore, MD
• -November 16-22, 2002
• SC02 Goal
• - Increase participation of underrepresented
  groups from ALL IHEs

65
2002 Regional Cluster Workshops
Targeted Audience Beginners from MSI
Community Number of Workshops Three Dates
March 6-9 April 11-12 September
28-29 Locations San Diego, CA Seguin, TX
Atlanta, GA URL http//accessinclusion.ncsa.uiu
c.edu/MSI/
66
The Power of Cluster Computing

• The world of supercomputing is no longer an
  exclusive club for those who have the resources
  to purchase a supercomputer and the hands-on
  experience provided at the spring conference
  has served to bring home the notion that We can
  do it too
• Mark Trebian,
• Lac Courte Ojibwa Community College

67
Regional Cluster Computing Workshops

• HPC Computing Basics

• Hands On

68
Workshop Participants for March

• Winston Salem University
• Azeez Aileru Michelle Lister-Glen
• California State University-LA
• Colin Campbell Raj S. Pamula
• Hampton University
• Eduardo Socolovsky
• Lehman College of CUNY
• Jason Ling Robert Schneider

• White Earth Tribal and Community College
• Pamela Snetsinger Tim Diehl
• Rust College
• Sana Sise Roderick Mabry
• Oglala Lakota College
• Anthony Brave Brett Bump
• North Carolina AT State University
• Stephen Providence

69
We Need Your Help!

• There has been only 4 people signed up for the
  Seguin, TX workshop. Deadline is Monday.
• Proposed Alternative
• Alliance All Hands Meeting May 8-10
• Cluster Workshop May Champaign, ILL NCSA

70
2002-2003 Program Activities

• Regional Cluster Workshops
• SC 02 Minority Participant Grant
• AN MSI Cluster
• AN MSI Cluster Help Desk
• AN MSI Cluster in a Suitcase
• AN MSI Cluster Tutorial CD-Rom
• Human Resource Development
• Deploy AG Nodes
• HPC Initiatives
• Expand HPC capacity at minority institutions.

End of Grant August 31, 2003
71
Some Resources
PACI www.paci.org (NSF portal)www.eot.org (EOT-PACI)
SC2002 www.sc-conference.org/sc2002
AN-MSI www.anmsi.org
iAAEC www.iaaec.org
AccessGrid www.accessgrid.org
Gridforum www.gridforum.org
NCSI www.computationalscience.net