les robertson cernit 1

1
LHC Computing Grid ProjectGoals, Organisation
Status

• DoE / NSF Review of US LHC Computing
• Chicago, November 2001
• Les Robertson
• CERN - IT Division
• les.robertson_at_cern.ch

2

• The Project

3
The LHC Computing Grid Project
Goal Prepare and deploy the LHC computing
environment

• applications - tools, frameworks, environment
• computing system ? services
• cluster ? fabric
• collaborating computer centres ? grid
• CERN-centric analysis ? global analysis
  environment
• foster collaboration, coherence of LHC computing
  centres
• central role of data challenges

This is not yet another grid technology project
it is a grid deployment project
4
The LHC Computing Grid Project
Two phases

• Phase 1 2002-04
• Development and prototyping
• Approved by CERN Council 20 September 2001
• Phase 2 2005-07
• Installation and operation of the full world-wide
  initial production Grid
• Costs (materials staff) included in the LHC
  cost to completion estimates

5
The LHC Computing Grid Project
Phase 1 Goals

• Prepare the LHC computing environment
• provide the common tools and infrastructure for
  the physics application software
• establish the technology for fabric, network and
  grid management
• buy, borrow, or build
• Validate the technology and models by building
  progressively more complex Grid prototypes and
  operating data challenges for the experiments?
  Deploy a 50 model production GRID including the
  committed LHC Regional Centres

• Develop models for building the Phase 2 Grid?
  Produce a Technical Design Report for the full
  LHC Computing Grid
• Maintain reasonable opportunities for the re-use
  of the results of the project in other fields

50 of the complexity of one of the LHC
experiments
6
Time constraints
proto 1
proto 3
proto 2
continuing RD programme
prototyping
pilot technology selection
pilot service
system software selection, development,
acquisition
hardware selection, acquisition
1st production service
2001 2002
2003 2004
2005 2006
7
Areas of Work

• Applications Support Coordination
• Computing System
• Grid Technology
• Grid Deployment

8
Applications Support Coordination

• Application Software Infrastructure libraries,
  tools
• Object persistency, data management tools, data
  models
• Common Frameworks Simulation, Analysis, ..
• Adaptation of Physics Applications to Grid
  environment
• Grid tools, Portals

9
Computing System

• Physics Data Storage and Management
• Fabric Management
• LAN Management
• Wide-area Networking
• Security
• Internet Services

10
Grid Technology

• Grid middleware
• Scheduling
• Data Management
• Monitoring
• Error Detection Recovery
• Standard application services layer
• Inter-project coherence/compatibility

11
Grid Technology for the LHC Grid

• An LHC collaboration needs a usable, coherent
  computing environment a Virtual Computing
  Centre - a Worldwide Grid

• Already even in the HEP community - there are
  several Grid technology development projects,
  with similar but different goals

12
A few of the Grid Technology Projects

• Data-intensive projects with EU funding, HEP
  leadership
• DataGrid 21 partners, coordinated by CERN
  (Fabrizio Gagliardi)
• CrossGrid 23 partners complementary to DataGrid
  (Michal Turala)
• DataTAG funding for transatlantic demonstration
  Grids (Olivier Martin)
• European national HEP related projects
• GridPP (UK) INFN Grid Dutch Grid NorduGrid
  Hungarian Grid
• US HEP projects
• GriPhyN NSF funding HEP applications
• PPDG Particle Physics Data Grid DoE funding
• iVDGL international Virtual Data Grid
  Laboratory
• Global Coordination
• Global Grid Forum GGF Recommendations
• InterGrid ad hoc HENP Grid coordination (Larry
  Price)

13
Grid Technology for the LHC Grid

• How do we achieve and maintain compatibility,
  provide one usable computing grid for an
  experiment?
• architecture? api? protocols?
• while remaining open to external, industrial
  solutions

This will be a significant challenge for
the LHC Computing Grid
Project
14
Grid Deployment

• Data Challenges
• Grid Operations
• Integration of the Grid Physics Environments
• Network Planning
• Regional Centre Coordination
• Security access policy

15

• Organisation

16
The LHC Computing GridProject Structure
LHCC
CommonComputingRRB
Reviews
The LHC Computing Grid Project
Resource Matters
Reports
Project Overview Board
Project Manager ProjectExecutionBoard
Software andComputingCommittee(SC2)
Requirements, Monitoring
implementation teams
17
The LHC Computing GridProject Structure
LHCC
CommonComputingRRB
Reviews
The LHC Computing Grid Project
Resource Matters
Reports
Project Overview Board
OtherComputingGridProjects
Project Manager ProjectExecutionBoard
Software andComputingCommittee(SC2)
Requirements, Monitoring
Other HEPGridProjects
implementation teams
Other Labs
18
The LHC Computing GridProject Structure
LHCC
CommonComputingRRB
Reviews
Project Overview BoardChair CERN Director for
Scientific ComputingSecretary CERN IT Division
Leader MembershipSpokespersons of LHC
experimentsCERN Director for CollidersRepresent
atives of countries/regions with Tier-1 center
France, Germany, Italy, Japan, United Kingdom,
United States of America4 Representatives of
countries/regions with Tier-2 center from CERN
Member StatesIn attendanceProject LeaderSC2
Chairperson
The LHC Computing Grid Project
Reports
Resource Matters
Project Overview Board
Project Manager ProjectExecutionBoard
Software andComputingCommittee(SC2)
Requirements, Monitoring
implementation teams
19
The LHC Computing GridProject Structure
LHCC
CommonComputingRRB
Reviews
Software and Computing Committee
(SC2)(Preliminary) Sets the requirements Approves
the strategy workplan Monitors progress and
adherence to the requirements Gets technical
advice from short-lived focused RTAGs
(Requirements Technology Assessment
Groups) Chair to be appointed by CERN Director
GeneralSecretary Membership2 coordinators
from each LHC experiment Representative from CERN
EP Division Technical Managers from centers in
each region represented in the POBLeader of the
CERN Information Technology DivisionProject
LeaderInvited POB Chairperson
The LHC Computing Grid Project
Reports
Resource Matters
Project Overview Board
Project Manager ProjectExecutionBoard
Software andComputingCommittee(SC2)
Requirements, Monitoring
implementation teams
20
The LHC Computing GridProject Structure

• Project Execution BoardGets agreement on
  milestones, schedule, resource allocation
• Manages the progress and direction of the project
  
• Ensures conformance with SC2 recommendations
• Identifies areas for study/resolution by SC2
• Membership (preliminary POB approval required)
• Project Management Team
• Project Leader Area Coordinators
• Applications
• Fabric basic computing systems
• Grid technology - from worldwide grid projects
• Grid deployment, regional centres, data
  challenges
• Empowered representative from each LHC
  Experiment
• Project technologist/architect
  Resource manager
• Leaders of major contributing teams
• Constrain to 1518 members

LHCC
CommonComputingRRB
Reviews
The LHC Computing Grid Project
Reports
Resource Matters
Project Overview Board
Project Manager ProjectExecutionBoard
Software andComputingCommittee(SC2)
Requirements, Monitoring
implementation teams
21

• Status

22
Funding of Phase 1 at CERN

• Funding for RD activities at CERN during
  2002-2004 partly through special contributions
  from member and associate states -

• Austria, Belgium, Bulgaria, Czech Republic,
  France, Germany, Greece, Hungary, Israel, Italy,
  Spain, Switzerland, United Kingdom
• Industrial funding CERN openlab Intel,
  Enterasys, KPNQwest

• European Union Datagrid, DataTag further
  possibilities (FP6)
• Funded so far - all of the personnel, 40 of
  the materials
• Discussions with other countries

23
Status of Funding Agreements
24
Experiment members
25
PEB other core members

• Computer Systems
• Wolfgang von Rüden
• Grid Technology
• Fabrizio Gagliardi
• Applications
• in discussion with an excellent candidate
• Data challenges, Grid operation, Regional Centres
• Discussing splitting the job into operation and
  high level RC policy issues
• Some candidates under discussion
• Resource manager
• Chris Eck
• Administration
• Miguel Marquina
• CTO
• under discussion

26
US Representation

• Significant US investment in
• Regional centres
• Grid technology
• Applications
• Formal representation in POB, SC2
• Collaborations present in all committees
• How can US efforts be most effectively
  represented in the PEB?

27
Project Startup

• Collaborations have named their representatives
  in the various committees
• First pre-POB meetings being scheduled will not
  be fully populated
• PEB 23 November
• SC2 beginning of December?
• Kick-off workshop in February?