Overview and Summary of the EGI Blueprint Proposal

1
Overview and Summary of the EGI Blueprint Proposal

• Dieter Kranzlmüllercontact_at_eu-egi.org

2
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

3
Grid Stakeholders Today
onGrids
International Scientific and Research
Collaboration
FundingAgency 1
FundingAgency 2
FundingAgency N

4
Grid Stakeholders Today
International Scientific and Research
Collaboration
EuropeanProjects
NationalGridProjects
RegionalGridInstitution
LocalGridCommunity

FundingAgency 1
FundingAgency 2
FundingAgency N

5
Grid Users Today
EuropeanProjects
NationalGridProjects
RegionalGridInstitution
LocalGridCommunity

FundingAgency 1
FundingAgency 2
FundingAgency N

6
Grid Stakeholders Today
International Scientific and Research
Collaboration
EuropeanProjects
National GridProjects
RegionalGridInstitution
LocalGridCommunity

Funding Agency 1
FundingAgency 2
FundingAgency N

7
Grids in Europe
EGI Knowledge BasePlease upload your infosto
knowledge.eu-egi.eu
www.eu-egi.eu
8
Characteristics of NGIs

• Each NGI
• should be a recognized national body with a
  single point-of-contact
• should mobilize national funding and resources
• should ensure the operation of a national
  e-Infrastructure
• should support user communities (application
  independent, and open to new user communities and
  resource providers)
• should contribute and adhere to international
  standards and policies

EGI_DS Document Guidelines for NGIs(will be
updated and revised after Workshop)
9
Grid Stakeholders Today
International Scientific and Research
Collaboration
EuropeanProjects
National GridProjects
RegionalGridInstitution
LocalGridCommunity

Funding Agency 1
FundingAgency 2
FundingAgency N

10
Future Grid Stakeholders
International Scientific and Research
Collaboration
EuropeanGridProjects
NationalGridInitiative 1
NationalGridInitiative 2
NationalGridInitiative N

FundingAgency 1
FundingAgency 2
FundingAgency N

11
The first e-Infrastructure Call in FP7
Year 2009
Year 2008
Year 2007
Slide courtesy of Kyriakos Baxevanidis, EC
12
www.eu-egi.eu
Goal of EGI Design Study Conceptual setup and
operation of a new organizational model of a
sustainable pan-European grid infrastructure
13
Evolution
National
FutureEuropean Grid
Global
14
European Grid Initiative

• Goal
• Ensure the long-term sustainability of grid
  infrastructures in Europe by establishing a new
  federated model bringing together NGIs to build
  the EGI Organization
• Objectives
• Ensure the long-term sustainability of the
  European e-infrastructure
• Coordinate the integration and interaction
  between National Grid Infrastructures
• Operate the European level of the production Grid
  infrastructure for a wide range of scientific
  disciplines to link National Grid Infrastructures

15

• Ensure the long-term sustainability of the
  European e-infrastructure
• Coordinate the integration and interaction
  between National Grid Infrastructures
• Operate the European level of the production Grid
  infrastructure for a wide range of scientific
  disciplines to link National Grid Infrastructures
• Provide global services and support that
  complement and/or coordinate national services
  (Authentication, VO-support, security, etc)
• Coordinate middleware development and
  standardization to enhance the infrastructure by
  soliciting targeted developments from leading EU
  and National Grid middleware development
  projects
• Advise National and European Funding Agencies in
  establishing their programmes for future software
  developments based on agreed user needs and
  development standards
• Integrate, test, validate and package software
  from leading Grid middleware development projects
  and make it widely available
• Provide documentation and training material for
  the middleware and operations. (NGIs may wish to
  make the material available in turn in their
  local language)
• Take into account developments made by national
  e-science projects which were aimed at supporting
  diverse communities.
• Link the European infrastructure with similar
  infrastructures elsewhere
• Promote Grid interface standards based on
  practical experience gained from Grid operations
  and middleware integration activities, in
  consultation with relevant standards
  organizations
• Collaborate closely with industry as technology
  and service providers, as well as Grid users, to
  promote the rapid and successful uptake of Grid
  technology by European industry.

EGI Vision Paper http//www.eu-egi.eu/vision.pdf
16
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

17
Disclaimer

• These slides have been drafted based on the
  current version of the EGI Blueprint proposal
  (v1.2, 25 June 2008).
• The purpose of this blueprint is to assess a
  possible model for the future sustainable grid
  infrastructure in Europe.
• The aim of these slides is to support the
  discussions in the EGI Geneva Workshop (30 June
  2008).
• The EGI_DS project will modify this draft
  blueprint on the basis of feedback provided.

18
Purpose of EGI Blueprint proposal

• From Chapter 1. Introduction, p. 5
• The purpose of this blueprint is
• for NGI and other stakeholders
• to assess whether it meets their requirements,
• and if not
• to inform the design project of changes they
  would like.

19
Editorial Responsibilities

• From Chapter 1. Introduction, p. 5
• EGI Task Forces
• Operations (Leader J. Shiers)
• Middleware (Leader M. Mazzucato)
• User Support (Leader D. Cresti)
• Guidance from
• EGI_DS Management Board
• EGI_DS Workpackages

20
EGI Blueprint- Table of Contents

1. Introduction
2. Executive Summary
3. EGI, EGI Organisation, and NGIs
4. Transition Period
5. Functions of the EGI
6. Management of the EGI
7. Legal Aspects
8. Resources and Funding
9. Appendices

21
Terminology 1/3

• EGI
• all efforts to establish a sustainable and
  operational grid infrastructure in Europe
• EGI EGI.org NGIs
• NGI
• recognized national bodies ensuring the
  operations of the grid infrastructure in each
  country,
• including representation of requirements of the
  scientific community and the resource providers

22
Terminology 2/3

• EGI.org EGI Organization
• to facilitate interaction and collaboration
  between the NGIs
• to provide a common managerial framework of the
  pan-European grid infrastructure
• EGI Council
• the sole governing and decision making body for
  EGI
• EGI Advisory Board (AB) ? EGI Policy Board (PB)
  ? EGI Council

23
Terminology 3/3

• EGI Prep Team
• the consortium of the EU Project EGI_DS (European
  Grid Initiative Design Study)
• performs the conceptual setup and operation of
  the new organizational model ( EGI model) of a
  sustainable pan-European grid infrastructure as
  described in the EGI Vision.

24
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

25
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application Support and Training
• External functions

26
EGI Management Structure

• Political Bodies
• such as
• eIRG,
• EU,
• ESFRI,
• Ntl. Bodies,
• ...

EGI
EGI Council
Strategy Cttee
Advisory Committees
Director staff
CTO (Developments)
COO (Operations)
CAO (Admin. PR)
Dev. Group
Oper. Group
Adm.PR Group
EGI Organisation ? EGI.org
27
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application Support and Training
• External functions

28
EGI Grid Infrastructure

• should be
• a large-scale, production Grid infrastructure
• built on national grids that interoperate
  seamlessly at many levels,
• offering reliable and predictable services to a
  wide range of applications

29
EGI Operations Function

• Set of services
• all services from EGI.org and NGIs needed
• to ensure optimal functionality of the
  pan-European grid infrastructure and
• the overall seamless effective interoperation of
  national and regional grids
• Challenges
• Scalability, interoperation and promotion of
  autonomy

30
EGI Infrastructure
International Scientific and Research
Collaboration
EGI.org
European-level Grid Services
Middleware A
Middleware B
Middleware B
Middleware X
gLite
UNICORE
ARC
NationalGridInitiative 1
NationalGridInitiative 2
NationalGridInitiative N

31
EGI Operations EGI.org critical services NGI
international tasks
EGI.org critical services
NGI international tasks
NGI local tasks
EGI
EGI.org
NGI
NGI
NGI
NGI
NGI
32
EGI Operations

• Multi-level, distributed operation model
• Tasks

Manpower estimates for central operations at
EGI.org
EGI.org NGIs
Operations coordination Operation of Grid core services
Central repositories ticketing Grid oversight (shifts)
Security response coordination National security response
Resource allocation coordination National resource allocation
Coordination of MW rollout Monitoring of SLA compliance
Dashboard overview tool Site certification
Catch-all certification authority National grid portals

Activities FTEs
Operation of tools and services 6.5
User support 4.5
Coordination 3
Security 2
Total 16
33
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application Support and Training
• External functions

34
Middleware Challenges

• Smooth transition from todays situation
• Barrier-less Grid ? Towards a common certified
  solution
• High quality ? maximum competition within given
  budget
• Stability and dependability of services ?
  Conservative approach vs. innovation

35
EGI Infrastructure
International Scientific and Research
Collaboration
EGI.org
European-level Grid Services
Middleware A
Middleware B
Middleware B
Middleware X
gLite
UNICORE
ARC
NationalGridInitiative 1
NationalGridInitiative 2
NationalGridInitiative N

36
Proposed Approach

• Definition of a common middleware solution
• The Universal Middleware Toolkit (UMT)
• Definition of processes to provide stable
  solution
• Middleware development function as part of EGI
• Common policies, rules, quality and standard
  compliance criteria for UMT components
• Definition of processes to achieve highest
  quality
• Service/Component orientation, interface
  definition and standardization
• Testing and verification process under EGI
  control
• Definition of processes to satisfy users/NGI
  requirements
• Integrated development-deployment-feedback cycle

37
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application support and training
• External functions

38
Introduction
New Users How to attract them
Existing Users How to maintain them
GRID Environment Support

• Applications Support in EGI/NGI
• Day-by-day support is within the NGIs and many
  VOs operate over several NGIs
• Different middleware supported

Good operations procedures
Middleware developments
Good level of service
39
EGI Application Support

• In EGI, the NGI is the most visible organization
  to the user
• Mono-disciplinary and regional communities
  perfectly covered ? towards international and
  interdisciplinary collaboration
• Interdisciplinary applications
• International applications

40
EGI Application Support
Activities FTEs
Event Organization 4 FTEs
General Management 3 FTEs
Cluster coordination for current and new communities 7 (?) per SSC
Interfacing with operations 2-4 FTEs
Interfacing with middleware 2-4 FTEs
Central Repositories 2-4 FTEs
Training and Documentation 4 FTEs
41
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application support and training
• External functions

42
EGI External functions

• Dissemination
• To ensure visibility of EGI
• 2-3 FTEs for EGI.org and 0,5 FTE per NGI
• Industry take-up
• Collaboration with industry
• Carried out by the EGI.org management team
• Other external relations
• Policy and external liaison manager 1 FTE
  EGI.org
• Standardization liaison manager 1 FTE EGI. org

43
EGI Functionality Overview

• EGI.org management administration
• Operations
• Middleware interfaces and final certification
• Application support and training
• External functions

44
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

45
Future Grid Stakeholders
International Scientific and Research
Collaboration
EGI.org
European-level Grid Services
Middleware A
Middleware B
Middleware B
Middleware X
gLite
Globus
UNICORE
NationalGridInitiative 1
NationalGridInitiative 2
NationalGridInitiative N

46
NGI Guidelines

• Legal requirementsAn NGI must
• have the capacity to sign the Statutes of EGI.org
  or be represented by a legal structure which has
  the capacity to sign the Statutes and act in the
  name and on behalf of an NGI
• have a mandate to represent its national Grid
  community in all matters falling within the scope
  of EGI.org
• be the only organisation having the mandate
  described in (b) for its country and thus provide
  a single contact point at national level
• be able to commit to EGI.org financially i.e. to
  pay EGI.org membership fee and if there is a
  demand for such services in the NGI order
  EGI.org services and pay for these services.
• nominate a representative duly authorised to
  deliberate, negotiate and decide on all matters
  falling within the mandate of the EGI.org
  Council.
• have a sustainable structure or represented by a
  legal structure which has a sustainable structure
  in order to commit to EGI.org in the long term

47
NGI guidelines

• Technical responsibilitiesNGIs ensure that
• storage and computing resources (as well as
  baseline services to share and use them) are
  provided
• the national Grid Infrastructure is permanently
  operated and maintained to an agreed level of
  service
• user communities are registered and supported
• resource owners/providers are registered and
  supported
• standards and other consensus accepted by EGI (on
  supported middleware stacks for example) are
  implemented
• EGI policies are implemented

48
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

49
EGI Financial Model

• Long-term vision
• Management, funded through membership fees
• Operations, funded through usage charges
• Innovations, funded through co-funded grants (EC
  and others)
• Transition phase
• Strong support from EC required to establish EGI
  model and to keep it at the leading edge of
  technology
• Usage fees will not be introduced
• EGI.org Management, funded through membership
  fees
• Operations Innovations, funded through
  co-funded EC grant

50
EGI Funding Estimates
Nr. Costs for EGI.org Costs (in FTE/a) Intl. part of NGI Costs (in FTE/a)
1 Operations 16 250-300
2 Middleware interfaces and final certification 8 100-120
3 Application Support and training 7 230
4 External functions 4 60
5 EGI.org Management and Administration 10 90
Total 45 720-800
51
EGI Financial Proposal

• EGI.org Management, funded through membership
  fees
• Approx. 1 MEUR / year
• Distributed over countries per GDP (or other
  composed index)

52
EGI Financial Proposal

• Operations Innovations, funded through
  co-funded EC grant
• Approx. 20 MEUR / year (comparable to today)

53
EGI Financing

• EGI Costs during transition phase
• Membership fees 1 MEUR / year
• EC contribution 20 MEUR / year
• Periodic review every 3-5 years based on
• Usage
• Commercially available technologies
• Required innovation

54
EGI Financing NGI Responsibilities

• Each country continues to fund its own local
  infrastructure including national IT resources
  and user communities, and NGI management
• NGIs must ensure their own national funding
  required in addition to the funding from the EC
  for European integration.
• If the EC or the NGIs do not provide the funding
  planned, then the EGI cannot take place in the
  form proposed.

55
Contents

• Vision of EGI Reminder
• EGI Blueprint Overview
• Terminology (EGI, EGI.org and the NGIs)
• EGI Functions
• NGI Guidelines
• EGI Financial Model

56
EGI European Grid Initiative

• EGI Grid Infrastructure should
• be a large-scale, production Grid infrastructure
• built on national grids that interoperate
  seamlessly at many levels,
• offering reliable and predictable services to a
  wide range of applications
• The Future EGI.org represents the Glue between
  various grid communities in Europe and beyond
• EGI_DS requires your input to define required
  mechanisms and functionalities of the EGI.org

57
http//www.eu-egi.eu contact_at_eu-egi.eu