EGEE Project

1
EGEE Project

• Goals, Status and Application Support

Aleksander Kusznir, Tomasz Szepieniec, Andrzej
Oziemblo, Marcin Radecki
2
Agenda

• EGEE Project
• Cyfronet in EGEE
• Application support

3
The EGEE project brings together experts from 70
organisations and 27 countries with the common
aim of building on recent advances in grid
technology and developing a service grid
infrastructure in Europe which is available to
scientists 24 hours-a-day. The project aims to
provide researchers in academia and industry with
access to major computing resources, independent
of their geographic location. The EGEE project
will also focus on attracting a wide range of new
users to the grid.

• The project will primarily concentrate on three
  core areas
• The first area is to build a consistent, robust
  and secure grid network that will attract
  additional computing resources.
• The second area is to continuously improve and
  maintain the middleware in order to deliver a
  reliable service to users.
• The third area is to attract new users from
  industry as well as science and ensure they
  receive the high standard of training and support
  they need.
• The grid will be built on the EU Research Network
  GÉANT and exploit grid expertise generated by
  many EU, national and international Grid projects
  to date.

4
Funded by the European Commission, the EGEE
project community has been divided into 12
partner federations, consisting of 70 partner
institutions and covering a wide-range of both
scientific and industrial applications. Two pilot
application domains have been selected to guide
the implementation and certify the performance
and functionality of the evolving infrastructure.
One is the Large Halidron Collider Computing Grid
supporting physics experiments and the other is
Biomedical Grids, where several communities are
facing equally daunting challenges to cope with
the flood of bioinformatics and healthcare data.
With funding of over 30 million Euro from the
European Commission, the project is one of the
largest of its kind. EGEE is a two-year project
concieved as part of a four-year programme, where
the results of the first two years will provide
the basis for assessing subsequent objectives and
funding needs.
5
Project Director, Fabrizio Gagliardi, said
"EGEE will make grid technology available on a
regular and reliable basis to all European
science, as well as Research and Development.
Like the World Wide Web, which was initially
developed for specialised scientific purposes,
the impact of the emerging Grid technology on
European society is difficult to predict at this
stage but is likely to be huge."
6
The EGEE Vision EGEE aims to integrate current
national, regional and thematic Grid efforts, in
order to create a seamless European Grid
infrastructure for the support of the European
Research Area. This infrastructure will be built
on the EU Research Network GEANT and exploit Grid
expertise that has been generated by projects
such as the EU DataGrid project, other EU
supported Grid projects and the national Grid
initiatives such as UK e-Science, INFN Grid,
Nordugrid and US Trillium. The EGEE vision is
that this Grid infrastructure will provide
European researchers in academia and industry
with a common market of computing resources,
enabling round-the-clock access to major
computing resources, independent of geographic
location. The infrastructure will support
distributed research communities, including
relevant Networks of Excellence, which share
common Grid computing needs and are prepared to
integrate their own distributed computing
infrastructures and agree common access policies.
The resulting infrastructure will surpass the
capabilities of localised clusters and individual
supercomputing centers in many respects,
providing a unique tool for collaborative
computer-intensive science (e-Science) in the
European Research Area. Finally, the
infrastructure will provide interoperability with
other Grids around the globe, including the US
NSF Cyberinfrastructure, contributing to efforts
to establish a worldwide Grid infrastructure.
7
The scope of the project is illustrated in Fig. 1.
Schema of the evolution of the European Grid
infrastructure from two pilot pplications in high
energy physics and biomedical Grids, to an
infrastructure serving multiple scientific and
technological communities, with enormous computer
resources. The applications and resource figures
are purely illustrative. The EGEE project covers
Year 1 and 2 of a planned four year programme.
8
The EGEE Mission
In order to achieve the vision outlined above,
EGEE has a three-fold mission 1. To deliver
production level Grid services, the essential
elements of which are manageability,
robustness, resilience to failure, and a
consistent security model, as well as the
scalability needed to rapidly absorb new
resources as these become available, while
ensuring the long-term viability of the
infrastructure. 2. To carry out a professional
Grid middleware re-engineering activity in
support of the production services. This will
support and continuously upgrade a suite of
software tools capable of providing production
level Grid services to a base of users which is
anticipated to rapidly grow and diversify. 3. To
ensure an outreach and training effort which can
proactively market Grid services to new research
communities in academia and industry, capture new
e-Science requirements for the middleware and
service activities, and provide the necessary
education to enable new users to benefit from the
Grid infrastructure. Reflecting this three-fold
mission, the EGEE proposal is structured in three
main areas of activity services, middleware and
networking. These are described in the sections
SA, JRA and NA of the proposal, respectively, and
key aspects for each of these areas are
summarised below.
9
It is essential to the success of EGEE that the
three areas of activity should form a tightly
integrated Virtuous Cycle, illustrated in Fig.
2.
The Virtuous Cycle for EGEE development. A new
scientific community makes first contacts to EGEE
through outreach events organized by Networking
Activities. Follow-up meetings by applications
specialists may lead to definition of new
requirements for the infrastructure. If approved,
the requirements are implemented by the
Middleware Activities. After integration and
testing, the new middleware is deployed by the
Service Activities. The Networking Activities
then provide appropriate training to the
community in question, so that it becomes an
established user. Peer communication and
dissemination events featuring established users
then attract new communities.
10
Fig. 3. Distribution of Service Activities over
Europe. The symbols illustrate regional
distribution and do not reflect precise
geographical location of activities. The
structure of the Grid services will comprise
EGEE Operations Management at CERN EGEE Core
Infrastructure Centres in the UK, France, Italy,
Russia (PM12) and at CERN, responsible for
managing the overall Grid infrastructure
Regional Operations Centres, responsible for
coordinating regional resources, regional
deployment and support of services. Specifics of
the roles and responsibilities of these centres
are included in the SA1 description.
11
The deployment, operation and support of the
Grid-empowered infrastructure is the objective of
the dominant service activity, SA1, which clearly
describes the roles and responsibilities of the
centres in the above layers. The management
structure that binds these centres together with
the Network Resource Provision activity SA2 is
illustrated in Fig. 4. By ensuring that a single
manager in the Project Executive Board has
coverview and responsibility for all Service
activities, a high degree of coordination and
consistent decision making can be ensured.
12
The key objectives of this activity are 1.
Core Infrastructure services to operate a set of
essential services, such as the information
services, resource brokers, data management
services, and administration of the virtual
organisations, that bind distributed resources
into a coherent infrastructure. 2. Grid
monitoring and control to proactively monitor
the operational state of the Grid and its
performance, initiating corrective action to
remedy problems arising with either Core
Infrastructure or Grid resources. 3. Middleware
deployment and resource induction to validate
middleware releases and then to deploy them on
Resource Centres throughout the Grid. Strict
criteria will be placed on validating new
middleware before production deployment. This
will involve close interaction and feedback with
the middleware engineering activity (JRA1) and
the applications (NA4). Where new Resource
Centres are to be incorporated into the Grid,
assistance must be provided both in middleware
installation and introduction of operational
procedures at Resource Centres. Extra effort will
be required to Resource Centres offering
resources such as parallel and vector
supercomputers that play strategic roles in a
number of scientific fields.
13
4. Resource and user support to receive,
respond to and coordinate the resolution of
problems with Grid operations from both Resource
Centres and users this role will filter and
aggregate problems, providing solutions where
known, and engaging Core Infrastructure or
Middleware Engineering or other appropriate
experts to resolve new problems. 5. Grid
management to co-ordinate the fulfilment of the
above objectives by Regional Operations Centres
(ROC) and Core Infrastructure Centres (CIC),
together with managing the relationships with
resource providers, through negotiation of
service-level agreements, and the wider Grid
community, through participation in liaison and
standards bodies. 6. International
collaboration to drive collaboration with peer
organisations in the U.S. and in Asia-Pacific to
ensure the interoperability of grid
infrastructures and services in order that the
EGEE user communities that are frequently
international with wider membership than the EGEE
partners are able to seamlessly access resources
both within and outside those provided through
EGEE.
14
European added value and impact Thanks to
preliminary successes of EU-funded projects
(DataGrid, DataTAG, CrossGrid), several
scientific communities have gained experience
with Grid technologies. One of these, the HEP
community, has decided to base the future
computing infrastructure of its largest
scientific enterprise, the LHC programme,
exclusively on Grid technologies. The impact of
the successful first intensive production use of
the Grid infrastructure by the LHC experiments
will help pave the way for adoption of this
infrastructure by other major scientific
disciplines and eventually industry and commerce,
with potentially very large benefits for European
science and technology. As illustrated in the
Figure below, EGEE will benefit initially from
LCG, and once the European Grid infrastructure is
established, it will in turn support a wide
variety of user communities.
15
Fig. 5. Timeline showing the evolving
relationship between DataGrid, LCG and EGEE.
DataGrid is supplying middleware to LCG in 2003.
In 2004, LCG will provide operations and
resources to EGEE. Over the four-year programme
envisaged in this proposal, EGEE will shift to be
operations and resource provider to a number of
virtual organisation, of which LCG will represent
a subset.
16
EGEE KEY STAFF

• Fabrizio Gagliardi, PROJECT DIRECTOR
• A Technical Director will be in charge of the
  overall coordination of the various technical
  activities (each of these activities will deploy
  their own internal technical management
  structure) and will act as Deputy Project
  Director. Dr. Robert Jones has been designated
  for this position.
• An Operations manager will be in charge of the
  overall operation of the EGEE Grid
  infrastructure. In the first phase of the project
  this role will be performed by the LCG Operations
  manager. Dr. Ian Bird has been designated for
  this position.
• A Middleware manager supervising the Middleware
  re-engineering and coordinating the middleware
  activities in the middleware clusters. Mr.
  Frederic Hemmer has been designated for this
  position
• A Quality Engineer Head responsible for overall
  quality assurance across all activities of the
  project. Mr. Gabriel Zaquine has been designated
  for this position.
• A Security Head responsible for overall grid
  security aspects across the middleware
  re-engineering and grid operations activities of
  the project. Mr. Fredrik Hedman has been
  designated for this position.
• The Manager of the dissemination, outreach,
  training activities. Prof. Malcolm Atkinson has
  been esignated for this position.
• An Application manager responsible for
  representing all the application domains that
  make use of the grid infrastructure. Dr. Guy
  Wormser has been designated for this position.
• A Network Head responsible for network provision
  and developments for the grid infrastructure. Mr.
  Franck Bonassieux has been nominated for the
  position.

17
Agenda

• EGEE Project
• Cyfronet in EGEE
• Application support

18
Struktura EGEE
EGEE
Special Activity 1
19
Central Europe Federation

• 11 RC (Resource Center)
• Polska CYFRONET, ICM, PSNC
• Austria UIBK, GUP
• Czechy CESNET
• Slowacja II-SAS
• Slowenia JSI
• Wegry KFKI-RMKI, MTA SZTAKI, NIIF
• rozproszony ROC (Regional Operations Center)
• Cyfronet, ICM, PCSS

20
Central Europe ROC

• Cyfronet, Kraków
• przewodniczenie M1-8
• wprowadzanie nowych RC do EGEE
• udzial w testowaniu middleware
• ICM, Warszawa
• przewodniczenie M9-16
• support dla uzytkowników
• udzial w testowaniu middleware
• PCSS, Poznan
• przewodniczenie M17-24
• support dla administratorów
• udzial w testowaniu middleware

21
EGEE w Cyfronecie

• Aleksander KusznirROC Manager
• Tomasz SzepieniecDep. ROC Manager

• Andrzej OziebloRC Manager
• Marcin RadeckiDep. RC Manager

Witold Marton finances/office Robert
Pajak webmaster/office
22
Co zrobilismy?

• Ustalilismy ramy wspólpracy w ROC
• Sledzimy dyskusje i uczesniczymy w nich
• Ukladamy wspólprace z RC
• lista dyskusyjna administratorów dziala
• Zdobylismy doswiadczenie z LCG-2 i dzielimy sie
  nimi
• Doprowadzamy do porzadku finanse
• Wypelniamy karty pracy!

23
Co przed nami?

• Wyjasnic niejasnosci
• Co jest funded a co nie?
• Rola CIC, gdzie jest RB?
• Rola federacji
• EGEE vs. LCG
• Zadania
• Execution Plan M3 (czerwiec)
• Pilot instalation M6 (wrzesien)
• Szkolenie dla administratorów/spotkanie CE Fed.
  (wrzesien?)
• Wsparcie w instalacji LCG2 w CE

24
Agenda

• EGEE Project
• Cyfronet in EGEE
• Application support

25
EGEE i Aplikacje

• EGEE buduje infrastrukture dla wszystkich
• Pilotowe aplikacje
• HEP
• Bioinformatics
• Trwaja poszukiwania innych...

26
Co mozna miec z EGEE?

• Moc obliczeniowa i zasoby pamieci masowej
• dostep do zasobów dziesiatek centrów
  obliczeniowych
• za darmo (na razie)
• Dostosowanie infrastruktury do potrzeb aplikacji
• mozliwosc dodania pakietów, które sa wymagane
  przez aplikacji
• dynamiczne rozpoznawanie
• Wsparcie dla uzytkowników w dziedzinie wspólpracy
  z infrastruktura
• Call Center
• Szkolenia

27
Czego to wymaga?

• Dostosowania aplikacji do wykonywaniaw
  srodowisku Gridowym
• dla wiekszosci aplikacji sekwencyjnych i
  wykorzystujacych MPI trywialne
• wazne sa wykorzystywane biblioteki/pakiety
  (zwlaszcza komercyjne)
• w trudnych przypadkach... mamy zdolnych studentów
  
• Zalozenia Virtual Organization
• zespól ludzi, którzy wykorzystuje te same/podobne
  aplikacje
• Zgloszenia swoich checi
• Otwarte ramiona NA4 czekaja (a i my mozemy pomóc)

28
Podsumowanie

• EGEE Grid bedzie stabilny!
• Rola Cyfronetu w EGEE CE ROC
• Jestesmy dostawcami infrastruktury,Czy bedziemy
  uzytkownikami?
• Dziekujemy za uwage!