Nessun titolo diapositiva

1
GENIUS a Web Portal for DataGRID
Roberto Barbera()
()work in collaboration with A. Andronico, A.
Falzone and A. Rodolico
ACAT 2002, Moscow, 24-28.06.2002
CHEP 2000, 10.02.2000
Roberto Barbera
2
Outline

• The Grid Vision the concept of Collaboratory
• Grid activities in Europe the DataGrid Project
• The main actors of the DataGrid Project
• Easy ed ubiquitous access to the Grid the
  GENIUS web portal
• Conclusions and perspectives

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
3
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
4
GRID Projects EU IST (37 M) An integrated
approach
ACAT 2002, Moscow, 24-28.06.2002
5
DataGRID main contractors

• CERN International (Switzerland/France)
• CNRS - France
• ESA/ESRIN International (Italy)
• INFN - Italy
• NIKHEF The Netherlands
• PPARC - UK

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
6
Other DataGRID partners

• Industrial Partners
• Datamat (Italy)
• IBM-UK (UK)
• CS-SI (France)

• Research and Academic Institutes
• CESNET (Czech Republic)
• Commissariat à l'énergie atomique (CEA) France
• Computer and Automation Research Institute, 
  Hungarian Academy of Sciences (MTA SZTAKI)
• Consiglio Nazionale delle Ricerche (Italy)
• Helsinki Institute of Physics Finland
• Institut de Fisica d'Altes Energies (IFAE) -
  Spain
• Istituto Trentino di Cultura (IRST) Italy
• Konrad-Zuse-Zentrum für Informationstechnik
  Berlin - Germany
• Royal Netherlands Meteorological Institute (KNMI)
• Ruprecht-Karls-Universität Heidelberg - Germany
• Stichting Academisch Rekencentrum Amsterdam
  (SARA) Netherlands
• Swedish Research Council - Sweden

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
7
EDG overview work packages

• EDG Project is structured in 12 Work Packages
• WP1 Work Load Management System
• WP2 Data Management
• WP3 Grid Monitoring / Grid Information Systems
• WP4 Fabric Management
• WP5 Mass Storage Management
• WP6 Testbed and demonstrators
• WP7 Network Monitoring
• WP8 High Energy Physics Applications
• WP9 Earth Observation
• WP10 Biology
  
• WP11 Dissemination
• WP12 Management

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
8
Computational biology
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
9
Medical Diagnostic Imaging
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
10
Earth Observation Community GRID interactive
scenario
Common access to EO missions catalogues Acquisiti
on plan, order, delivery
On demand high level products generation
Parametric data fusion and models integration
Collaborative publishing of results
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
11
Earth Observation
ENVISAT (launched 01.03.2002 !)

• 3500 MEuro programme cost
• 10 instruments on board
• 200 Mbps data rate to ground
• 400 Tbytes data archived/year
• 100 standard products
• 10 dedicated facilities in Europe
• 700 approved science user projects

Roberto Barbera
12
High Energy Physics
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
13
High Energy Physics
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
14
High Energy Physics
6-8 PetaBytes / year O(108) events/year O(103)
batch and interactive users
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
15
1/100 of a PbPb _at_ LHC !
Simulation and reconstruction of a full
(central) PbPb collision at LHC (about 84000
primary tracks!) takes about 24 hours of a
top-PC and produces an output bigger than 2 GB.
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
16
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
17
ALICE grid sites
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
18
The LHC web in the world
Europe 267 institutes, 4603 usersElsewhere
208 institutes, 1632 users
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
19
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
20
Job Submission work-flow
Replica Catalogue
Information Service
Resource Broker
Author. Authen.
Job Submission Service
Logging Book-keeping
Compute Element
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
21
EDG m/w has been released but

• EDG software (Globus, UI, JDL, WP2, WP3, etc.)
  contains tens of commands/switches which also
  have their own logical sequences (B after A,
  C before D and so on).
• Browsing Grid VO directories (users, RCs,
  DBs, etc.) requires LDAP speaking and tomorrow
  could require SQL speaking.
• User gridification is a tough task for a
  rookie ? this does not fit with the claim that
  grids are for everybody and that grid computing
  will be as easy as surfing the Internet ?
• Furthermore, all this holds for DataGrid. What
  will happen when other grids software
  (especially UIs) will come up (PPDG, iVDGL,
  etc.) ? Will users have to learn tens of grid
  dialects ?
• Today grid computing is a rather complicated
  experience only possible at selected machines
  (UIs) ? this does not fit with the claim that
  one could do grid computing even from a PDA ?
• Is there any way to set-up a user-friendly grid
  ?

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
22
A web portal why and how ?

• It can be accessed from everywhere and by
  everything (desktop, laptop, PDA, WAP phone).
• It can keep the same user interface to several
  back-ends (grid dialects ? command-line UIs).
• It must be redundantly secure at all levels 1)
  secure for web transactions, 2) secure for user
  credentials, 3) secure for user authentication,
  4) secure at VO level.
• All available grid services must be incorporated
  in a logic way, just one mouse click away.
• Its layout must be easily understandable and user
  friendly.

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
23
GENIUS (Grid Enabled web eNvironment for site
Independent User job Submission)https//genius.c
t.infn.it
GENIUS web portal
ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera
24
GENIUS how it works
WEB Browser
GENIUS
Local WS
EnginFrame
Apache
EDG UI
Roberto Barbera
25
GENIUS show the main page
Roberto Barbera
26
GENIUS show the authentication
Roberto Barbera
27
GENIUS show file services
Roberto Barbera
28
GENIUS show the authorization
Roberto Barbera
29
GENIUS show security services
Roberto Barbera
30
GENIUS show job submission
Roberto Barbera
31
GENIUS show job submission
Roberto Barbera
32
GENIUS show job queue
Roberto Barbera
33
GENIUS show job output
Roberto Barbera
34
GENIUS show personal spooler
Roberto Barbera
35
GENIUS show job data
Roberto Barbera
36
GENIUS show interactive analysis
Roberto Barbera
37
GENIUS show the VO services
Roberto Barbera
38
GENIUS show the VO services
Roberto Barbera
39
GENIUS show monitoring services
Roberto Barbera
40
GENIUS show monitoring services
Roberto Barbera
41
GENIUS show monitoring services
Roberto Barbera
42
GENIUS show monitoring services
Roberto Barbera
43
Present status and perspectives

• Current implementation of GENIUS already
  includes
• secure web transactions, user authentication and
  authorization
• remote interaction with the users file system
• interfaces for job submission/control, to VO
  servers (users and catalogues), and to
  monitoring systems
• persistent (users) book-keeping and spooler
  system
• interactive analysis !
• rpm available !
• Todo
• multi-jobs (parallel and sequential)
• interface to data management and other grid
  services
• more application-specific customizations
• web-guided creation of a work flow system.

Roberto Barbera
44
GENIUS vs. other grid portals

• It is not a toolkit. It is a complete
  production-ready environment which combine the
  concepts of user portal and science portal.
• No client software needs to be installed apart
  from the web browser. GENIUS can be accessed from
  everywhere.
• No security delegation (à la MyProxy) is
  needed. Access passwords are securely streamed
  only when needed.
• Interactive analysis (via VNC) and web access to
  personal spooling areas are possible.
• User file system is not limited to input and
  output files.
• EnginFrame modularity makes different
  customizations easy to implement. Already
  available for EDG m/w, GLOBUS, and LSF. Under
  definition for CONDOR (hungarian grids).
• It is compatible with the Tomcat open source java
  servlet container available from SUN.

Roberto Barbera
45
Conclusions

• Computational grids could represent the natural
  environment for next generation high energy
  physics experiments, computational bio-medecine,
  Earth observation and many other
  inter-disciplinary applications.
• Grid could be the Internet new age where
  users can seamlessly and ubiquitously access not
  only information but also huge computing
  resources and mass storage systems distributed
  worldwide with their own applications.
• However, in order to turn dreams into reality,
  grid access must be easy and intuitive especially
  for the vast majority of non-expert users and
  this is the mandate of the GENIUS team.
• Live demos of GENIUS at work could be made for
  interested people during breaks in the e-mail
  reading area.

ACAT 2002, Moscow, 24-28.06.2002
Roberto Barbera