Nessun titolo diapositiva

1
The GENIUS grid portal
Roberto Barbera()
()work in collaboration with A. Falzone and A.
Rodolico
CHEP 2003, 24-28.03.2003
CHEP 2000, 10.02.2000
Roberto Barbera
2
Outline

• Introduction
• Motivations
• Current status (through the real use made by the
  Experiments)
• Summary and conclusion

CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
3
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
4
The Grid metaphor
CHEP 2003, 24-28.03.2003
Roberto Barbera
5
DataGrid job submission work-flow
Roberto Barbera
6
EDG m/w has been released but

• EDG software (Globus, UI, JDL, WP2, WP3, etc.)
  contains tens of commands/switches which also
  have their own logical sequences.
• Browsing Grid VO directories (users, RCs,
  DBs, etc.) requires LDAP speaking and tomorrow
  could require SQL speaking.
• User gridification is a tough task for a
  rookie ? this does not fit with the claim that
  grids are for everybody and that grid computing
  will be as easy as surfing the Internet ?
• Furthermore, all this holds for DataGrid. What
  will happen when other grids software
  (especially UIs) will come up (PPDG, iVDGL,
  etc.) ? Will users have to learn tens of grid
  dialects ?
• Today grid computing is a rather complicated
  experience for un-experienced user only possible
  at selected machines (UIs) ? this does not fit
  with the claim that one could do grid computing
  even from a PDA ?
• Is there any way to set-up a user-friendly grid
  ?

CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
7
A web portal why and how ?

• It can be accessed from everywhere and by
  everything (desktop, laptop, PDA, WAP phone).
• It can keep the same user interface to several
  back-ends (grid dialects ? command-line UIs).
• It must be redundantly secure at all levels 1)
  secure for web transactions, 2) secure for user
  credentials, 3) secure for user authentication,
  4) secure at VO level.
• All available grid services must be incorporated
  in a logic way, just one mouse click away.
• Its layout must be easily understandable and user
  friendly.

CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
8
A little bit of history

• 1998-1999
• graphic interface to LSF (multi) clusters for
  ALICE jobs
• 2000-2001
• simple but effective web portal to submit ALICE
  jobs to the grid using EnginFrame and GLOBUS
• 2002-now
• official grant of the INFN Grid Project to
  collaborate with NICE srl to integrate in a web
  portal all services offered by the DataGrid
  middle-ware adoption/contributions by other
  experiments

CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
9
GENIUS (Grid Enabled web eNvironment for site
Independent User job Submission)https//genius.c
t.infn.it INFN/NICE collaboration
GENIUS web portal
CHEP 2003, 24-28.03.2003
Roberto Barbera
10
GENIUS how it works
WEB Browser
GENIUS
Local WS
EnginFrame
Apache
EDG UI
Roberto Barbera
Roberto Barbera
11
EnginFrame in brief

• Standards-based GRID portal
• Java, Tomcat, Apache, XML/XSL ? GridML
• Solves back-end integration problems
• Visual rendering for most Grid objects
• jobs, job arrays, hosts, services, databases,
  etc.
• Multiple Grid technologies support
• EDG, GLUE, Globus, Condor (soon)
• Authentication delegation (GSI,MyProxy, NIS,NT,
  Kerberos V, ...)
• Data management UL/DL remote (multi-) file
  browsing
• Integration with interactive apps
• End-user oriented focus!
• application integration

Roberto Barbera
Roberto Barbera
12
GENIUS show the main page
CHEP 2003, 24-28.03.2003
Roberto Barbera
13
GENIUS show OS authentication
CHEP 2003, 24-28.03.2003
Roberto Barbera
14
GENIUS show file services
CHEP 2003, 24-28.03.2003
Roberto Barbera
15
GENIUS show grid authentication
CHEP 2003, 24-28.03.2003
Roberto Barbera
16
Grid authentication à la MyProxy
EDG UI
MyProxy Server
GENIUS Server (EDG UI)
WEB Browser
Local WS
Roberto Barbera
Roberto Barbera
17
ALICE graphic job description
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
18
ALICE job submission
CHEP 2003, 24-28.03.2003
Roberto Barbera
19
ALICE job queue
CHEP 2003, 24-28.03.2003
Roberto Barbera
20
ALICE job output
CHEP 2003, 24-28.03.2003
Roberto Barbera
21
ALICE personal spooler
CHEP 2003, 24-28.03.2003
Roberto Barbera
22
ALICE grid file browsing
CHEP 2003, 24-28.03.2003
Roberto Barbera
23
ALICE grid file replication
CHEP 2003, 24-28.03.2003
Roberto Barbera
24
ALICE grid file inspection
CHEP 2003, 24-28.03.2003
Roberto Barbera
25
ALICE grid file downloading
CHEP 2003, 24-28.03.2003
Roberto Barbera
26
ALICE interactive analysis
CHEP 2003, 24-28.03.2003
Roberto Barbera
27
ATLAS GLUE job submission
(courtesy of L. Vaccarossa)
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
28
ATLAS interactive analysis
(courtesy of L. Vaccarossa)
CHEP 2003, 24-28.03.2003
Roberto Barbera
29
CMS grid integration schema
(courtesy of M. Verlato)
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
30
CMS GENIUS/Impala integration
(courtesy of M. Verlato)
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
31
CMS GENIUS/BOSS integration
(courtesy of M. Verlato)
CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera
32
GENIUS show Earth Ob. app.
CHEP 2003, 24-28.03.2003
Roberto Barbera
33
GENIUS show Biomed. app.
CHEP 2003, 24-28.03.2003
Roberto Barbera
34
Present status and perspectives

• Current implementation of GENIUS includes more
  than 100 services. Among them
• secure web transactions, user authentication and
  authorization
• grid authentication à la MyProxy !
• remote interaction with the users and grid
  file system
• interfaces for job submission/control, data
  management, VO servers, and monitoring systems
• several Resource Brokers and VOs available
• persistent (user level) book-keeping and spooler
  system
• secure interactive analysis with TightVNC
• full support for parallel multi-jobs
  (sequential ones soon)
• web guided job description (from DATAMAT)
• CVS available !
• Next future
• Participation to the GGF Grid Portal Manifesto
  and GCE Working Group.

Roberto Barbera
Roberto Barbera
35
FAQsand answers (1)

• Q I want to use GENIUS. Do I have to pay for it
  ?
• A No. GENIUS is open source and the underlying
  portal framework EnginFrame is free for the
  education and research communities.
• Q I want to use GENIUS. Do I need any software
  running on my laptop ?
• A No client software needs to be installed apart
  from the web browser. GENIUS can really be
  accessed from everywhere.
• Q Do I have to be afraid about cached password
  sent over the web ?
• A Access passwords are securely streamed only
  when needed and then destroyed. Only temporary
  sessions are possible.
• Q Can new authentication methods implemented
  into GENIUS ?
• A Of course. Kerberos V is a good example.
  EnginFrame is already compliant with Kerberos
  authentication.

Roberto Barbera
Roberto Barbera
36
FAQsand answers (2)

• Q I want to add a new VO to GENIUS and customize
  new services for that VO. How can I do that ?
• A A new VO can be added to GENIUS in just
  minutes. New VO specific services can be added
  just modifying only two files an XML file and a
  shell script.
• Q Can I use GENIUS to interface other m/ws ?
• A Yes. Although GENIUS is currently based on the
  DataGrid middleware(w/ and w/o GLUE extensions),
  it can be very easily interfaced to others. A
  direct interface to the Globus Toolkit already
  exists and another one to Condor is in progress.
• Q How can I start downloading/using GENIUS ?
• A Go to the reference site https//genius.ct.infn
  .it, click on GENIUS CVS available and follow
  the instructions.

Roberto Barbera
Roberto Barbera
37
Summary and conclusion

• Computational grids could represent the natural
  environment for next generation high energy
  physics experiments, computational bio-medicine,
  Earth observation and many other
  inter-disciplinary applications.
• Grid could be the Internet new age where
  users can seamlessly and ubiquitously access not
  only information but also huge computing
  resources and mass storage systems distributed
  worldwide with their own applications.
• However, in order to turn dreams into reality,
  grid access must be ubiquitous, easy and
  intuitive especially for the vast majority of
  non-expert users and these are just the goals of
  GENIUS.
• GENIUS is also a good example of implementation
  of real use cases started in one experiment and
  followed by others.

CHEP 2003, 24-28.03.2003
Roberto Barbera
Roberto Barbera