WP1 Grid Workload Management

1
WP1Grid Workload Management

• Massimo Sgaravatto
• INFN Padova
• http//www.infn.it/workload-grid

2
Activities 2001

• Driven by deliverables
• D1.1 Report on current technology
• Survey on existing Grid tools and frameworks
• C. Anglano (TO), T. Ferrari, F. Giacomini (CNAF),
  F. Prelz (MI), M. Sgaravatto (PD)
• D1.2 Definition of architecture
• Internal WP1 architecture document
• F. Giacomini (CNAF) main author
• Participation to ATF to define the global EDG
  architecture
• D1.3 Initial Workload Management System (1st
  release)
• Code released to EDG-Integration Team

3
1st Release (what and who)

• UI (User Interface) - DATAMAT
• Command line for job management operations
• Job Description Language (JDL) to specify job
  characteristics and requirements
• RB (Resource Broker) Catania
• Responsible to choose the best resources where
  to submit jobs based on the constraint specified
  in the JDL and characteristics and status of
  resources (published in the Grid Information
  Service and Replica Catalog)

4
1st Release (what and who)

• JSS (Job Submission Service) Padova
• Responsible for job management operations
• II (Information Index) Milano
• First filter to the Grid Information Service
• LB (Logging Bookkeeping) CESNET
• State machine view of each job
• WP1 WP2 interfaces - CNAF, PISA
• Packaging - CNAF, PISA
• Coordination (internal and with the other WPs) -
  F. Prelz, M. Sgaravatto

5
(No Transcript)
6
Other 2001 activities

• Grid Accounting Torino
• Economy based model
• Implementation of a first prototype on-going
• Advance reservation and co-allocation - CNAF
• Globus GARA evaluation

7
Planning for 2002

• Bug fixes, improvement of functionalities
• RB Catania
• JSS Padova
• II Milano
• Support for interactive jobs
• RB Catania
• JSS - Padova
• Grid accounting - Torino
• Implementation of a prototype system and
  integration with the workload management system

8
Planning for 2002

• Analysis of new and smarter scheduling strategies
  Catania
• Integration of network information in the
  matchmaking process within RB CNAF, Catania,
  Torino
• Advance reservation and co-allocation - CNAF
• Triggering of data transfers Catania, Torino
• Add the ability to evaluate network throughput
  and decide on the convenience of transferring
  data to provide better scheduling options (this
  may involve some form of network bandwidth
  reservation)

9
Planning for 2002

• Support for partitionable jobs
• Padova
• Job dependencies
• CNAF
• WP1 WP2 interfaces
• Pisa
• Packaging of WP1 software, Participation to
  EDG-IT
• CNAF, Pisa

10
Resources for year 2002

• Travel
• Travel in Italy 104 K
• 8 WP1 2-day meetings (Milano)
• CT (2 people), CNAF (3 people), PD (4 people), PI
  (2 people), TO (4 people)
• Integration activities (3 weeks)
• CT (1 people), MI (1 people), CNAF (2 people), PD
  (1 people), PI (2 people), TO (2 people)
• TB INFN-GRID and coordination activities (20
  days)
• MI (1 people), PD (1 people)
• Conferences and workshops (5 days)
• MI (1 people), PD (1 people), PI (1 people), TO
  (2 people)

11
Resources for year 2002

• Travel abroad 153 K
• 3 EDG workshops (Paris, Edinburgh, ??)
• CT (2 people), CNAF (3 people), MI (2 people), PD
  (4 people), PI (2 people), TO (4 people)
• GGF4 - Toronto (4 days)
• CT (1 people), CNAF (1 people), MI (1 people), PD
  (1 people), TO (1 people)
• GGF6 - USA (4 days)
• CT (1 people), CNAF (1 people), MI (1 people), PD
  (1 people), TO (1 people)
• SC2002 USA (1 week)
• MI (1 people), PD (1 people)
• 7 PTB CERN
• MI (1 people), PD (1 people)
• Coordination CERN
• MI (1 people, 20 days), PD (1 people, 15 days)
• Collaboration with Globus and GGF developers on
  Information Services
• MI (1 people, 2 weeks)
• Collaboration with Globus and GGF developers on
  Scheduling
• CT (1 people, 2 weeks)
• Collaboration with Condor developers
• PD (1 people, 2 weeks), CNAF (1 people, 2 weeks)