HLRmon accounting portal - PowerPoint PPT Presentation

Title: HLRmon accounting portal


1
HLRmon accounting portal
A. Cristofori1, E. Fattibene1, L. Gaido2, P.
Veronesi1 INFN-CNAF Bologna (Italy)1, INFN-Torino
Torino (Italy)2 hlrmon-lists_at_to.infn.it -
https//dgas.cnaf.infn.it/hlrmon/
The accounting layout
Architecture

• Collectors retrieve
• aggregated CPU accounting information from a
  desired HLR
• storage accounting data by probes running on the
  SRM instances at WLCG sites
• values of some GLUE attributes about the
  computing power capacity of the WLCG
• sites
• An aggregation layer is responsible for the data
  manipulation to produce charts and tabular
  reports visualized by the graphical interface.
• Data aggregated per Grid user are directly
  retrieved from the HLR database at run-time and
  are just accessible by authorized users.

DGAS (Distributed Grid Accounting System) sensors
collect accounting information at site
level. Site data are sent to site or multi-site
HLRs (Home Location Register). A top level HLR
receives accounting data from all the Grid
HLRs. HLRmon retrieves data from the top level
HLR and presents them through a web interface.
Aggregated data are also sent to the central EGI
Accounting Portal. HLRmon is successfully
deployed as accounting portal for IGI and other
Grid projects/NGIs using DGAS as accounting
system.
General purpose CPU reports

• Different metrics to analyze
• CPU and Wall Clock Time, expressed in days
• and normalized on the mean power capacity of the
  site
• Number of executed jobs
• Job efficiency in terms of (CPU Time / Wall
  Time) ratio
• Different keys of data aggregation
• Site
• Virtual Organization
• VOMS group and role
• Certification Authority and Registration
  Authority
• Job type (Grid or local)
• Grid user DN
• An advanced selection menu permits to choose a
  desired subgroup of values for each aggregation
  key.
• A specific view with data grouped per discipline
  is provided the mapping information between VOs
  and disciplines is currently retrieved from the
  EGI Operations Portal.

WLCG reports
Towards complete storage reports
The charts allow the analysis of CPU and storage
resources usage at the WLCG Tier1 and Tier2 by
the LHC experiments, over the last month and the
last year. The resource usage and the amount of
pledged resources are compared. Accounting data
are grouped by site and by VO. Storage data are
taken by a script running on the sites and sent
to HLRmon via email.
HLRmon provides a storage accounting section for
WLCG sites and VOs. A more generalized
approach, integrated in DGAS, is being
developed. Non-standard schema is used to
generate records (no standard schema
exists). Records are retrieved at sites and
stored on the HLRs. HLRmon is able to retrieve
storage information directly from the desired
HLR. Each record on the HLR has a timeDuration
calculated as the difference between two
consecutive measurements. HLRmon calculates the
daily disk consumption in terms of space-per-hour
as the integral of the used space over
time. Data are aggregated per site, VO and
Storage Area.