Re-Reconstruction Of Generated Monte Carlo

1
Re-Reconstruction OfGenerated Monte Carlo

• In a McFarm Context

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
2
Objective

• Manage MC reprocessing with McFarm
• No massive changes flexible ?
• D0RunII, ups/upd environment sufficient
  packages, rcps, data
• mc_runjob handle reprocessing
• Scriptable procedure
• File outputs certified for SAM storage

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
3
Status August 1

• U. Michigan NPACI cluster ? 3 scripts
• Job submission, SAM project handling
  (make_npaci.py splitProject.py, )
• Run control referred to other scripts that
  provided job creation (npaci_jobs.sh)
• Not exactly applicable to McFarm
• Left out crucial info (binaries, rcps)
• Yet were still informative (nothing exotic
  needed, adaptable to McFarm)

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
4
Further Investigation

• RCPs crucial
• Where do the come from?
• What are they?
• Can they and their parameters be user specified
  like Request system used with mc_runjob?
• Or have to craft mc_runjob macro and use reg_job?

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
5
Action Plan

• Make job dir on farm node.
• Locate RCPs and alter for single input file and
  output files with no SAM use.
• Run re-reco to completion
• Inspect output, logs
• Shows SAM not needed during running, no non-MC
  database or binary is needed, and that the job
  can be encapsulated to one input/output.

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
6
Release p14.02.00

• Copy McFarm run directory in the d0reco phase to
  a test area
• Modify file list to use McFarm generated reco
  file
• Copy runD0reco_mc_reprocess.rcp and
  DropChunks_ReprocessDST.rcp to d0reco rcp dir
• Modify run_d0reco.sh rcp file to
  runD0reco_mc_reprocess.rcp, rename to
  run_d0rereco.sh, run it

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
7
p14.02.00 Results

• Job completed producing reco and tmb files
• Great! No extra stuff, just D0RunII.
• Wheres the metadata?
• Right RCPs?
• Only gtp14.03.00 certified for re-reco. Try it
  again.

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
8
p14.03.02 Results

• Reprocess rcp's for detector subsystems
• Find them all and place in the proper sub dir of
  the re-reco test area
• Job completes producing reco and tmb files
• Wheres the metadata?
• Right RCPs?
• Also shown that can re-reco in mc_runjob structure

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
9
CAB/NPACI Style

• Use d0tools package
• rund0exe runs d0reco
• cabSubmit.py submits job, SAM handling
• Still wheres the metadata? Not d0reco
• rund0exe takes USERPOSTSCRIPT argument provided
  by env. var. at NPACI
• Still unknown how its produced(?) Need script(?)

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.
10
Developments Status

• mc_runjob version re-reco specifically enabled
  available
• No apparent structural incompatibilities for
  McFarm to be able to re-reco
• Has metadata producer been found?
• Anybody know the latest?

D0SAR_at_OU, 2003/09/26

Joel Snow, Langston U.