P14 Reprocessing: Site Certification Status p14.05.02


RecoCert plots: run 176852, p13.06.01 DST reconstructed with p14.05.02, no event selection
chunks
TMB vs TMB
ccin2p3 vs d0rutherford: ps pdf
all
TMB vs TMB
ccin2p3 vs edg: ps pdf
all
TMB vs TMB
ccin2p3 vs uta: ps pdf
all
TMB vs TMB
ccin2p3 vs westgrid: ps pdf
all
TMB vs TMB
ccin2p3 vs manhep: ps pdf
all
TMB vs TMB
ccin2p3 vs nikhef: ps pdf
all
TMB vs TMB
ccin2p3 vs gridka: ps pdf
all
TMB vs TMB
ccin2p3 vs imperial-lesc: ps pdf
all
DST vs DST
fnal clued0 vs ccin2p3 rcp changed to reproduce offsite: ps pdf
partition 001
TMB vs TMB
fnal from RAW vs ccin2p3 from DST: ps pdf
same events, partition 9-12,14-28,30-45,47,54-57,59-61,67
Comment:
Identical RecoCert plots for same events produced at different remote sites.
When rcp is changed at FNAL to mimic remote setup, plots agree (except p41, p44 ignored)
Some differences between FNAL from RAW, remote sites from DST.

Certification Procedure
Each site must prove that it is able to run d0reco and produce results identical to those found at FNAL. We agreed with Harry Melanson that the following procedure would suffice for certifying the remote sites:
  1. Run recocert on fully reconstructed events from FNAL farm for use as standard set. Note that Harry has run recocert on other FNAL p14.05 output and he considers it "certified".

    This only need be run on thumbnails. It is not necessary to run this on DSTs.

  2. Copy the thumbnails (including metadata and logs) of the certification run (176852) from remote sites to d0mino. Each station has a recocert area for this in /sam/remote_merge. E.g. ccin2p3 would copy their certification thumbnails to: /sam/remote_merge/ccin2p3/recocert
  3. The metadata should be checked by one of the experts.
  4. Recocert should then be run against these thumbnails and overlayed on the reference set from the FNAL farms.
  5. If any differences show up in the overlays, then we will ask Harry and/or Suyong to examine the plots and declare them fit/unfit. It was agreed that on the first passes of this procedure we WILL ask them to examine the plots regardless of how inconsequential any differences may seem.
  6. List of selected events from remote site should be compared to Marco's master list. The match should be exact.
  7. No difference in the certification plots or blessing by Harry/Suyong, and an exact match on the selected event lists gives a remote site a green light to proceed with production.
There are two things in here which you might question. First, use of thumbnails rather than DSTs. Harry's contention is that any signiifcant differences should show up in the thumbnails since any useful physics object is in there. That makes our life a lot easier since we have limited temporary storage space for DSTs. A second point which might concern you is the comparison using fully reconstructed output from FNAL and selected output from the remote sites. Harry points out that although there will be differences in things like electron quality, the more basic quanitites such as numbers of tracks and hits are driven by normal background and not the few "interesting" tracks in an event. Consequently, things like track and hit distributions should not differ much between selected and unselected samples. So I think we have our marching orders. Remote sites should copy their thumbnails from the certification run to d0mino. They should check their selected event lists from this run agains Marco's master list ( I think both gridka and ccin2p3 hav already done this). Phil should run recocert on the thumbnails in sam for run 176852 as a reference. When the remote sites have notified Phil that their thumbnails are on d0mino he should run recocert on them and overlay against the refence set. We will then ask Harry/Suyong to bless/curse the output.
Mike Diesburg, Daniel Wicke, Phil Lewis 3. Nov. 2003. Last update 3rd Nov. 2003.
Diesburg@fnal.gov
Daniel.Wicke@physik.uni-wuppertal.de
Philip.Lewis@ic.ac.uk