|
Page updated: 2004 |
Run II
Reconstruction Program
Status - Version p14
|
Latest version: |
|
Running on the farms |
Overview • Status
• Performance • Test samples
Upcoming Features • Known Problems
Version Compatibility • Version History • Release Notes
General Information • How
to
run RECO • Report
RECO problems
Now...
The current version of p14 is p14.06.01.
In general...
The p14 version of the reconstruction program has the following significant differences with the previous (p13) version:x
- New tracking algorithm combination available (AA+HTF)
- Improved tracking efficiency and no reliance on axial-only tracking.
- Lower fake rates.
- Improved efficiency for PT < 500 MeV.
- Improved efficiency for high impact parameter tracks (gamma conversions, K0, L, etc.).
- Improved speed starting p14.05.00 through removing crumbly clusters
- Use of offline calibration databases (SMT, CFT, CPS, MUO)
- New alignment, based on magnet off data. This new alignment significantly reduces the Z mass width and the E/p width for electrons. It also removes an observed <q/PT> bias.
- Vertexing
- Improved primary vertex – 2 pass vertexing and probabilistic selection (starting p14.04.00)
- SMT
- Calibration database.
- New HW maps (post-shutdown).
- CFT
- Calibration database.
- CPS
- Calibration database.
- Update map.
- Include more clusters in thumbnail.
- FPS
- Update map.
- Improve reconstruction software.
- Deal with hardware problems.
- EM Id
- Tuned H matrices.
- Muon Id
- Include hits in thumbnail.
- Remove storing of multiple matches.
- Turn off axial-only track matching.
- Fix alignment, to improve track matching.
- Jet Id
- Reduce fake jets by reducing use of CH as seeds.
- Include T42 algorithm in shadow-mode, for studies.
- Thumbnail
- More trigger information
p14.06.00 is currently installed on the data processing farms (FNAL). p14.06.00 is the final version.
The following statistics were measured on CAB using run 174244. The CPU time has been converted to 1 GHz-seconds. RSS measures real memory used and VSIZE measures virtual memory (real memory is more important for farm production, and virtual memory is more important for users running in shared batch systems). The numbers represent averages of different files within a run (we have observed significant differences between files in a given run). These numbers should be used with care when extrapolating performance to other runs.
|
Version |
CPU Time (sec/event) |
RSS Memory (MB) |
VSIZE Memory (MB) |
DST size (KB) |
TMB size (KB) |
NEVT |
|
p14.03.00 |
14.8 |
413.4 |
666.4 |
208.2 |
22.3 |
1000 |
|
p14.02.00 |
20.7 |
445.0 |
597.5 |
211.2 |
23.8 |
100 |
|
p14.01.00 |
25.7 |
688.3 |
852.5 |
220.3 |
18.9 |
100 |
|
p13.06.01 |
17.2 |
388.9 |
494.4 |
171.6 |
18.9 |
100 |
Run 179760 is 26e30 run
|
Version |
CPU Time (sec/event) |
RSS Memory (MB) |
VSIZE Memory (MB) |
DST size (KB) |
TMB size(KB) |
NEVT |
|
P14.05.00 |
20.6 |
273 |
523 |
210 |
24.7 |
2500 |
Run 174491 is a higher luminosity run.
|
Version |
CPU Time (sec/event) |
RSS Memory (MB) |
VSIZE Memory (MB) |
DST size (KB) |
TMB size (KB) |
NEVT |
|
p14.03.00 |
37.1 |
453 |
883.1 |
283.6 |
27.4 |
1000 |
|
p14.02.00 |
40.2 |
434.8 |
698.2 |
270.1 |
28.6 |
100 |
|
p13.06.01 |
31.8 |
432.1 |
578.1 |
224.0 |
23.0 |
100 |
Tracking efficiency is measured by matching "tight muons" to tracks found in the central detector (a technique developed by Erich Varnes and described in a talk to the tracking group).
|
Version |
Tracks/event |
Hits/track |
Track effic (phi=0) |
Tracks/primary vertex |
|
p14.01.00 |
47.7 |
18.1 |
0.89 |
23.3 |
|
p13.06.01 |
35.3 |
16.0 |
0.71 |
12.3 |
DST composition
(top 20
chunks), based on run 174244.
|
|
p13.06.01 |
|
|
p14.03.00 |
|
||||
|
Chunk |
Number of chunks |
% of total |
Chunk |
Number
of chunks |
%
of total |
||||
|
FPSClusterChunk |
1 |
20.41% |
L3Chunk |
1 |
15.04% |
||||
|
L3Chunk |
1 |
17.30% |
TrackCalExtraChunk |
1 |
14.32% |
||||
|
TrackCalExtraChunk |
1 |
9.12% |
FPSClusterChunk |
1 |
10.74% |
||||
|
JetChunk |
8 |
7.66% |
JetChunk |
6 |
8.02% |
||||
|
FPSDataChunk |
1 |
6.00% |
Calt42Chunk |
1 |
6.63% |
||||
|
EMparticleChunk |
2 |
5.49% |
ChargedParticleChunk |
1 |
5.08% |
||||
|
CalSCClusterChunk |
1 |
4.27% |
GTrackChunk |
1 |
4.17% |
||||
|
RawDataChunk |
1 |
4.09% |
L1L2Chunk |
1 |
3.96% |
||||
|
ChargedParticleChunk |
1 |
3.99% |
CPSClusterChunk |
1 |
3.71% |
||||
|
GTrackChunk |
1 |
3.68% |
RawDataChunk |
1 |
3.63% |
||||
|
CalDataChunk |
1 |
3.31% |
FPSDataChunk |
1 |
3.22% |
||||
|
CalTClusterChunk |
10 |
2.49% |
EMparticleChunk |
2 |
3.18% |
||||
|
CftClusterChunk |
1 |
2.10% |
CalSCClusterChunk |
1 |
2.98% |
||||
|
SMTPosBCollectChunk |
1 |
1.98% |
CalDataChunk |
1 |
2.63% |
||||
|
SMTPosDCollectChunk |
1 |
1.67% |
CalTClusterChunk |
8 |
1.92% |
||||
|
VertexCollChunk |
6 |
0.86% |
CftClusterChunk |
1 |
1.72% |
||||
|
MuoAlignChunk |
1 |
0.59% |
SMTPosBCollectChunk |
1 |
1.45% |
||||
|
MuoCentralMatchChunk |
1 |
0.54% |
SMTPosDCollectChunk |
1 |
1.23% |
||||
|
MuoSegmentChunk |
1 |
0.53% |
CPSDigiChunk |
1 |
1.22% |
||||
|
TrackChunk |
1 |
1% |
VertexCollChunk |
5 |
0.56% |
||||
A breakdown of where CPU time is spent, based on run 174244. Note that these numbers fluctuate by a few percent, based on which run is processed, and the instantaneous luminosity of that run. Also, not all times are accounted for (to the level of about 5%). These numbers should be considered to indicate general trends.
|
|
p13.06.01 |
p14.01.00 |
p14.03.00 |
|
Stage |
% of CPU time |
% of CPU time |
% of CPU time |
|
Initialization |
0.08% |
0.06% |
0.00% |
|
SAM |
0.00% |
0.00% |
0.00% |
|
Read event |
0.08% |
0.06% |
0.11% |
|
Unpacking |
6.67% |
5.51% |
6.80% |
|
Detector (RDC) |
3.21% |
2.88% |
2.79% |
|
Detector (DST) |
1.69% |
1.38% |
2.01% |
|
Tracking |
56.96% |
63.97% |
62.65% |
|
Vertexing |
6.33% |
5.51% |
5.13% |
|
Particle ID |
14.94% |
11.65% |
15.16% |
|
cal |
1.10% |
0.94% |
0.78% |
|
chpart |
6.67% |
5.58% |
7.36% |
|
em |
0.25% |
0.19% |
0.22% |
|
mu |
2.11% |
1.44% |
2.68% |
|
jet |
3.46% |
2.63% |
3.01% |
|
tau |
0.08% |
0.06% |
0.00% |
|
met |
0.25% |
0.25% |
0.22% |
|
links |
0.00% |
0.00% |
0.00% |
|
bc |
1.01% |
0.56% |
0.78% |
|
wz |
0.00% |
0.00% |
0.00% |
|
Write event |
0.17% |
0.13% |
0.22% |
|
Finish event |
7.26% |
5.70% |
1.00% |
|
RecoStat (recostat) |
1.43% |
0.69% |
0.86% |
RECO certification plots generated with recocert:
p14.02.00, Run 176571 (3 MB)
p14.02.00, higher statistics (from Data Monitoring group)
p14.01.00 vs p13.06.01, Run 176571 (5.2 MB)
The above set of plots compare run 176517 reconstructed on the farms with p14.01.00 and p13.06.00. The plots were generated with the recocert package. Results from p14.01.00 are in black (p13.06.01 in red). Where appropriate, the plots have been normalized by the number of events processed. Track efficiency plots have been refined by Erich Varnes recently: a) require calorimeter confirmation of muon, to reduce muon fake rate, b) tuned matching cuts to better handle geometric matching. These modifications have resulted in a higher observed tracking efficiency.
p13.06.01, Run 174244 (10 MB) - for comparison
p14.01.00
certifications
samples (Data and
- No more releases of p14 planned
Data
reconstructed with the following versions have known problems or
annoyances:
- p13.06.0x
- In the DST, L1L2Chunk does not contain all L1 CAL towers. This can be recovered from the pared down RawDataChunk present in DST.
- p14.03
- CPS energy information is wrong, due to a bug in CPS calibration, position is usable, but probably not for analysis. Users should use p14.05 data for CPS studies. Affects p14.03.01 data.
- Low energy EM particles have an energy of 5 GeV. This bug won’t affect EM objects above 10 GeV. EM post-processing fixes this.
- P14.05
- Low energy EM particles have an energy of 5 GeV. This bug won’t affect EM objects above 10 GeV. EM post-processing fixes this.
- P14.06
- Post Nov 2003 shutdown data has wrong calibration applied, happened when mapping was applied to calibration run, but not to offline.
History of Problems and
resolutions:
Major error, 
Annoying feature, 
Functionality to
be added
Scheduled for next
release, 
Problem fixed.
(common = occurs within 100 events, rare = occurs within
1000
events)
|
Status |
Description |
Fixed in version |
|
Segmentation faults |
Not fixed |
|
|
Infinite loop in AA tracking algorithm |
p14.06.00 |
|
|
Energy
information in the CPS data reconstructed with p14.03.0x (x>=1) due
to a bug in cps_util and cps_calibration. Position information is not
great, but usable. This is all fixed in p14.04.00. |
p14.04.00 |
|
|
EM
reco produces a peak at pT=5 GeV for low PT electrons. Fortunately, the
cell information is stored, so EM post-process allows to do the
reconstruction correctly. |
p14.06.00 |
|
|
A serious bug was introduced in p14.03.01 as part of DSPACK. When L1L2 information is unpacked, program crashes, but not for all p14.03.01 data. |
p14.03.02 |
|
|
A serious bug has been found in the calculation of the jet estimator n90 (from which f90 is built), for kt jets, and for cone jets which result from a merging of 2 or more jets. See this D0 News announcement for more details. |
p14.04.00 |
|
|
A bug in Jet::p() results in returning pz instead of p. Users are advised to avoid p() and instead use sqrt(px() * px() + py() * py() + pz() * pz()); |
No plan to fix in p14. |
|
|
CPU time per event can be x20 -x40 larger than typical for specific events, dominating average time. |
p14.05.00. |
|
|
The calorimeter "energy sharing" problem that occurred during the first few months of 2003 (see Nirmalya's ADM talk or Greg Landsberg's summary) resulted in approximately 40 pb-1 of data that was compromised for physics analyses. A solution ( description of the solution, a before plot and an after plot) was implemented and can be used to reprocess RAW or DST data tiers. |
p14.03.00 |
|
|
RECO startup time is extremely variable when processing raw data. This was due to limitations with cacheing within the calibration database servers. The python version of the cache could only store about 6 individual calibration constant sets, aresulting in "cache thrashing" with the user db servers due to requests for more than this number of sets. Users attempting to (re)process events from a wide range of runs experienced even worse performance. Farm production was less affected. See below for more details. The cacheing code has been rewritten in C++, allowing for currently 30 SMT data sets to be in memory at one time. |
New SMT C++ cache code deployed. |
|
|
CPU time per event grows linearly with the number of events processed. See Slava Kulik's ADM talk for a description of the solution. |
p14.03.00 |
|
|
RECO requires more memory than p13. |
Improved in p14.02.00 and p14.03.00. |
|
|
Momentum
resolution is significantly worse in data than in |
p14.02.00. |
|
|
FPS cluster chunk dominates DST size. |
Improved in p14.02.00. More tuning required. |
|
|
Floating point errors in EMparticle |
p14.02.00 |
|
|
FPS unpacking crashes. |
p14.02.00 |
|
|
FPS reco crashes. |
p14.02.00 |
|
|
RECO processing time per event slower (1.2 - 1.4) than p13 depending on luminosity. |
Improved with p14.02.00 |
|
|
SMT Status is not correctly set in SMT calibration database. Results in permitting noisy chips to be considered during reconstruction. Impact may slow down reconstruction. |
p14.02.00 |
|
|
GTRHTF tracking
crashes when processing p13.08.00 |
p14.01.00 |
|
|
Floating point error in trfzp (rare). |
p14.01.00 |
|
|
mag_field returns incorrect polarity. |
p14.01.00 |
|
|
CFT calibration db server hangs (only one example so far - under investigation). |
p14.01.00 |
|
|
GtrHtfAAPkg has noisy printout in output file. |
p14.01.00 |
|
|
sam_manager throws exception when it times out, preventing valid metadata to be generated. |
p14.01.00 |
|
|
A root exists bug that makes files written by root after reading a tree lose their TRefs. Requires later version of root. |
p14.01.00 |
The following attempts to describe which versions of p14 RECO are compatible with each other. This summary is very general, and may not cover all possible issues that someone doing an analysis may care about. More detailed information about the differences between versions can be found below. Detailed release notes are also available.
Entries with the same color indicate compatibility.
p14 is significantly
different than p13. Analyses should treat such samples
independently.
|
Version |
Alignment |
Calibration |
|
SMT |
CFT |
FPS |
Tracking |
Vertexing |
MUID |
Thumbnail |
Notes |
|
p14.00.00 |
x |
x |
x |
x |
x |
|
x |
x |
x |
x |
x - Non-production version |
|
p14.01.00 |
x |
x |
x |
xx |
x |
x |
x |
x |
x |
x |
x - Non-production version |
|
p14.02.00 |
a |
a |
a |
a |
a |
x |
a |
a |
a |
a |
First production version. |
|
p14.03.00 |
a |
a |
a |
a |
a |
x |
a |
a |
a |
a |
|
|
p14.03.0x |
a |
a |
a |
a |
a |
a |
a |
a |
a |
a |
FPS phi calculation fixed. |
|
p14.04.00 |
a |
a |
a |
a |
a |
a |
a |
a |
a |
a |
|
Notes:
p14.03.00 is the first version that officially supports reprocessing of DST's. Users should be aware that results from reprocessing DST's will not be identical to those from processing RAW files, since clusters / hits that are created based on calibration constants are not re-created. For example, reprocessing p13 DST's with p14.03.00 results in slightly different SMT clusters than if the raw data were processed. There differences are small, but users should treat them appropriately for their individual needs.
- p14.07.00
- t42 in killing mode
- CPS calibration/mapping fixed for post Nov2003 shutdown data
- TMB++ - minus the CPS chunks
- FPD - stored in the thumbnail chunk
- New muon geometry for post March 2004 data - no visible effect is observed using the old geometry
- Calorimeter database access code - not turned on
- p14.06.00
- t42 chunk is now written to the thumbnail
- Various fixes from Scott Snyder
-
New CPS and
CFT map for the new data after mid November 2003
- p14.05.02
- This version has the CAL corrections when reconstructing from RAW
- Problems – infinite loop in AA tracking algorithm and mysterious segmentation faults are reported by the farms
- p14.05.01
- No major changes for d0reco. Removed cosmic timing cut for selective reprocessing
- p14.05.00
- Major changes
- Selective reprocessing,
streaming and event tagging – event tagging allows one to look at event header without
unpacking
chunks
-
muon id interface change (the
same as in p15 and test releases) – needed for
p14 certified muons and selective reprocessing and
offline streaming
- tracking speed up through propagator optimization and removal of “crumbly” clusters– expect some loss of efficiency for high-occupancy events
- Dropped bc-jet reconstruction from d0reco RCP
-
Problems
- EM reconstruction Et not correct for low Et electrons – post-processing in the user analysis can fix this
- p14.04.00
- Major changes
- Speed up of tracking
- Drop TrackCalExtra chunk
- Calorimeter timing and control information
- Fix L1 CAL information when reprocessing
- Better FPS maps and geometry
- Take into account 3cm offset in z when calculating H-matrices
- No db access when reprocessing
- 2 pass primary vertex reconstruction and probabilistic selection
- Problems
- Somewhat frequent crashes on the farms
- 4 towers swapped
- EM reconstruction Et not correct for low Et electrons – post-processing in the user analysis can fix this
- p14.03.02
- Major changes
- Fix for DSPACK bug introduced in p14.03.01
- cps_calibration speed up
- Problems
- 4 towers swapped – new problem identified affecting all data
- EM reconstruction Et not correct for low Et electrons
- CPS calibration was not applied correctly
- p14.03.01
- Major changes
- Speed up CPS calibration database access
- Problems
- A major bug was introduced from DSPACK, resulting in corrupted data in L1L2Chunk only. The data is usable as long as that chunk is not unpacked.
- Occasional events in the farms taking hours to reconstruct.
- p14.03.00
- Major changes
- Support for reprocessing p13 DST.
- Can fix calorimeter "crate 8" problems from RAW or DST data tier.
- Speed up due to better memory management.
- Improved FPS reconstruction.
- Speed up pick_events.
- Problems
- None known at this time.
- p14.02.00 - First production version
- Major changes
- New tracking detector alignment, reducing observed q/PT bias. As an example, the measured Z mass width is significantly reduced (and no longer depends on phi).
- Fix rotations in muon detector geometry, to improve matching to tracker.
- Update ICD ADC-to-GeV constants, improving jet energy scale.
- Fix SMT status when connecting to database, improving CPU time per event.
- First "production" version of FPS software. FPS data in DST / TMB is now useful for first-pass physics analyses.
- Add 0.5 GeV cut to tracks for primary vertexing.
- Increase the number of trigger towers written into L1L2Chunk to 1280.
- Make L1CTT information in L1L2Chunk useful and complete.
- Problems
- None known.
- p14.01.00
- Major changes
- Make access to calibration database the default for data processing.
- Make AA/HTF the default tracking.
- Improve primary vertex finding to reduce split vertices.
- Do not include CH cells as calorimeter jet seeds - reduces noisy jets by 10-20%.
- Increase number of CPS clusters in thumbnail.
- Fix CFT wire map with 2 fibers inadvertently swapped - small improvement in tracking efficiency.
- Release July, 02 and Feb, 03 muon geometry (latest survey numbers).
- Problems
- SMT status word not set in calibration database, resulting in known bad channels being used. Increase tracking time by > 20%. Fixed in p14.02.00.
- p14.00.00
- First p14 release
Release Notes
- p14.07.00
- Functionality Changes
- cal_t42 (p14-br-20) - killing mode RCP
- cal_nada (p14-br-01) - flag bad status in caldatachunk
- caltables (p14-br-03) - code update for CAL calibration database access
- cal_calibration (p14-br-01) - code update for CAL calibration database access
- calunpdata (p14-br-g) - code update for CAL calibration database access
- config_base (p14-br-v00-00-19) - increase event tag size from 2 words to 4 words
- config_db_client p14-br-v00-00-10 - make MagField DB server choose either farm or user server name by reading command line option -dbserver
- d0reco
(p14-br-19)
- Preliminary TMB++ - CalDataChunk, Calt4_25Chunk, SMT and CFT chunks
- remove kalman vertexing and wzreco from processing, removed obsolete package elasticreco from being linked in,
- added calrecocalibrater to OBJECTS (though it's not used by default)
- fps_reco (p14-br-k) - improved alignment
- fpd_event (p14-br-01) - Split the container from algorithms
- fpd_reco (p14-br-02) - FPD reconstruction
- fpd_unpack (p14-br-05) - write out FPD info in the thumbnail packed format
- fpddigi (p14-br-01) - write out FPD info in the thumbnail packed format
- geometry_db (p14-br-v02-00-21) - new muon geometry for post March data
- mag_field_config (p14-br-v00-00-31) - use the singleton pattern in config_db_client.
- sam_manager (p14-br-07) - new SAM client, should be transparent to users
- smtutil (p14-br-v00-09-31) - Map two swapped HDI's during the shutdown
- thumbnail (p14-br-21) - Support FPD in the thumbnail
- Bug fixes
- cps_util (p14-br-15) - fix for data after the shutdown where some channels were moved and the map is correct but the wrong calibration was applied
- muon_index (p14-br-02) - code for missing bottom C hole counter
-
run_config_mgr (p14-br-02) - Fix to get CAL timing and control crate
information to be properly unpacked.. need this for the so called "mixed
events" processing
กก
- Functionality Changes
- p14.06.00
- Functionality Changes
- cft_unpackutils (p14-br-v00-02-46) – new CFT map
- cft_unpdata (p14-br-v00-47-12) – set CFT occupancy to be stored in the thumbnail
- config_base (p14-br-v00-00-18) – modify TMBTriggerChunk to store CFT occupancy
- cps_util (p14-br-04) and cps_unpdata (p14-br-06) - new CPS map
- d0reco (p14-br-16) – FPD unpacker added, removed Kalman vertexing and added RCPs for streaming. Output t42 chunk to the thumbnail+. Streaming RCP is untested.
- event_flags (p14-br-03) – sets flags for streaming
- fixp13tmb_calprob (p14-br-11) - second round of TMB fixing
- io_packages (p14-br-v00-16-26) – fill user vector in the event header (allows quick skimming)
- jet_evt (p14-br-04) – chunk modified to store JES corrections
- mag_field_config (p14-br-v00-00-30) – get correct B field for old MC (p13 or earlier)
- missingET (p14-br-05) - use t42 for MET in TMB fixing
- muo_evt (p14-br-04), muonid (p14-br-11) – add “good muon” class plus code for new bottom scintillator. Muon geometry needs to be updated to actually use the counter.
- muon_geometry (p14-br-03), muon_index (p14-br-01) – New bottom scintillator counter added
- thumbnail (p14-br-16) – Add Process hook, fix unpacking crash when there’s no L3PhysicsResult object
- fpd_unpack (p14-br-04) – FPD unpacker
- np_tmb_stream (p14-br-04) – changes to enable streaming
-
Numerous L2 updates to unpack L2 STT/CTT
information
- Bug fixes
- AATrack (p14-02-10-02b) – Speed up
- DSPACK (p14-br-07) – reduce fragmentation
- bc_liketagreco (p14-br-01) – Memory leak fix
- calorimeter_geometry (p14-br-c) – Memory leak fix
- cal_nlc (p14-br-07) – fix cal weights (d0note 4288)
- cal_corr_dst (p14-br-14) – fix MG bug and divide by 0 bug. RCP added for t42 in killing mode
- cal_t42 (p14-br-05) – Memory leak fix
- cellNN (p14-br-02) – Memory leak fix
- cft_geometry (p14-br-a) - Memory leak fix
- chpart_reco (p14-br-09) – fix the links between vertex and charged particle
- cps_evt (p14-br-02a) - fix missing CPS links in the thumbnail
- cps_geometry (p14-br-a) - Memory leak fix
- d0om_CORBA (p14-v00-03-50) - Memory leak fix
- empartfit (p14-br-01), em_evt (p14-br-03), em_util (p14-br-03), emreco (p14-br-05), hmreco (p14-br-03) – fix low bug for low pT EM objects (i.e. spike at ~5 GeV), store correctly the CPS information in the thumbnail
- fps_geometry (p14-br-f) - Memory leak fix
- gtr_htf (p14-br-09) – Memory usage reduction
- gtr_htfAA (p14-br-08) – Memory fragmentation fixes
- l3femtools (p14-br-02) – Memory fragmentation fixes
- l3tCalUnpTool (p14-br-06) – Memory fragmentation fixes
- muo_segmentlinkedlist (p14-br-01) – Memory leak fix
- name_translation (p14-br-01) - Memory fragmentation fixes
- run_config_mgr (p14-br-01) – unpack of Timing and Control crate
- silicon_geometry (p14-br-02) - Memory fragmentation fixes
- smt_hit (p14-br-02) - Memory fragmentation fixes
- trf_cut (p14-br-v00-64-06) - Memory fragmentation fixes
- vertex_analyze (p14-br-01) – Adjust for interface change
- vertex_selalg (p14-br-07) – Memory leak fix
- vertexreco (p14-br-02) – fix itest
- vkalman_fit (p14-br-01) - Memory fragmentation fixes
- vkalman_util (p14-br-01) - Memory fragmentation fixes
- wzreco (p14-br-02) – Memory leak fix
-
p14.05.02
- Bug fixes
- d0reco (p14-br-15) – apply cal_corr_dst in cal unpacking stage (for processing from RAW) and use correct min-bias file for p13 dst reprocessing
- calunpdata (p14-br-e) – remove BLS correction from this package since it is in cal_corr_dst
-
cal_corr_dst (p14-br-09) – new RCPs for processing from
RAW
- p14.05.01
-
Bug fixes
- Muonid (p14-br-08) – remove cosmic cut from MuonCandidateReco.rcp (for selective reprocessing, doesn’t affect standard muon reconstruction)
- p14.05.00
- Bug fixes
- vertex_selalg
(p14-br-06) – better histogram distribution file for minimum bias
probability calculation
- emreco (p14-br-03) – save CPS clusters matched to low energy EM particles
- missingET
(p14-br-04) – SETC now correctly uses cells above energy of 0 instead
of
some threshold
- cal_corr_dst
(p14-br-08) – fix for the cable swap problem in addition to shared
- Functionality improvements
- gtr_htf (p14-br-08), gtr_htfAA (p14-br-07) and AATrack (p14-02-10-01) - remove crumbling CFT clusters (a.k.a. cluster patterns coming from low pt particle grazing the detector) for high occupancy events
- gtrprop (p14-v00-22-49) and trfbase (p14-v00-64-20) - propagator optimization (speed up)
- muonid interface change (same as test and p15 branches)
- p14.04.00
- Bug fixes
- cps_calibration
(p14-03-01-b2) – Fix CPS calibration bug that
affected p14.03.01
data and remove debugging database access that is unnecessary.
-
cps_util
(p14-br-02) - Fix CPS calibration bug that affected p14.03.01 data.
- DSPACK (p14-br-03) - Fixes bug introduced in p14.03.01 that writes corrupted data.
- jet_evt (p14-br-03) – Fix incorrect calculation of n90, affecting mostly kT jets but at small level cone jets as well
- d0om (p14-br-01) and d0om_ds (p14-br-02) – fix allows to read “corrupted” p14.03.02
- Functionality improvements
- emreco (p14-br-02) - Take into account of the fact that the center of cal is 3 cm offset in z.
- hmreco (p14-br-02) - H-matrix calculation is modified to take this effect into account.
- unpack_cal_fe (p14-br-b) - L2 holdtimeout increased from 7 to 8 bits, R/O error bit now defunct
- Add CAL Timing and Control
crate information - correctly unpack CAL Timing and Control crate info
for both
thumbnail and DST. The thumbnail from p14.04 will have this crate info
which
adds 1 word. Packages changed are:
- caldata (p14-br-a)
- calunpdata (p14-br-d)
- thumbnail (p14-br-08)
- AATrack (p14-02-09-b1) – Speed up through the use of static matrix class rather than CLHEP matrices.
- gtr_htfAA (p14-br-06) – Proper member initialization
- l1l2_reco (p14-br-01) l1l2_evt (p14-br-08) - a few accessor methods added, meaningful L1L2 info after p13 reprocessing (without db access). This is needed for reprocessing data in remote sites.
- config_base (p14-br-v00-00-15) - make tmb global info without db access (for p13 reprocessing)
- event_info (p14-br-01) - make tmb global info without db access (for p13 reprocessing)
- fps_unpdata (p14-br-l) - fix mapping problems
- fps_geometry (p14-br-e) - updated geometry
- d0reco (p14-br-07) - stop making CFT 2D clusters (not needed), RCP change to get correct L1L2 trigger info for p13 reprocessing and improved primary vertexing
- vertex_init (p14-br-02), vertex_selalg (p14-br-03) and vertexreco (p14-br-01) – 2 pass primary vertex reconstruction and probabilistic selection algorithm implemented
- p14.03.02
- Bug fixes
- DSPACK(p14-br-03) - Fixes bug introduced in p14.03.01 that writes corrupted data.
- cps_calibration (p14-03-01-b2) – Remove debugging database access that is unnecessary.
- p14.03.01
- Bug fixes
- AATrack (p14-02-08-b3) - Fix unitialized variables.
- DSPACK (p14-br-01) - Fixes a bug that causes crashes if you try to read files containing classes with a large number of members (> ~110).
- calorimeter_geometry (p14-br-b) - 1) fixes bug that applied "south" alignments to North planes in CellPlanes 2) reinitializes CellPlanes when CalGeometer::refresh is called.
- chpart_evt (p14-br-04) - Rearrange code so it can run on ChargedParticleChunk.
- chpart_reco (p14-br-06) - Rearrange code so it can run on ChargedParticleChunk.
- cps_unpdata (p14-03-01-b1) - Adapt to CPS interface change in cps_util.
- cps_util (p14-03-01-b1) - Add protection for FPE if mip_values = 0; changed the data types of some internal data members, namely CPS calibration constants, from int to float..
- fps_address (p14-br-e) - Fix phi bug.
- fps_reco (p14-br-h) - Fix phi bug.
- fps_unpdata (p14-br-j) - Fix phi bug.
- kt_jets (p14-br-01) - Fix phi wrap-around bug.
- l1l2unpacker (p14-br-01) - Fix for corrupt CTT data.
- l3fcpsunp (p14-03-01-b1) - Adapt to CPS interface change.
- missingET (p14-br-02) - New variables plus a couple of other requested changes > (return cell-based info in default methods rather than tower-based, > compute eta rings from cells rather than towers).
- muo_hitreco (p14-br-02) - Prepare for new gas constants.
- muo_segment (p14-03-01-b1) - Fix unitialized variable.
- muo_segmentreco (p14-br-02) - Prepare for new gas constants.
- muo_util (p14-br-05) - Prepare for new gas constants.
- muon_geometry (p14-br-02) - Fix diffs in tests.
- silicon_geometry (p14-br-v02-04-33) - Speed up instantiation of SMT 2D and 1D chunks when read from the DST file.
- smt_d0hit (p14-br-v00-02-62) - Speed up instantiation of SMT 2D and 1D chunks when read from the DST file.
- smt_hit (p14-br-v00-06-24) - Speed up instantiation of SMT 2D and 1D chunks when read from the DST file.
- taureco (p14-br-02) - Bugfix that saves PS clusters associated with taus
- trfcyl (p14-v00-64-34) - Fix a FPE divide-by-zero.
- wzreco (v00-06-05) -
- Functionality improvements
- cps_calibration (p14-03-01-b1) - Decode channel id instead of going to db, to speed up access.
- fixp13tmb_calprob (p14-br-01) - Reprocess the p13 thumbnails, apply a fix for one calorimeter readout problem (affecting data collected between january and april 2003), rerun the jet, electron, missing Et, tau and b-tagging reconstruction packages, create a new thumbnail file with the reconstruced objects.
- jetreco (p14-br-01) - New rcps to support fixp13tmb_calprob.
- recocert (p14-br-v03-03-00) - Improved version ready for shifters.
- smt_hitalgs (p14-br-v00-05-64) - Improve 1D hit positions calculations.
- smt_lpos (p14-br-v00-06-30) - Improve 1D hit positions calculations.
- p14.03.00
- Bug fixes
- bcjet_evt (p14-03-00-b3) - Fix unitialized variables.
- cal_nada_analyze (p14-br-02) - Fix error in tests.
- calreco (p14-br-03) - Fix to prevent accessing arrays out-of-bounds.
- calroad (p14-br-01) - Fix very rare floating-point exception error.
- cft_unpdata (p14-br-v00-47-10) - Fixes for the CFT unpacking if the pedestals are read from ASCII files, to support examines.
- chpart_evt (p14-br-03) - Remove eta cutoff in ChargedParticle::unpThumbNail.
- chpart_reco (p14-br-05) - The calculation of vertex chisq using track dca was not being divided by the error so the best vertex was being selected by dca rather than chisq.
- cps_evt (p14-br-01) - Fix handling of wraparound when filling thumbnail objects (from Scott).
- config_base (p14-br-v00-00-14) - Record field configuration in the Global object for the MC files.
- d0omCORBA (p14-v00-03-48a) - Get fully qualified hostname. Use getpwuid instead of getlogin to get username.
- fps_address (p14-03-00-b3) - Fix unitialized variables.
- fps_reco (p14-03-00-b3) - Fix unitialized variables.
- gtr_htf (p14-br-05) - Fix un-initialized variables (from Scott).
- gtr_htfAA (p14-br-05) - Fix un-initialized variables (from Scott).
- gtrprop (p14-v00-22-47) - Fix memory leak.
- io_util (p14-v00-02-19) - Support new SAM API.
- l1l2_evt (p14-br-06) - Protect against too many track sectors for internal arrays.
- mag_field_config (p14-br-v00-00-29) - Record field configuration in the Global object for the MC files.
- missingET (p14-03-00-b3) - Prevent accessing array out-of-bounds.
- muo_centralmatch (p14-03-00-b3) - Fix unitialized variables.
- muo_hitreco (p14-03-00-b3) - Fix unitialized variables.
- muo_segment (p14-03-00-b3) - Fix unitialized variables.
- muo_segmentreco (p14-03-00-b3) - Fix unitialized variables.
- muonid (p14-br-05) - This fix stores the proper BC local informations in the thumbnail for nseg=+/-2 (i.e. BC matched with a central track or BC segment only). The local information (local position and momentum for BC only muons) was not stored for nseg=+2 muons and corrupted for nseg=-2. We now store in the tmb, the local *BC* info, which is the only local info available, in case of |nseg|=2 muons (even if the variables are called xA, yA, pxA, etc ...).
- muo_util (p14-br-03) - Added a component test for the new class RunNumber; skip the extra t0 corrections if RunNumber has not been set, instead of aborting the program.
- tau_evt (p14-03-00-b3) - Fix unitialized variables.
- wz_evt (p14-03-00-b3) - Fix unitialized variables.
- Functionality improvements
- analysis_utilities (p14-br-01) - Fixes a feature necessary to be able to access the trigger information in the analysis phase for MC and for data which had been re-trigsimmed.
- AATrack (p14-02-08-b2) - Clean up memory after processing event, to reduce memory fragmentation (speeds up RECO and reduces memory footprint).
- cal_corr_dst (p14-br-01) - New package to perform fixes to calorimeter energy sharing for dst reprocessing.
- cal_nlc (p14-br-05) - Install backward compatibility to hide interface change; support cal_corr_dst.
- calunpdata (p14-br-c) - Correction of the calorimeter shared energy problem (description of solution, before plot, after plot).
- d0reco (p14-br-04)
- Remove Run I R=0.5 jet algorithms from standard processing, as agreed to by all physics groups.
- Override STL memory allocator with d0_util version, to improve CPU time per event.
- Publish the files from ${ROOT_DIR} into rundata/root/ to support RTE.
- Support changes necessary to be able to access the trigger information in the analysis phase for MC and for data which had been re-trigsimmed (new D0recoTrigDecode.rcp).
- Support reprocessing p13 dst. New format: "data_reprocess_p13dst".
- Clean up old rcps.
- d0_util (p14-br-03) - Add support to override STL allocators with fast allocator.
- framework (p14-br-01) - Improve memory monitoring.
- fwkevent_timing (v00-00-02) - Improve memory monitoring.
- fwkprofiling (p14-br-01) - Improve memory monitoring.
- geometry_db (p14-br-v02-00-15) - New muon geometry for data taken between July, 2002 and February, 2003. Fixes incorrect rotation.
- gtr_find (p14-v00-23-02c) - Clean up memory after processing event, to reduce memory fragmentation (speeds up RECO and reduces memory footprint).
- gtr_htfAA (p14-br-04) - Clean up memory after processing event, to reduce memory fragmentation (speeds up RECO and reduces memory footprint).
- gtr_sys (p14-v00-22-40a) - Override STL memory allocator with d0_util version, to improve CPU time per event.
- io_packages (p14-v00-16-23) - Speed up pick_events.
- l3fchunk (p14-br-03) - Changes to handle L3BTagIPPhysicsResults and to save numbers of hits for tracks.
- memutil (p14-br-01) - Added the ability to produce a report of memory allocations/deallocations.
- muo_hitreco (p14-br-01), muo_segmentreco (p14-br-01), muo_util (p14-br-01) - Use the proper PDT t0's depending on the run period.
- smt_calibdata (p14-br-v00-00-14), smt_config (p14-br-v00-00-20) , smtraw (p14-br-v00-06-85) - Make SMT calibration constants consume less memory.
- thumbnail (p14-br-07) - Changes to handle L3BTagIPPhysicsResults and to save numbers of hits for tracks.
- p14.02.00
- Bug fixes
- cal_t42 - Fix memory leak; add Calt42Combine.cpp .hpp .rcp.
- chpart_evt - Fix thumbnail unpacking of qoverp.
- cps_unpdata
- Updated map files.
- Fix db access for first event.
- d0rec
- Create runD0reco_data_farm.rcp and reco_init_farm.rcp to employ farm calibration db server.
- Remove duplicate creation of thumbnails when reprocessing data DST's.
- RTE fix: modify d0reco_x-runtime.sh to copy files in rundata/gtr_find/* into directory that d0reco executable will use as its current working directory.
- em_analyze - Add std namespace to cout and endl in two files in root_macros/D0Util/ directory.
- emreco:
- CalScone0401-mcvtx.rcp: Add RCP parameters for ability to drop CH
- EMReco-cnn-mcvtx.rcp: Replace CellNN-mcvtx by CellNN_mcvtx in clusterer name.
- em_evt - Update with new pmcs names; protect against bad floorXYZ.
- fps_address - Remove asserts that cause fps_reco ctest to fail.
- fps_geometry - Fix ctest
- fps_reco - Set debug print flag to false.
- fps_unpdata - Fix one value in calibration file; update to version p14-br-h to fix bugs.
- gtr_find - Updated gtr_find_get_obs and gtr_find_get_rdata_obs for new obs files.
- gtr_htf - Upgrade to v00-02-16; bug fix to prevent FPE errors (kappa=0).
- gtr_mcsim - Remove debug printout.
- l1l2_evt - Fix bug causing crash when processing MC file that did not go through trigsim.
- l3fchunk / thumbnail - Fix L3 quantities (missing Et and all of the track parameters) in the thumbnail.
- muo_alignment - Added missing stds in bin directory.
- recocert - Fix UPS table.
- smt_config - Deal with the missing Status word in the SMT calibration database. Revert to the p13 method for now. Effect is to significantly reduce the number of noise hits in the SMT and speed up RECO by at least 20%.
- sftdigi - Fixed bug in CFTFiberGeometry that was returning average fiber positions instead of individual positions (affected MC).
- tmb_tree - Fix Tref bug in TMBEmclMaker.cpp
- trfdca - Remove some assertions in certain propagators and let the propagators simply return propagation failure instead.
- vertex_init - Fix minor bugs in z-cone clustering.
- vertex_evt - When looking at matching vertex positions, wasn't looking at z position; fixed.
- Functionality improvements
- bc_likeTagreco - Rework interface to speed up unpacking of thumbnail.
- calibration_management - Added a command line switch for farm servers; remove obsolete farm rcp.
- caltables / calunpdata - Modified ICD ADC-to-GeV conversion factor.
- chpart_reco - Fixed FPS Z position for data and MC.
- geometry_db (version p14-br-v02-00-14):
- Fix rotations in muon detectors (improves matching to tracker).
- RTE support.
- Redo SMT/CFT alignment with magnet off data. This new alignment significantly improves the Z mass width.
- fps - New versions of fps_analyze, fps_unpdata, fps_address, fps_reco, fps_geometry, fps_event - tune for real data, reduce chunk size, general rework.
- fps_geometry - Update to p14-br-c.
- fps_reco - Adjust thresholds to reduce DST size (not yet optimized).
- fps_unpdata - Version p14-br-g of map.
- l1l2_evt - Increase the number of trigger towers written into L1L2Chunk to 1280. Introduce two constants to separate the run periods in which the L1Cal trigger was functional up to eta=|0.8|, eta=|2.4| and full detector. Introduce a new inline method for accessing the number of towers being used in the trigger as a function of the run number. Make L1CTT information in L1L2Chunk useful and complete.
- l3fchunk, l3femtools - Add methods for thumbnail support of data taken with p15.
- recocert - Updated certification plots and utilities to merge files.
- silicon_geometry - Support for RTE.
- smtraw - New pedestal files.
- thumbnail - Support bc_likeTagreco interface change to speed up unpacking of thumbnail, include new L3 electron "resc" widths in thumbnail.
- vertex_init - Loosen initial z cone cluster cuts.
- vtrkimp - Add a default 0.5 GeV track cut for primary vertexing.
- p14.01.00
- Bug fixes
- bc_eTagreco - Fix problems in case an EMparticle is associated with more than one ChargedParticle.
- bc_muTagreco - Fix bug in muTagUtilities::getPtRel which caused rare crashes.
- cft_unpack_util - Fix CFT wire map with 2 fibers inadvertently swapped.
- chpart_evt - Change q/pT packing for ChTmbObj.
- chpart_reco - Fix extrapolation to CPS; fix chisq/ndof.
- config_base - Fix toroid polarity.
- d0reco - Remove CftClusterChunk from DropChunks_ReprocessDST.rcp
- d0omCORBA / d0omORACLE - Update tests to support change from Oracle 8.0.5 to 8.1.7
- em_evt - Change the number of bits used for chpindex in ChTmbObj from 8 to 12.
- empartfit - Protect against crash due to empty mapchi2.
- fps_unpdata - Minor mapping fix.
- gtr_htf
- Fix crashing when processing
p13.08.00
- Remove debug printout.
- jet_evt - Add protection in the << operator for Jet class: it was crashing on TMB because some information is missing.
- l1l2_evt - Fix bug involving decoding of L1 muon trigger information.
- mag_field - Fix bug with getting correct polarities.
- mag_field_geometry - Fix tests.
- muon_geometry - Fix tests.
- muonid - Fix bug dealing with handling internal arrays.
- prod_history - Support adding calibration id information.
- sam_manager - Allow graceful ending of job if SAM times out.
- tau_evt - Fix thumbnail unpacking of ntrk1,2,3
- tau_reco - Fix R for ntrk,1,2,3 calculation.
- trfzp - Fix floating point exception error.
- Functionality improvements
- cal_t42 - New calorimeter clustering algorithm
- calibration_management
- Add rcp for farm production.
- Add top level calibration ID to history chunk.
- Remove vtx_topo from the list of RCPs reco_vtx.rcp.
- calreco - Remove CH from seeds.
- d0omCORBA - There are two significant changes relative to the old p13 version, which are a) remove python module SAM from global python path, which has a naming conflict with product sam_common, and b) add server reconnect feature.
- d0reco - Install cal_t42.
- emreco - Increase number of CPS clusters in thumbnail.
- energycluster - Remove CH from seeds.
- fps_analyze - Updates.
- geometry_db
- Release July, 02 muon geometry.
- Release Feb, 03 muon geometry
- gtr_find - Make AA/HTF the default.
- io_packages - Add class RemoteFileExpander which allows reading from a remote node.
- np_tmb_stream - Install latest features.
- root - Upgrade to at least 3_03_09a.
- run_d0reco - Install cal_t42 run time file.
- tau_clusterreco - Add RCP parameters required by the new CH handling algorithm.
- valgimp_primary - Primary vertices are now found by making a chi2/ndof on the vertex, not by making a track chi2 contribution. Should remove almost all split vertices.
- p14.00.00
- First version.
General Information
Users of this release are encouraged to report issues / fixes / "whatever" that might be useful to others using this release.
This page maintained by Suyong Choi