p17repro_recoveryset_v2_001 18-Dec-2005 06:00:00 (UTC) wicke d0production ===================== 23 files missing. all_0000155605_015.raw (Never processed. Likely corrupted) all_0000155605_018.raw (see below) all_0000157596_001.raw (Never processed. Likely corrupted) all_0000158041_001.raw (No derived files of any version exist for run 158041) all_0000158041_002.raw (No derived files of any version exist for run 158041) all_0000158041_003.raw (No derived files of any version exist for run 158041) all_0000158041_004.raw (No derived files of any version exist for run 158041) all_0000158041_006.raw (No derived files of any version exist for run 158041) all_0000158041_005.raw (No derived files of any version exist for run 158041) all_0000178241_048.raw (see below) all_0000178310_015.raw (see below) all_0000178376_115.raw (see below) all_0000178388_023.raw (see below) all_0000178392_135.raw (see below) all_0000178393_051.raw (see below) all_0000178420_122.raw (see below) all_0000178447_096.raw (see below) all_0000178522_103.raw (see below) all_0000178722_050.raw (see below) all_0000178723_142.raw (see below) all_0000178761_161.raw (see below) all_0000178852_214.raw (see below) all_0000178864_009.raw (see below) 15 Files crashed multiple tims in the same event: (get_event.sh -id d0farm_fnd0101.fnal.gov_181058_26600 ; get_event.sh -id d0farm_fnd0101.fnal.gov_091300_8359 ; get_event.sh -id d0farm_fnd0101.fnal.gov_171151_12358 ) | sort Finished staging input file all_0000155605_018.raw Events Read: Tot. 517 | 1st 0000155605.0000689038 | Last 0000155605.0000690817 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000155605_018.raw Events Read: Tot. 517 | 1st 0000155605.0000689038 | Last 0000155605.0000690817 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000155605_018.raw Events Read: Tot. 517 | 1st 0000155605.0000689038 | Last 0000155605.0000690817 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178241_048.raw Events Read: Tot. 2579 | 1st 0000178241.0017119376 | Last 0000178241.0017150812 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178241_048.raw Events Read: Tot. 2579 | 1st 0000178241.0017119376 | Last 0000178241.0017150812 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178241_048.raw Events Read: Tot. 2579 | 1st 0000178241.0017119376 | Last 0000178241.0017150812 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178310_015.raw Events Read: Tot. 773 | 1st 0000178310.0008907939 | Last 0000178310.0008910500 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178310_015.raw Events Read: Tot. 773 | 1st 0000178310.0008907939 | Last 0000178310.0008910500 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178310_015.raw Events Read: Tot. 773 | 1st 0000178310.0008907939 | Last 0000178310.0008910500 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178376_115.raw Events Read: Tot. 1877 | 1st 0000178376.0040646857 | Last 0000178376.0040682943 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178376_115.raw Events Read: Tot. 1877 | 1st 0000178376.0040646857 | Last 0000178376.0040682943 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178376_115.raw Events Read: Tot. 1877 | 1st 0000178376.0040646857 | Last 0000178376.0040682943 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178388_023.raw Events Read: Tot. 998 | 1st 0000178388.0001124436 | Last 0000178388.0001133894 | Status open No exit code available ford0 executable. User executable exited with code 1 Finished staging input file all_0000178388_023.raw Events Read: Tot. 998 | 1st 0000178388.0001124436 | Last 0000178388.0001133894 | Status open No exit code available ford0 executable. User executable exited with code 1 Finished staging input file all_0000178388_023.raw Events Read: Tot. 998 | 1st 0000178388.0001124436 | Last 0000178388.0001133894 | Status open No exit code available ford0 executable. User executable exited with code 1 Finished staging input file all_0000178392_135.raw Events Read: Tot. 2092 | 1st 0000178392.0041639237 | Last 0000178392.0041679813 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178392_135.raw Events Read: Tot. 2092 | 1st 0000178392.0041639237 | Last 0000178392.0041679813 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178392_135.raw Events Read: Tot. 2092 | 1st 0000178392.0041639237 | Last 0000178392.0041679813 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178393_051.raw Events Read: Tot. 2081 | 1st 0000178393.0047273025 | Last 0000178393.0047312177 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178393_051.raw Events Read: Tot. 2081 | 1st 0000178393.0047273025 | Last 0000178393.0047312177 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178393_051.raw Events Read: Tot. 2081 | 1st 0000178393.0047273025 | Last 0000178393.0047312177 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178420_122.raw Events Read: Tot. 2008 | 1st 0000178420.0004626208 | Last 0000178420.0004659867 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178420_122.raw Events Read: Tot. 2008 | 1st 0000178420.0004626208 | Last 0000178420.0004659867 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178447_096.raw Events Read: Tot. 1607 | 1st 0000178447.0012993551 | Last 0000178447.0013045631 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178447_096.raw Events Read: Tot. 1607 | 1st 0000178447.0012993551 | Last 0000178447.0013045631 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178447_096.raw Events Read: Tot. 1607 | 1st 0000178447.0012993551 | Last 0000178447.0013045631 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178522_103.raw Events Read: Tot. 2718 | 1st 0000178522.0049923952 | Last 0000178522.0049952688 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178522_103.raw Events Read: Tot. 2718 | 1st 0000178522.0049923952 | Last 0000178522.0049952688 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178522_103.raw Events Read: Tot. 2718 | 1st 0000178522.0049923952 | Last 0000178522.0049952688 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000178722_050.raw Events Read: Tot. 559 | 1st 0000178722.0010184527 | Last 0000178722.0010204328 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178722_050.raw Events Read: Tot. 559 | 1st 0000178722.0010184527 | Last 0000178722.0010204328 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178723_142.raw Events Read: Tot. 913 | 1st 0000178723.0031159098 | Last 0000178723.0031176321 | Status open No exit code available ford0 executable. User executable exited with code 1 Finished staging input file all_0000178723_142.raw Events Read: Tot. 913 | 1st 0000178723.0031159098 | Last 0000178723.0031176321 | Status open No exit code available ford0 executable. User executable exited with code 1 Finished staging input file all_0000178761_161.raw Events Read: Tot. 1520 | 1st 0000178761.0021528836 | Last 0000178761.0021576611 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178761_161.raw Events Read: Tot. 1520 | 1st 0000178761.0021528836 | Last 0000178761.0021576611 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178761_161.raw Events Read: Tot. 1520 | 1st 0000178761.0021528836 | Last 0000178761.0021576611 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178852_214.raw Events Read: Tot. 443 | 1st 0000178852.0025604091 | Last 0000178852.0025610593 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178852_214.raw Events Read: Tot. 443 | 1st 0000178852.0025604091 | Last 0000178852.0025610593 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178852_214.raw Events Read: Tot. 443 | 1st 0000178852.0025604091 | Last 0000178852.0025610593 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000178864_009.raw Events Read: Tot. 1757 | 1st 0000178864.0000860017 | Last 0000178864.0000895009 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178864_009.raw Events Read: Tot. 1757 | 1st 0000178864.0000860017 | Last 0000178864.0000895009 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000178864_009.raw Events Read: Tot. 1757 | 1st 0000178864.0000860017 | Last 0000178864.0000895009 | Status open No exit code available for d0 executable. User executable exited with code 1 COMPLETE FROM HELD INPUTS p17repro_recoveryset_v2_002 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_003 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_004 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_005 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_006 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_007 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_008 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 207 missing. The following errors occured twice $ ( get_event.sh -id d0farm_fnd0101.fnal.gov_101410_23850 ; get_event.sh -id d0farm_fnd0101.fnal.gov_102847_3435 ) | sort Finished staging input file all_0000179110_015.raw Events Read: Tot. 1814 | 1st 0000179110.0000851856 | Last 0000179110.0000881829 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179143_161.raw Events Read: Tot. 1244 | 1st 0000179143.0038837767 | Last 0000179143.0038865631 | Status open D0 executable exited with code 134 User executable exited with code 134 Whats up with the remaining stuff? all_0000179196_001.raw to all_0000179196_205.raw: No derived files of any version exist for run 179196 FINISHED p17repro_recoveryset_v2_009 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 87 files missing: all_0000179240_016.raw [processed in p14] [Crashed twice after Tot. 1675 event with different d0reco exit codes.] all_0000179556_033.raw (crashed twice in same event, see below) all_0000179897_001.raw (1) all_0000179899_002.raw(1) all_0000179899_001.raw(1) all_0000179900_001.raw(1) all_0000179901_001.raw(1) all_0000179902_001.raw (crashed twice in same event, see below) all_0000179902_002.raw(1) all_0000179902_003.raw(1) all_0000179902_004.raw(1) all_0000179902_005.raw(1) all_0000179902_006.raw (crashed twice in same event, see below) all_0000179902_007.raw(1) all_0000179902_008.raw(1) all_0000179902_009.raw (crashed twice in same event, see below) all_0000179902_010.raw(1) all_0000179902_011.raw(1) all_0000179902_012.raw (crashed twice in same event, see below) all_0000179902_013.raw(1) all_0000179902_014.raw (crashed twice in same event, see below) all_0000179902_015.raw(1) all_0000179902_016.raw(1) all_0000179902_017.raw(1) all_0000179902_018.raw (crashed twice in same event, see below) all_0000179902_019.raw(1) all_0000179902_020.raw(1) all_0000179902_021.raw(1) all_0000179902_022.raw(1) all_0000179902_023.raw(1) all_0000179902_024.raw(1) all_0000179902_025.raw(1) all_0000179902_026.raw(1) all_0000179902_027.raw(1) all_0000179902_028.raw (crashed twice in same event, see below) all_0000179902_029.raw(1) all_0000179902_030.raw(1) all_0000179902_031.raw(1) all_0000179902_032.raw(1) all_0000179902_033.raw(1) all_0000179902_034.raw(1) all_0000179902_035.raw(1) all_0000179902_036.raw(1) all_0000179902_037.raw (crashed twice in same event, see below) all_0000179902_038.raw(1) all_0000179902_039.raw(1) all_0000179902_040.raw(1) all_0000179902_041.raw(1) all_0000179902_042.raw(1) all_0000179902_043.raw(1) all_0000179902_044.raw(1) all_0000179902_045.raw (crashed twice in same event, see below) all_0000179902_046.raw (crashed twice in same event, see below) all_0000179902_047.raw (crashed twice in same event, see below) all_0000179902_048.raw (crashed twice in same event, see below) all_0000179902_049.raw(1) all_0000179902_050.raw(1) all_0000179902_051.raw(1) all_0000179902_052.raw(1) all_0000179902_053.raw(1) all_0000179902_054.raw (crashed twice in same event, see below) all_0000179902_055.raw(1) all_0000179902_056.raw(1) all_0000179902_057.raw(1) all_0000179902_058.raw(1) all_0000179902_059.raw (crashed twice in same event, see below) all_0000179902_060.raw(1) all_0000179902_061.raw (crashed twice in same event, see below) all_0000179902_062.raw(1) all_0000179902_063.raw (crashed twice in same event, see below) all_0000179902_064.raw(1) all_0000179902_065.raw(1) all_0000179902_066.raw(1) all_0000179902_067.raw(1) all_0000179902_068.raw(1) all_0000179902_069.raw(1) all_0000179902_070.raw(1) all_0000179902_071.raw(1) all_0000179902_072.raw(1) all_0000179902_073.raw (crashed twice in same event, see below) all_0000179902_074.raw (crashed twice in same event, see below) all_0000179902_075.raw (crashed twice in same event, see below) all_0000179903_002.raw(1) all_0000179904_002.raw(1) all_0000179903_001.raw(1) all_0000179904_001.raw(1) all_0000179905_001.raw(1) (1) MikeD: Runs 179897-179908 are all runs taken with the solenoid off or at some funny value. This isn't useful physics data. 20 files crashed twice Finished staging input file all_0000179556_033.raw Events Read: Tot. 863 | 1st 0000179556.0002010343 | Last 0000179556.0002024861 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_001.raw Events Read: Tot. 2 | 1st 0000179902.0030142803 | Last 0000179902.0030142972 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_006.raw Events Read: Tot. 2 | 1st 0000179902.0030530835 | Last 0000179902.0030530797 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_009.raw Events Read: Tot. 3 | 1st 0000179902.0030721730 | Last 0000179902.0030721858 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_012.raw Events Read: Tot. 2 | 1st 0000179902.0030908081 | Last 0000179902.0030908134 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_014.raw Events Read: Tot. 2 | 1st 0000179902.0031030875 | Last 0000179902.0031030885 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_018.raw Events Read: Tot. 2 | 1st 0000179902.0031274282 | Last 0000179902.0031274424 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_028.raw Events Read: Tot. 2 | 1st 0000179902.0031880321 | Last 0000179902.0031880386 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_037.raw Events Read: Tot. 3 | 1st 0000179902.0032572469 | Last 0000179902.0032572564 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_045.raw Events Read: Tot. 4 | 1st 0000179902.0033299350 | Last 0000179902.0033299407 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_046.raw Events Read: Tot. 2 | 1st 0000179902.0033397499 | Last 0000179902.0033397490 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_047.raw Events Read: Tot. 3 | 1st 0000179902.0033495482 | Last 0000179902.0033495348 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_048.raw Events Read: Tot. 2 | 1st 0000179902.0033593605 | Last 0000179902.0033593642 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_054.raw Events Read: Tot. 2 | 1st 0000179902.0034081126 | Last 0000179902.0034080964 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_059.raw Events Read: Tot. 3 | 1st 0000179902.0034479805 | Last 0000179902.0034479935 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_061.raw Events Read: Tot. 3 | 1st 0000179902.0034577610 | Last 0000179902.0034577639 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_063.raw Events Read: Tot. 2 | 1st 0000179902.0034700360 | Last 0000179902.0034700536 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_073.raw Events Read: Tot. 6 | 1st 0000179902.0035393863 | Last 0000179902.0035394014 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_074.raw Events Read: Tot. 2 | 1st 0000179902.0035504958 | Last 0000179902.0035505100 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179902_075.raw Events Read: Tot. 2 | 1st 0000179902.0035620365 | Last 0000179902.0035620194 | Status open D0 executable exited with code 134 User executable exited with code 134 HELD p17repro_recoveryset_v2_010 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 25 missing. all_0000179906_001.raw (1) [was done in p14.03.01!!] all_0000179907_001.raw (1) [was done in p14.03.01!!] all_0000179908_001.raw (crashed twice in same event, see below) all_0000179908_002.raw (1) all_0000179908_003.raw (crashed twice in same event, see below) all_0000179908_004.raw (1) all_0000179908_005.raw (1) all_0000179908_006.raw (1) all_0000179908_007.raw (1) all_0000179908_008.raw (crashed twice in same event, see below) all_0000179908_009.raw (1) all_0000179908_010.raw (1) all_0000179908_011.raw (crashed twice in same event, see below) all_0000179908_012.raw (1) all_0000180130_012.raw (crashed twice in same event, see below) all_0000180131_135.raw (crashed twice in same event, see below) all_0000180131_165.raw (crashed twice in same event, see below) all_0000180138_044.raw (crashed twice in same event, see below) all_0000180243_007.raw (crashed twice in same event, see below) all_0000180282_019.raw (crashed twice in same event, see below) all_0000180335_130.raw (crashed twice in same event, see below) all_0000180335_137.raw (crashed twice in same event, see below) all_0000180405_006.raw (crashed twice in same event, see below) all_0000180428_037.raw (crashed twice in same event, see below) (1) MikeD: Runs 179897-179908 are all runs taken with the solenoid off or at some funny value. This isn't useful physics data. 15 failed twice in the same event: Finished staging input file all_0000179907_001.raw Events Read: Tot. 2 | 1st 0000179907.0035703167 | Last 0000179907.0035703180 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179908_003.raw Events Read: Tot. 3 | 1st 0000179908.0035714859 | Last 0000179908.0035714862 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179908_008.raw Events Read: Tot. 3 | 1st 0000179908.0035746628 | Last 0000179908.0035746636 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000179908_011.raw Events Read: Tot. 2 | 1st 0000179908.0035765490 | Last 0000179908.0035765498 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180116_201.raw Events Read: Tot. 229 | 1st 0000180116.0011209205 | Last 0000180116.0011212520 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180130_012.raw Events Read: Tot. 2171 | 1st 0000180130.0000741321 | Last 0000180130.0000794042 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180131_135.raw Events Read: Tot. 863 | 1st 0000180131.0016013268 | Last 0000180131.0016028073 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180131_165.raw Events Read: Tot. 2043 | 1st 0000180131.0017646924 | Last 0000180131.0017694707 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000180138_044.raw Events Read: Tot. 353 | 1st 0000180138.0002352696 | Last 0000180138.0002356236 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180243_007.raw Events Read: Tot. 859 | 1st 0000180243.0007662411 | Last 0000180243.0007683592 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000180282_019.raw Events Read: Tot. 2450 | 1st 0000180282.0001474676 | Last 0000180282.0001555620 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000180335_130.raw Events Read: Tot. 1950 | 1st 0000180335.0054560041 | Last 0000180335.0054599872 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180335_137.raw Events Read: Tot. 1594 | 1st 0000180335.0054860836 | Last 0000180335.0054891709 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180405_006.raw Events Read: Tot. 1069 | 1st 0000180405.0023704232 | Last 0000180405.0023734857 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180428_037.raw Events Read: Tot. 1368 | 1st 0000180428.0033222181 | Last 0000180428.0033246900 | Status open D0 executable exited with code 134 User executable exited with code 134 COMPLETE FROM FINISHED INPUTS p17repro_recoveryset_v2_011 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 56 missing. all_0000152415_053.raw (crashed twice in same event, see below) all_0000152649_001.raw (crashed twice in same event, see below) all_0000152649_002.raw (crashed twice in same event, see below) all_0000152649_003.raw (crashed twice in same event, see below) all_0000152649_004.raw (crashed twice in same event, see below) all_0000152649_005.raw (crashed twice in same event, see below) all_0000152649_006.raw (crashed twice in same event, see below) all_0000152649_007.raw (crashed twice in same event, see below) all_0000153190_001.raw (Not processed after p10. Likely corrupted) all_0000154041_076.raw (crashed twice in same event, see below) all_0000154598_227.raw (crashed twice in same event, see below) all_0000154610_017.raw (crashed twice in same event, see below) all_0000155120_005.raw (crashed twice in same event, see below) all_0000158974_026.raw (crashed twice in same event, see below) all_0000159446_015.raw (crashed twice in same event, see below) all_0000160361_024.raw (crashed twice in same event, see below) all_0000160694_129.raw (Processed p14, prm335 FIle lost in tape copy) all_0000160694_154.raw (Processed p14, prm335 FIle lost in tape copy) all_0000160694_179.raw (Processed p14, prm335 FIle lost in tape copy) all_0000160700_011.raw (Processed p14, prm335 FIle lost in tape copy) all_0000160704_013.raw (Processed p14, prm335 FIle lost in tape copy) all_0000161099_010.raw [No location in SAM ] all_0000161293_001.raw to all_0000161293_023.raw (Run 161293 has no derived files of any version) all_0000161293_022.raw (Never processed. Likely corrupted) all_0000180449_165.raw (crashed twice in same event, see below) all_0000180531_163.raw (crashed twice in same event, see below) all_0000180790_044.raw (crashed twice in same event, see below) all_0000185746_045.raw (crashed twice in same event, see below) all_0000185750_107.raw (crashed twice in same event, see below) all_0000185750_151.raw (crashed twice in same event, see below) all_0000185751_064.raw (crashed twice in same event, see below) all_0000185751_131.raw (crashed twice in same event, see below) all_0000185806_065.raw (crashed twice in same event, see below) all_0000194340_100.raw (crashed twice in same event, see below) all_0000194447_234.raw (crashed twice in same event, see below) Finished staging input file all_0000152415_053.raw Events Read: Tot. 875 | 1st 0000152415.0000468072 | Last 0000152415.0000470224 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_001.raw Events Read: Tot. 62 | 1st 0000152649.0000000021 | Last 0000152649.0000000312 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_002.raw Events Read: Tot. 51 | 1st 0000152649.0000005325 | Last 0000152649.0000005498 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_003.raw Events Read: Tot. 216 | 1st 0000152649.0000010120 | Last 0000152649.0000010809 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_004.raw Events Read: Tot. 200 | 1st 0000152649.0000014835 | Last 0000152649.0000015399 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_005.raw Events Read: Tot. 266 | 1st 0000152649.0000019599 | Last 0000152649.0000020395 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_006.raw Events Read: Tot. 221 | 1st 0000152649.0000024269 | Last 0000152649.0000024864 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000152649_007.raw Events Read: Tot. 12 | 1st 0000152649.0000029011 | Last 0000152649.0000029066 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000154041_076.raw Events Read: Tot. 857 | 1st 0000154041.0000368005 | Last 0000154041.0000369880 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000154598_227.raw Events Read: Tot. 606 | 1st 0000154598.0001374798 | Last 0000154598.0001376243 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000154610_017.raw Events Read: Tot. 521 | 1st 0000154610.0000331359 | Last 0000154610.0000332074 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000155120_005.raw Events Read: Tot. 3034 | 1st 0000155120.0000037100 | Last 0000155120.0000045621 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000158974_026.raw Events Read: Tot. 685 | 1st 0000158974.0012201619 | Last 0000158974.0012204691 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000159446_015.raw Events Read: Tot. 820 | 1st 0000159446.0002134442 | Last 0000159446.0002139239 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000160361_024.raw Events Read: Tot. 1307 | 1st 0000160361.0002928086 | Last 0000160361.0002930695 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000180449_165.raw Events Read: Tot. 1070 | 1st 0000180449.0008994510 | Last 0000180449.0009020339 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000180531_163.raw Events Read: Tot. 1102 | 1st 0000180531.0023986222 | Last 0000180531.0024006875 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000180790_044.raw Events Read: Tot. 1306 | 1st 0000180790.0012023547 | Last 0000180790.0012059239 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185746_045.raw Events Read: Tot. 1547 | 1st 0000185746.0003189748 | Last 0000185746.0003210433 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000185750_107.raw Events Read: Tot. 1790 | 1st 0000185750.0010142836 | Last 0000185750.0010162063 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185750_151.raw Events Read: Tot. 1412 | 1st 0000185750.0011245930 | Last 0000185750.0011260277 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185751_064.raw Events Read: Tot. 1002 | 1st 0000185751.0014127217 | Last 0000185751.0014137980 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185751_131.raw Events Read: Tot. 270 | 1st 0000185751.0015673376 | Last 0000185751.0015676363 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185806_065.raw Events Read: Tot. 2131 | 1st 0000185806.0045796143 | Last 0000185806.0045829361 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000194340_100.raw Events Read: Tot. 2040 | 1st 0000194340.0031515371 | Last 0000194340.0031552120 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000194447_234.raw Events Read: Tot. 1454 | 1st 0000194447.0058202789 | Last 0000194447.0058236868 | Status open D0 executable exited with code 134 User executable exited with code 134 p17repro_recoveryset_v2_012 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_013 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 86 missing. all_0000162594_179.raw (Never processed. Likely corrupted) all_0000163387_043.raw (Never processed. Likely corrupted) all_0000163938_191.raw (Never processed. Likely corrupted) all_0000163938_192.raw (Never processed. Likely corrupted) all_0000163938_193.raw (Never processed. Likely corrupted) 81: Failed twice in the same event: ( get_event.sh -id d0farm_fnd0101.fnal.gov_145758_5508 ; get_event.sh -id d0farm_fnd0101.fnal.gov_151953_9794 ) | sort | uniq -d Finished staging input file all_0000162012_110.raw Events Read: Tot. 699 | 1st 0000162012.0050741308 | Last 0000162012.0050744795 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162081_016.raw Events Read: Tot. 1087 | 1st 0000162081.0010068449 | Last 0000162081.0010075494 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162099_099.raw Events Read: Tot. 1497 | 1st 0000162099.0015919920 | Last 0000162099.0015927012 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162576_186.raw Events Read: Tot. 2315 | 1st 0000162576.0005880372 | Last 0000162576.0005891218 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162577_129.raw Events Read: Tot. 886 | 1st 0000162577.0007229404 | Last 0000162577.0007233177 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162592_027.raw Events Read: Tot. 877 | 1st 0000162592.0005374784 | Last 0000162592.0005379555 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162592_125.raw Events Read: Tot. 1786 | 1st 0000162592.0006880044 | Last 0000162592.0006888935 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162594_041.raw Events Read: Tot. 2099 | 1st 0000162594.0008241473 | Last 0000162594.0008252402 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162594_055.raw Events Read: Tot. 1626 | 1st 0000162594.0008395044 | Last 0000162594.0008403676 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162595_098.raw Events Read: Tot. 1894 | 1st 0000162595.0011050061 | Last 0000162595.0011059831 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162599_011.raw Events Read: Tot. 92 | 1st 0000162599.0011272313 | Last 0000162599.0011272809 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162599_160.raw Events Read: Tot. 750 | 1st 0000162599.0012996821 | Last 0000162599.0013001317 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162624_045.raw Events Read: Tot. 2034 | 1st 0000162624.0001451124 | Last 0000162624.0001459780 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000162626_045.raw Events Read: Tot. 212 | 1st 0000162626.0002783993 | Last 0000162626.0002784885 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163063_010.raw Events Read: Tot. 1541 | 1st 0000163063.0025276361 | Last 0000163063.0025285556 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163075_189.raw Events Read: Tot. 2747 | 1st 0000163075.0008379043 | Last 0000163075.0008400023 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163084_102.raw Events Read: Tot. 2305 | 1st 0000163084.0015640146 | Last 0000163084.0015653844 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163171_023.raw Events Read: Tot. 2878 | 1st 0000163171.0046849228 | Last 0000163171.0046867624 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163171_091.raw Events Read: Tot. 1874 | 1st 0000163171.0047970467 | Last 0000163171.0047980134 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163171_121.raw Events Read: Tot. 1071 | 1st 0000163171.0048406415 | Last 0000163171.0048412759 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163223_025.raw Events Read: Tot. 2652 | 1st 0000163223.0063310000 | Last 0000163223.0063325755 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163223_065.raw Events Read: Tot. 2618 | 1st 0000163223.0063895933 | Last 0000163223.0063908045 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163223_089.raw Events Read: Tot. 578 | 1st 0000163223.0064246182 | Last 0000163223.0064249445 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163223_117.raw Events Read: Tot. 2319 | 1st 0000163223.0064627744 | Last 0000163223.0064641481 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163228_052.raw Events Read: Tot. 2183 | 1st 0000163228.0067545499 | Last 0000163228.0067559466 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163228_065.raw Events Read: Tot. 2070 | 1st 0000163228.0067737823 | Last 0000163228.0067749619 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163304_004.raw Events Read: Tot. 462 | 1st 0000163304.0002475751 | Last 0000163304.0002479222 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163324_023.raw Events Read: Tot. 199 | 1st 0000163324.0000438792 | Last 0000163324.0000439911 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163385_028.raw Events Read: Tot. 1367 | 1st 0000163385.0012677540 | Last 0000163385.0012687407 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163387_019.raw Events Read: Tot. 2379 | 1st 0000163387.0014570806 | Last 0000163387.0014588456 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163387_094.raw Events Read: Tot. 87 | 1st 0000163387.0015527533 | Last 0000163387.0015528154 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163491_096.raw Events Read: Tot. 1648 | 1st 0000163491.0004114373 | Last 0000163491.0004124400 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163494_063.raw Events Read: Tot. 1062 | 1st 0000163494.0007579219 | Last 0000163494.0007585719 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163495_034.raw Events Read: Tot. 1393 | 1st 0000163495.0008359182 | Last 0000163495.0008367823 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163498_056.raw Events Read: Tot. 95 | 1st 0000163498.0009825036 | Last 0000163498.0009825629 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163526_070.raw Events Read: Tot. 1085 | 1st 0000163526.0011875108 | Last 0000163526.0011882000 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163529_003.raw Events Read: Tot. 458 | 1st 0000163529.0013586759 | Last 0000163529.0013589541 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000163530_068.raw Events Read: Tot. 54 | 1st 0000163530.0016181591 | Last 0000163530.0016181716 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163530_120.raw Events Read: Tot. 619 | 1st 0000163530.0016642635 | Last 0000163530.0016646595 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163641_097.raw Events Read: Tot. 2068 | 1st 0000163641.0001513447 | Last 0000163641.0001524312 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163641_143.raw Events Read: Tot. 1903 | 1st 0000163641.0002027378 | Last 0000163641.0002037655 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163641_157.raw Events Read: Tot. 356 | 1st 0000163641.0002184015 | Last 0000163641.0002186017 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163641_187.raw Events Read: Tot. 1193 | 1st 0000163641.0002496161 | Last 0000163641.0002502379 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163643_019.raw Events Read: Tot. 7 | 1st 0000163643.0002819884 | Last 0000163643.0002819771 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163938_030.raw Events Read: Tot. 609 | 1st 0000163938.0000409724 | Last 0000163938.0000413373 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163938_038.raw Events Read: Tot. 1636 | 1st 0000163938.0000532004 | Last 0000163938.0000542864 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163938_058.raw Events Read: Tot. 163 | 1st 0000163938.0000809057 | Last 0000163938.0000810261 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163943_092.raw Events Read: Tot. 887 | 1st 0000163943.0004568700 | Last 0000163943.0004573862 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163946_101.raw Events Read: Tot. 335 | 1st 0000163946.0006853699 | Last 0000163946.0006857757 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000163972_120.raw Events Read: Tot. 2131 | 1st 0000163972.0004792036 | Last 0000163972.0004805568 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164037_025.raw Events Read: Tot. 1555 | 1st 0000164037.0014085009 | Last 0000164037.0014094009 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164039_113.raw Events Read: Tot. 494 | 1st 0000164039.0015641608 | Last 0000164039.0015644509 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164041_103.raw Events Read: Tot. 1096 | 1st 0000164041.0020826688 | Last 0000164041.0020834431 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164041_163.raw Events Read: Tot. 1378 | 1st 0000164041.0021644835 | Last 0000164041.0021655053 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000164074_006.raw Events Read: Tot. 1436 | 1st 0000164074.0028959860 | Last 0000164074.0028967962 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164080_014.raw Events Read: Tot. 490 | 1st 0000164080.0029735567 | Last 0000164080.0029738409 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164080_017.raw Events Read: Tot. 2364 | 1st 0000164080.0029775573 | Last 0000164080.0029788722 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000164080_062.raw Events Read: Tot. 1094 | 1st 0000164080.0030353542 | Last 0000164080.0030359788 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164081_027.raw Events Read: Tot. 1824 | 1st 0000164081.0031296098 | Last 0000164081.0031306786 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164082_058.raw Events Read: Tot. 1113 | 1st 0000164082.0031948302 | Last 0000164082.0031954912 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164082_101.raw Events Read: Tot. 1531 | 1st 0000164082.0032413871 | Last 0000164082.0032422833 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164083_002.raw Events Read: Tot. 1148 | 1st 0000164083.0033698666 | Last 0000164083.0033731267 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164097_170.raw Events Read: Tot. 211 | 1st 0000164097.0049626836 | Last 0000164097.0049628416 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164098_087.raw Events Read: Tot. 660 | 1st 0000164098.0051376973 | Last 0000164098.0051381340 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164167_131.raw Events Read: Tot. 566 | 1st 0000164167.0060215692 | Last 0000164167.0060220073 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164170_117.raw Events Read: Tot. 1847 | 1st 0000164170.0064054246 | Last 0000164170.0064066528 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164171_040.raw Events Read: Tot. 1551 | 1st 0000164171.0065060844 | Last 0000164171.0065070748 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164210_073.raw Events Read: Tot. 790 | 1st 0000164210.0075696727 | Last 0000164210.0075701279 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164213_129.raw Events Read: Tot. 20 | 1st 0000164213.0079290763 | Last 0000164213.0079290981 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164387_061.raw Events Read: Tot. 1033 | 1st 0000164387.0006660867 | Last 0000164387.0006668780 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164387_065.raw Events Read: Tot. 356 | 1st 0000164387.0006727185 | Last 0000164387.0006729675 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164401_045.raw Events Read: Tot. 835 | 1st 0000164401.0014250532 | Last 0000164401.0014258020 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164407_051.raw Events Read: Tot. 44 | 1st 0000164407.0019982981 | Last 0000164407.0019983287 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164445_036.raw Events Read: Tot. 185 | 1st 0000164445.0001924000 | Last 0000164445.0001926021 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164445_042.raw Events Read: Tot. 1332 | 1st 0000164445.0002008241 | Last 0000164445.0002021591 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164446_018.raw Events Read: Tot. 2595 | 1st 0000164446.0002666024 | Last 0000164446.0002681688 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164446_041.raw Events Read: Tot. 254 | 1st 0000164446.0003163212 | Last 0000164446.0003165720 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164502_003.raw Events Read: Tot. 1578 | 1st 0000164502.0026153280 | Last 0000164502.0026166072 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164502_037.raw Events Read: Tot. 2563 | 1st 0000164502.0026857228 | Last 0000164502.0026878600 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164502_111.raw Events Read: Tot. 1263 | 1st 0000164502.0028354335 | Last 0000164502.0028364686 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164502_116.raw Events Read: Tot. 2361 | 1st 0000164502.0028423427 | Last 0000164502.0028442567 | Status open D0 executable exited with code 134 User executable exited with code 134 COMPLETE FROM FINISHED INPUTS p17repro_recoveryset_v2_014 ==================== 25 missing. all_0000168388_018.raw [On tape, not available] 24 failed twice: Finished staging input file all_0000164503_006.raw Events Read: Tot. 2063 | 1st 0000164503.0030291982 | Last 0000164503.0030308929 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164503_150.raw Events Read: Tot. 840 | 1st 0000164503.0032654714 | Last 0000164503.0032661199 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164537_012.raw Events Read: Tot. 2446 | 1st 0000164537.0042035907 | Last 0000164537.0042055124 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164537_025.raw Events Read: Tot. 599 | 1st 0000164537.0042313926 | Last 0000164537.0042318810 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164537_029.raw Events Read: Tot. 2429 | 1st 0000164537.0042392149 | Last 0000164537.0042411190 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164537_061.raw Events Read: Tot. 1672 | 1st 0000164537.0043060864 | Last 0000164537.0043075654 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164537_090.raw Events Read: Tot. 1704 | 1st 0000164537.0043621576 | Last 0000164537.0043635586 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164539_151.raw Events Read: Tot. 296 | 1st 0000164539.0047370575 | Last 0000164539.0047373229 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164605_086.raw Events Read: Tot. 2155 | 1st 0000164605.0008183510 | Last 0000164605.0008199318 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164605_101.raw Events Read: Tot. 2329 | 1st 0000164605.0008456859 | Last 0000164605.0008473228 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164605_179.raw Events Read: Tot. 655 | 1st 0000164605.0009700865 | Last 0000164605.0009705705 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164636_014.raw Events Read: Tot. 1324 | 1st 0000164636.0015180420 | Last 0000164636.0015195157 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000164636_065.raw Events Read: Tot. 1752 | 1st 0000164636.0016248878 | Last 0000164636.0016268042 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000165670_191.raw Events Read: Tot. 1355 | 1st 0000165670.0032275268 | Last 0000165670.0032287971 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000165684_005.raw Events Read: Tot. 1296 | 1st 0000165684.0037339626 | Last 0000165684.0037355314 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000165984_124.raw Events Read: Tot. 1280 | 1st 0000165984.0021765629 | Last 0000165984.0021777702 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000165985_211.raw Events Read: Tot. 833 | 1st 0000165985.0026302256 | Last 0000165985.0026308468 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000166339_100.raw Events Read: Tot. 31 | 1st 0000166339.0005507679 | Last 0000166339.0005507709 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000167013_091.raw Events Read: Tot. 148 | 1st 0000167013.0008232670 | Last 0000167013.0008234091 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000168022_123.raw Events Read: Tot. 962 | 1st 0000168022.0005474284 | Last 0000168022.0005485144 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000168133_013.raw Events Read: Tot. 2128 | 1st 0000168133.0017634109 | Last 0000168133.0017661417 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000168138_060.raw Events Read: Tot. 1035 | 1st 0000168138.0009473561 | Last 0000168138.0009484638 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000168516_159.raw Events Read: Tot. 145 | 1st 0000168516.0030016333 | Last 0000168516.0030018356 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000168524_007.raw Events Read: Tot. 1966 | 1st 0000168524.0008785650 | Last 0000168524.0008811867 | Status open No exit code available for d0 executable. User executable exited with code 1 p17repro_recoveryset_v2_015 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 6 missing. Failed twice with Finished staging input file all_0000168716_115.raw Events Read: Tot. 1555 | 1st 0000168716.0011394889 | Last 0000168716.0011413728 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000168716_148.raw Events Read: Tot. 1257 | 1st 0000168716.0012141069 | Last 0000168716.0012156428 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000168734_005.raw Events Read: Tot. 1996 | 1st 0000168734.0025677678 | Last 0000168734.0025699526 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000169521_002.raw Events Read: Tot. 1151 | 1st 0000169521.0000471911 | Last 0000169521.0000488779 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000169773_098.raw Events Read: Tot. 2337 | 1st 0000169773.0002577248 | Last 0000169773.0002599324 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000169778_151.raw Events Read: Tot. 1594 | 1st 0000169778.0030451179 | Last 0000169778.0030470177 | Status open No exit code available for d0 executable. User executable exited with code 1 FINISHED p17repro_recoveryset_v2_016 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 19 missing. all_0000170025_110.raw (Never processed. Likely corrupted) all_0000170034_022.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_027.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_033.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_038.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_049.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_054.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_060.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_065.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_071.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_082.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170034_093.raw (Processed p13, prm959 FIle lost in tape copy) all_0000170247_040.raw (Never processed. Likely corrupted) 6 fails twice with: Finished staging input file all_0000169930_041.raw Events Read: Tot. 899 | 1st 0000169930.0004869031 | Last 0000169930.0004881619 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000169990_028.raw Events Read: Tot. 1025 | 1st 0000169990.0014406645 | Last 0000169990.0014419163 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000170015_103.raw Events Read: Tot. 852 | 1st 0000170015.0010814312 | Last 0000170015.0010825886 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000172482_121.raw Events Read: Tot. 2082 | 1st 0000172482.0005477891 | Last 0000172482.0005512259 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000172565_095.raw Events Read: Tot. 1212 | 1st 0000172565.0005464006 | Last 0000172565.0005484019 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000172568_158.raw Events Read: Tot. 1134 | 1st 0000172568.0026686207 | Last 0000172568.0026702326 | Status open D0 executable exited with code 134 User executable exited with code 134 COMPLETE FROM FINISHED INPUTS ****above checked by mike******** p17repro_recoveryset_v2_017 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 127 missing (~7 jobs were runnig for ever!). 13 Files that failed twice in the same way: Finished staging input file all_0000174209_002.raw Events Read: Tot. 2215 | 1st 0000174209.0004777949 | Last 0000174209.0004815415 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174264_083.raw Events Read: Tot. 3299 | 1st 0000174264.0004800794 | Last 0000174264.0004805989 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000174265_001.raw Events Read: Tot. 1988 | 1st 0000174265.0008572458 | Last 0000174265.0008608093 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000174305_042.raw Events Read: Tot. 191 | 1st 0000174305.0002217957 | Last 0000174305.0002220881 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174480_037.raw Events Read: Tot. 1562 | 1st 0000174480.0012536327 | Last 0000174480.0012560813 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000174495_060.raw Events Read: Tot. 425 | 1st 0000174495.0014183510 | Last 0000174495.0014189815 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174496_178.raw Events Read: Tot. 912 | 1st 0000174496.0029246057 | Last 0000174496.0029265329 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000174501_015.raw Events Read: Tot. 752 | 1st 0000174501.0045671800 | Last 0000174501.0045686481 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174501_050.raw Events Read: Tot. 1474 | 1st 0000174501.0046906242 | Last 0000174501.0046939934 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174997_018.raw Events Read: Tot. 1348 | 1st 0000174997.0012457399 | Last 0000174997.0012479421 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000174999_092.raw Events Read: Tot. 651 | 1st 0000174999.0042291269 | Last 0000174999.0042292847 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000175322_122.raw Events Read: Tot. 2476 | 1st 0000175322.0008249475 | Last 0000175322.0008288383 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000175343_187.raw Events Read: Tot. 2556 | 1st 0000175343.0040178651 | Last 0000175343.0040225373 | Status openNo exit code available for d0 executable. User executable exited with code 1 114 files to be investigated: p17repro_recoveryset_v2_018 18-Dec-2005 06:00:00 (UTC) wicke d0production ===================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_019 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 24 missing. ./investigate_production.sh p17repro_recoveryset_v2_019 p17.05.01 15 Files that failed twice in the same way: Finished staging input file all_0000176309_043.raw Events Read: Tot. 958 | 1st 0000176309.0042939431 | Last 0000176309.0042953635 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000176364_038.raw Events Read: Tot. 1688 | 1st 0000176364.0012255341 | Last 0000176364.0012295254 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000176474_158.raw Events Read: Tot. 255 | 1st 0000176474.0008257510 | Last 0000176474.0008262394 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000176566_220.raw Events Read: Tot. 1576 | 1st 0000176566.0013923619 | Last 0000176566.0013935127 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000176723_135.raw Events Read: Tot. 1096 | 1st 0000176723.0005711646 | Last 0000176723.0005712228 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000177008_003.raw Events Read: Tot. 2596 | 1st 0000177008.0007110947 | Last 0000177008.0007149751 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000177044_143.raw Events Read: Tot. 2312 | 1st 0000177044.0040633508 | Last 0000177044.0040658743 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000177275_161.raw Events Read: Tot. 898 | 1st 0000177275.0005893728 | Last 0000177275.0005896045 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000177311_172.raw Events Read: Tot. 1114 | 1st 0000177311.0005914059 | Last 0000177311.0005931863 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000177315_143.raw Events Read: Tot. 2130 | 1st 0000177315.0029307451 | Last 0000177315.0029339155 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000185464_001.raw Events Read: Tot. 42 | 1st 0000185464.0000010288 | Last 0000185464.0000010329 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185466_001.raw Events Read: Tot. 2 | 1st 0000185466.0000005498 | Last 0000185466.0000009179 | Status open D0executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185467_001.raw Events Read: Tot. 2 | 1st 0000185467.0000097289 | Last 0000185467.0000097312 | Status open D0executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185469_001.raw Events Read: Tot. 3 | 1st 0000185469.0000275543 | Last 0000185469.0000275570 | Status open D0executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000185469_006.raw Events Read: Tot. 2 | 1st 0000185469.0000415254 | Last 0000185469.0000415270 | Status open D0executable exited with code 134 User executable exited with code 134 9 files to be investigated. p17repro_recoveryset_v2_020 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_021 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 135 missing. p17repro_recoveryset_v2_022 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 0 files are processed, 107 missing. Files: all_0000188470_003.raw all_0000188470_001.raw all_0000188470_002.raw all_0000188471_001.raw all_0000188471_002.raw all_0000188471_003.raw all_0000188471_004.raw all_0000188471_005.raw all_0000188471_006.raw all_0000188471_007.raw all_0000188471_008.raw all_0000188471_009.raw all_0000188471_010.raw all_0000188471_011.raw all_0000188471_012.raw all_0000188471_013.raw all_0000188471_014.raw all_0000188471_015.raw all_0000188471_016.raw all_0000188471_018.raw all_0000188471_020.raw all_0000188471_017.raw all_0000188471_021.raw all_0000188471_022.raw all_0000188471_019.raw all_0000188471_023.raw all_0000188471_024.raw all_0000188471_025.raw all_0000188471_026.raw all_0000188471_027.raw all_0000188471_028.raw all_0000188471_029.raw all_0000188471_030.raw all_0000188471_031.raw all_0000188471_032.raw all_0000188471_033.raw all_0000188471_034.raw all_0000188471_035.raw all_0000188471_036.raw all_0000188471_037.raw all_0000188471_038.raw all_0000188471_039.raw all_0000188471_040.raw all_0000188471_041.raw all_0000188471_042.raw all_0000188471_043.raw all_0000188471_044.raw all_0000188471_045.raw all_0000188471_046.raw all_0000188471_047.raw all_0000188471_048.raw all_0000188472_001.raw all_0000188472_002.raw all_0000188472_003.raw all_0000188472_004.raw all_0000188472_005.raw all_0000188472_006.raw all_0000188472_007.raw all_0000188472_008.raw all_0000188472_009.raw all_0000188472_010.raw all_0000188472_011.raw all_0000188472_012.raw all_0000188472_013.raw all_0000188472_014.raw all_0000188472_015.raw all_0000188472_016.raw all_0000188472_017.raw all_0000188472_018.raw all_0000188472_019.raw all_0000188472_020.raw all_0000188472_021.raw all_0000188472_022.raw all_0000188472_023.raw all_0000188472_024.raw all_0000188472_025.raw all_0000188472_027.raw all_0000188472_028.raw all_0000188472_026.raw all_0000188473_001.raw all_0000188473_002.raw all_0000188473_003.raw all_0000188473_004.raw all_0000188473_005.raw all_0000188473_006.raw all_0000188473_007.raw all_0000188473_008.raw all_0000188473_009.raw all_0000188473_010.raw all_0000188473_011.raw all_0000188473_012.raw all_0000188473_013.raw all_0000188473_014.raw all_0000188473_015.raw all_0000188473_016.raw all_0000188473_017.raw all_0000188473_018.raw all_0000188473_019.raw all_0000188473_020.raw all_0000188473_021.raw all_0000188473_022.raw all_0000188473_023.raw all_0000188473_024.raw all_0000188473_025.raw all_0000188473_026.raw all_0000188473_027.raw all_0000188473_028.raw p17repro_recoveryset_v2_023 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 8 missing. RUNNING p17repro_recoveryset_v2_024 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 144 missing. WARNING: Skipping recoT_all_0000189580_030.raw_p17.05.01_d0farm_fnd0101.fnal.gov_062813_30348_FNAL Event count is off by 1126 WARNING: Skipping recoT_all_0000189615_224.raw_p17.05.01_d0farm_fnd0101.fnal.gov_062813_30348_FNAL Event count is off by 1142 WARNING: Skipping recoT_all_0000189666_130.raw_p17.05.01_d0farm_fnd0101.fnal.gov_062813_30348_FNAL Event count is off by 2402 WARNING: Skipping recoT_all_0000189772_061.raw_p17.05.01_d0farm_fnd0101.fnal.gov_062813_30348_FNAL Event count is off by 363 WARNING: Skipping recoT_all_0000189772_091.raw_p17.05.01_d0farm_fnd0101.fnal.gov_062813_30348_FNAL Event count is off by 1489 Reinvestigate p17repro_recoveryset_v2_025 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 20 missing. Files that failed twice in the same way: Finished staging input file all_0000189916_099.raw Events Read: Tot. 829 | 1st 0000189916.0020488336 | Last 0000189916.0020503130 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000190057_052.raw Events Read: Tot. 1323 | 1st 0000190057.0011111896 | Last 0000190057.0011129236 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000190084_006.raw Events Read: Tot. 533 | 1st 0000190084.0183992086 | Last 0000190084.0184000509 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000190186_064.raw Events Read: Tot. 2483 | 1st 0000190186.0005136843 | Last 0000190186.0005198929 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000191358_014.raw Events Read: Tot. 1661 | 1st 0000191358.0010226447 | Last 0000191358.0010257871 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000191359_039.raw Events Read: Tot. 1271 | 1st 0000191359.0022959292 | Last 0000191359.0022983862 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000191496_129.raw Events Read: Tot. 655 | 1st 0000191496.0009453892 | Last 0000191496.0009464625 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000191500_291.raw Events Read: Tot. 313 | 1st 0000191500.0050534251 | Last 0000191500.0050540655 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000191594_023.raw Events Read: Tot. 481 | 1st 0000191594.0037901262 | Last 0000191594.0037902086 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000191616_168.raw Events Read: Tot. 2062 | 1st 0000191616.0019158552 | Last 0000191616.0019203769 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000191708_055.raw Events Read: Tot. 1463 | 1st 0000191708.0003888628 | Last 0000191708.0003913414 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000191891_040.raw Events Read: Tot. 1513 | 1st 0000191891.0077114062 | Last 0000191891.0077146190 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192080_076.raw Events Read: Tot. 2172 | 1st 0000192080.0065431725 | Last 0000192080.0065483358 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192153_135.raw Events Read: Tot. 1178 | 1st 0000192153.0052487719 | Last 0000192153.0052513029 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192159_138.raw Events Read: Tot. 894 | 1st 0000192159.0071755597 | Last 0000192159.0071777808 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192287_015.raw Events Read: Tot. 2102 | 1st 0000192287.0001074302 | Last 0000192287.0001099396 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192291_180.raw Events Read: Tot. 1228 | 1st 0000192291.0048160896 | Last 0000192291.0048191970 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192291_212.raw Events Read: Tot. 2082 | 1st 0000192291.0050019433 | Last 0000192291.0050071589 | Status openD0 executable exited with code 134 User executable exited with code 134 Number of files that failed twice in the same way: 18 Unique failures and Grid IDs: Finished staging input file all_0000191727_095.raw Events Read: Tot. 527 | 1st 0000191727.0006253168 | Last 0000191727.0006263204 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000191727_095.raw Events Read: Tot. 527 | 1st 0000191727.0006253168 | Last 0000191727.0006263204 | Status open No exit code available for d0 executable. User executable exited with code 1 1 file not listed. p17repro_recoveryset_v2_026 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_027 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_028 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_029 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 13 files missing. All failed threetimes in the same event (two with varying exit codes): ( ./get_event.sh -id d0farm_fnd0101.fnal.gov_020417_24621 ; ./get_event.sh -id d0farm_fnd0101.fnal.gov_033110_2620 ; ./get_event.sh -id d0farm_fnd0101.fnal.gov_093216_17151 ) | sort | uniq -d Finished staging input file all_0000192537_011.raw Events Read: Tot. 2611 | 1st 0000192537.0009832675 | Last 0000192537.0009883758 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192537_129.raw Events Read: Tot. 2392 | 1st 0000192537.0018269589 | Last 0000192537.0018328205 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192540_052.raw Events Read: Tot. 1899 | 1st 0000192540.0060589163 | Last 0000192540.0060622455 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192560_069.raw Events Read: Tot. 1671 | 1st 0000192560.0005166673 | Last 0000192560.0005203788 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192577_081.raw Events Read: Tot. 1111 | 1st 0000192577.0028746084 | Last 0000192577.0028768204 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192578_045.raw Events Read: Tot. 834 | 1st 0000192578.0040060309 | Last 0000192578.0040072858 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192581_238.raw Events Read: Tot. 59 | 1st 0000192581.0091234780 | Last 0000192581.0091236601 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192667_029.raw Events Read: Tot. 846 | 1st 0000192667.0050944518 | Last 0000192667.0050953913 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192672_138.raw Events Read: Tot. 2006 | 1st 0000192672.0117701329 | Last 0000192672.0117738601 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000192808_104.raw Events Read: Tot. 313 | 1st 0000192808.0047546282 | Last 0000192808.0047554809 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192808_205.raw Events Read: Tot. 2003 | 1st 0000192808.0053797191 | Last 0000192808.0053848640 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192824_176.raw Events Read: Tot. 1866 | 1st 0000192824.0020947647 | Last 0000192824.0020976385 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000192916_008.raw Events Read: Tot. 2060 | 1st 0000192916.0008448388 | Last 0000192916.0008497252 | Status openD0 executable exited with code 134 User executable exited with code 134 p17repro_recoveryset_v2_030 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_031 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_032 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_033 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_034 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_035 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_036 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_037 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_038 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_039 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_040 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_041 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_042 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_043 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_044 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_045 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 26 files missing: All failed twice in the same event: ( ./get_event.sh -id d0farm_fnd0101.fnal.gov_051612_23915 ; ./get_event.sh -id d0farm_fnd0101.fnal.gov_134230_14456 ) | sort | uniq -d Finished staging input file all_0000193796_011.raw Events Read: Tot. 3547 | 1st 0000193796.0000773954 | Last 0000193796.0000861650 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193799_125.raw Events Read: Tot. 578 | 1st 0000193799.0027963075 | Last 0000193799.0027978678 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193799_129.raw Events Read: Tot. 1175 | 1st 0000193799.0028212581 | Last 0000193799.0028243322 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193802_004.raw Events Read: Tot. 551 | 1st 0000193802.0062462724 | Last 0000193802.0062475941 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193807_143.raw Events Read: Tot. 329 | 1st 0000193807.0116755267 | Last 0000193807.0116757938 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193834_011.raw Events Read: Tot. 3013 | 1st 0000193834.0000950558 | Last 0000193834.0001019578 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193834_016.raw Events Read: Tot. 110 | 1st 0000193834.0001414755 | Last 0000193834.0001419789 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193834_040.raw Events Read: Tot. 820 | 1st 0000193834.0003536819 | Last 0000193834.0003555083 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000193836_011.raw Events Read: Tot. 22 | 1st 0000193836.0018940433 | Last 0000193836.0018940404 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193840_053.raw Events Read: Tot. 1085 | 1st 0000193840.0029712912 | Last 0000193840.0029739658 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000193840_192.raw Events Read: Tot. 2113 | 1st 0000193840.0037869069 | Last 0000193840.0037918463 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000193841_206.raw Events Read: Tot. 1306 | 1st 0000193841.0055416187 | Last 0000193841.0055449624 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193844_014.raw Events Read: Tot. 1348 | 1st 0000193844.0057691485 | Last 0000193844.0057728027 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193864_035.raw Events Read: Tot. 2299 | 1st 0000193864.0018660867 | Last 0000193864.0018720939 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193867_006.raw Events Read: Tot. 2483 | 1st 0000193867.0045574422 | Last 0000193867.0045637702 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193990_012.raw Events Read: Tot. 610 | 1st 0000193990.0016862512 | Last 0000193990.0016881348 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193991_030.raw Events Read: Tot. 1687 | 1st 0000193991.0032012384 | Last 0000193991.0032045724 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193991_031.raw Events Read: Tot. 1061 | 1st 0000193991.0032097930 | Last 0000193991.0032124947 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193991_041.raw Events Read: Tot. 1106 | 1st 0000193991.0032922229 | Last 0000193991.0032947543 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000193991_044.raw Events Read: Tot. 3816 | 1st 0000193991.0033167158 | Last 0000193991.0033215832 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193991_065.raw Events Read: Tot. 1981 | 1st 0000193991.0034806949 | Last 0000193991.0034857788 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193992_097.raw Events Read: Tot. 1058 | 1st 0000193992.0042236085 | Last 0000193992.0042244955 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193993_133.raw Events Read: Tot. 843 | 1st 0000193993.0060139690 | Last 0000193993.0060149840 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000193994_019.raw Events Read: Tot. 3818 | 1st 0000193994.0068247594 | Last 0000193994.0068299587 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000194023_063.raw Events Read: Tot. 1641 | 1st 0000194023.0020315590 | Last 0000194023.0020345527 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000194027_195.raw Events Read: Tot. 2629 | 1st 0000194027.0074879905 | Last 0000194027.0074935657 | Status openNo exit code available for d0 executable. User executable exited with code 1 COMPLETE FROM FINISHED INPUTS p17repro_recoveryset_v2_046 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_047 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_048 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_049 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_050 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_051 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 91 file missing: 2 files all_0000195074_201.raw Event count is off by 1741 (twice) all_0000195260_020.raw Event count is off by 1497 (twice) 21 files failed twice in the same event: Finished staging input file all_0000194800_067.raw Events Read: Tot. 2065 | 1st 0000194800.0036223359| Last 0000194800.0036273020 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000194865_020.raw Events Read: Tot. 2001 | 1st 0000194865.0009483049 | Last 0000194865.0009534375 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000194865_077.raw Events Read: Tot. 231 | 1st 0000194865.0014351329 | Last 0000194865.0014355677 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000194865_092.raw Events Read: Tot. 1836 | 1st 0000194865.0015543558 | Last 0000194865.0015596417 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195024_097.raw Events Read: Tot. 1354 | 1st 0000195024.0048863490 | Last 0000195024.0048897900 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195051_032.raw Events Read: Tot. 1808 | 1st 0000195051.0002601406 | Last 0000195051.0002650257 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000195051_043.raw Events Read: Tot. 2125 | 1st 0000195051.0003436777 | Last 0000195051.0003496875 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195073_236.raw Events Read: Tot. 2118 | 1st 0000195073.0028119346 | Last 0000195073.0028183151 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195074_116.raw Events Read: Tot. 960 | 1st 0000195074.0035590068 | Last 0000195074.0035612547 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195134_005.raw Events Read: Tot. 1167 | 1st 0000195134.0000449300 | Last 0000195134.0000488005 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195136_024.raw Events Read: Tot. 1161 | 1st 0000195136.0026071883 | Last 0000195136.0026109312 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195136_056.raw Events Read: Tot. 874 | 1st 0000195136.0028775000 | Last 0000195136.0028795156 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195165_040.raw Events Read: Tot. 964 | 1st 0000195165.0003484681 | Last 0000195165.0003514689 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195167_004.raw Events Read: Tot. 959 | 1st 0000195167.0016294817 | Last 0000195167.0016318499 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195238_192.raw Events Read: Tot. 2328 | 1st 0000195238.0010411512 | Last 0000195238.0010452333 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000195258_054.raw Events Read: Tot. 2064 | 1st 0000195258.0004030959 | Last 0000195258.0004083087 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000195260_006.raw Events Read: Tot. 2123 | 1st 0000195260.0017082935 | Last 0000195260.0017141010 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195260_012.raw Events Read: Tot. 1130 | 1st 0000195260.0017590729 | Last 0000195260.0017626353 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195260_016.raw Events Read: Tot. 1661 | 1st 0000195260.0017929429 | Last 0000195260.0017978009 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195275_181.raw Events Read: Tot. 996 | 1st 0000195275.0016347820 | Last 0000195275.0016347890 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195325_006.raw Events Read: Tot. 2 | 1st 0000195325.0014781556 | Last 0000195325.0014781624 | Status open D0executable exited with code 134 User executable exited with code 134 68 files not understood: p17repro_recoveryset_v2_052 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_053 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_054 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 52 file missing: WARNING: Skipping recoT_all_0000195520_081.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 2164 WARNING: Skipping recoT_all_0000195520_101.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 1662 WARNING: Skipping recoT_all_0000195520_105.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 265 WARNING: Skipping recoT_all_0000195838_028.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 2764 WARNING: Skipping recoT_all_0000195838_072.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 697 WARNING: Skipping recoT_all_0000195838_106.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 2919 WARNING: Skipping recoT_all_0000195838_113.raw_p17.05.01_d0farm_fnd0101.fnal.gov_153522_3968_FNAL Event count is off by 1620 ** rerunning p17repro_recoveryset_v2_055 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_056 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_057 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_058 18-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_059 27-Dec-2005 06:00:00 (UTC) wicke d0production ====================================================================== 17 files missing: all_0000196422_061.raw failed twice with Event count is off by 1558 16 files failed twice in the same event: (./get_event.sh -id d0farm_fnd0101.fnal.gov_191356_31957; ./get_event.sh -id d0farm_fnd0101.fnal.gov_145312_25065) | sort | uniq -d Finished staging input file all_0000196047_075.raw Events Read: Tot. 2208 | 1st 0000196047.0020106976 | Last 0000196047.0020138951 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000196234_004.raw Events Read: Tot. 733 | 1st 0000196234.0001441254 | Last 0000196234.0001459274 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196235_031.raw Events Read: Tot. 419 | 1st 0000196235.0009984612 | Last 0000196235.0009996167 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000196242_090.raw Events Read: Tot. 2371 | 1st 0000196242.0010654796 | Last 0000196242.0010713281 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000196420_007.raw Events Read: Tot. 2468 | 1st 0000196420.0000603854 | Last 0000196420.0000661405 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196420_020.raw Events Read: Tot. 916 | 1st 0000196420.0001665500 | Last 0000196420.0001690065 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_036.raw Events Read: Tot. 2522 | 1st 0000196424.0028474508 | Last 0000196424.0028539173 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_056.raw Events Read: Tot. 1368 | 1st 0000196424.0029801711 | Last 0000196424.0029837261 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_060.raw Events Read: Tot. 516 | 1st 0000196424.0030063875 | Last 0000196424.0030077449 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_073.raw Events Read: Tot. 1299 | 1st 0000196424.0030904562 | Last 0000196424.0030938165 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_075.raw Events Read: Tot. 715 | 1st 0000196424.0031032115 | Last 0000196424.0031051097 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_076.raw Events Read: Tot. 2326 | 1st 0000196424.0031095982 | Last 0000196424.0031155788 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_078.raw Events Read: Tot. 2249 | 1st 0000196424.0031223331 | Last 0000196424.0031283232 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196424_189.raw Events Read: Tot. 1851 | 1st 0000196424.0037811986 | Last 0000196424.0037859339 | Status openNo exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000196428_003.raw Events Read: Tot. 1997 | 1st 0000196428.0000102417 | Last 0000196428.0000139230 | Status openD0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000196572_167.raw Events Read: Tot. 1157 | 1st 0000196572.0016932217 | Last 0000196572.0016965067 | Status openNo exit code available for d0 executable. User executable exited with code 1 COMPLETE FROM FINISHED INPUTS p17repro_recoveryset_v2_060 27-Jan-2006 06:00:00 (UTC) wicke d0production ================================================================== 21 file missing: RawFile 1st failure 2nd failure all_0000195026_103.raw Event count is off by 946 (confirmed with dsdump(Mike); removed all disk location) Event count is off by 946 all_0000195026_146.raw Event count is off by 2148 (confirmed with dsdump(Mike); removed all disk location) Event count is off by 2148 all_0000195026_183.raw Event count is off by 2246 (confirmed with dsdump(Mike); removed all disk location) Event count is off by 2246 all_0000195026_238.raw Event count is off by 52 (confirmed with dsdump(Mike); removed all disk location) Event count is off by 52 all_0000195026_241.raw Event count is off by 426 (confirmed with dsdump(Mike); removed all disk location) Event count is off by 426 Following failures occured twice: Finished staging input file all_0000194484_026.raw Events Read: Tot. 1159 | 1st 0000194484.0026197171 | Last 0000194484.0026273823 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000194484_033.raw Events Read: Tot. 1656 | 1st 0000194484.0027169083 | Last 0000194484.0027281883 | Status open No exit code available for d0 executable. User executable exited with code 1 Finished staging input file all_0000195026_081.raw Events Read: Tot. 2250 | 1st 0000195026.0070680291 | Last 0000195026.0070717861 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195026_100.raw Events Read: Tot. 86 | 1st 0000195026.0071460503 | Last 0000195026.0071461758 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_101.raw Events Read: Tot. 131 | 1st 0000195026.0071501231 | Last 0000195026.0071503026 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_102.raw Events Read: Tot. 1030 | 1st 0000195026.0071541803 | Last 0000195026.0071559610 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195026_111.raw Events Read: Tot. 1424 | 1st 0000195026.0071907286 | Last 0000195026.0071931352 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195026_115.raw Events Read: Tot. 20 | 1st 0000195026.0072068518 | Last 0000195026.0072068747 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_121.raw Events Read: Tot. 740 | 1st 0000195026.0072309291 | Last 0000195026.0072322848 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_135.raw Events Read: Tot. 1584 | 1st 0000195026.0072865669 | Last 0000195026.0072892505 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195026_144.raw Events Read: Tot. 2173 | 1st 0000195026.0073219610 | Last 0000195026.0073255572 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195026_173.raw Events Read: Tot. 222 | 1st 0000195026.0074344711 | Last 0000195026.0074348767 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_221.raw Events Read: Tot. 173 | 1st 0000195026.0076152269 | Last 0000195026.0076155205 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_226.raw Events Read: Tot. 711 | 1st 0000195026.0076336321 | Last 0000195026.0076348030 | Status open D0 executable exited with code 134 User executable exited with code 134 Finished staging input file all_0000195026_234.raw Events Read: Tot. 1177 | 1st 0000195026.0076629703 | Last 0000195026.0076649077 | Status open D0 executable exited withcode 134 User executable exited with code 134 Finished staging input file all_0000195027_021.raw Events Read: Tot. 993 | 1st 0000195027.0078046138 | Last 0000195027.0078060269 | Status open D0 executable exited with code 134 User executable exited with code 134 COMPLETE FROM FINISHED INPUTS p17repro_recoveryset_v2_061 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_062 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_063 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_064 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_065 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_066 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_067 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_068 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_069 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_070 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_071 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_072 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== p17repro_recoveryset_v2_073 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS p17repro_recoveryset_v2_074 27-Jan-2006 06:00:00 (UTC) wicke d0production ====================================================================== COMPLETE FROM COMPLETE INPUTS