How files are saved on the farms   12-12-01
 

Reco files

    reco files are written from the workers to directories /d0/stripe*/samtest/<jobno>

    they are stored by the startProject section of the batch job as the job runs.

    the script used is

    storerecofiles.py $PWD $D0FARM_DIR

    If you type listfast it will tell you how stores are doing for running jobs
 
    If the station is restarted, files may get stuck either in /d0/stripe*/samtest/<jobno>
    or the subdirectory store_in_progress

    You need to copy all the reco files and their meta.py files back into the  /d0/stripe*/samtest/<jobno>
    and rerun the script.

Root files
 
    Root files are written to directory /d0/stripe10/root/<farm project name with time stamp stripped>
    They wait until all resubmissions are done and are then merged.
 
    They will just sit there until either

     1) the request completes (or has 5 or less missing files)

     2) you go to the /d0/stripe10/root directory and type

    merge.csh $PWD/<farm project name with time stamp stripped>

Never do both at once!

RecoS files

    Are written to /d0/stripe10/special/<farm project name with time stamp stripped>

    right now i have to merge these by hand on d0mino as I have to use copyd0om and don't have
    a version which runs on the farms.