Dzero data preservation

Contact Pengfei Ding if you need help with accessing preserved files listed on this page.

Preserved files

d0srv302.fnal.gov 30T
30T     /projects/201801/D0_physics/MUinclusive_skim

d0srv246.fnal.gov 28T
515G    /projects/201802/D0_physics/DIEM_skim
364G    /projects/201802/D0_physics/DIMU_skim
26T     /projects/201802/D0_physics/EMinclusive_skim
476G    /projects/201802/D0_physics/EMMU_skim

d0srv245.fnal.gov 28T
5.4T    /projects/201803/D0_physics/wjets/CSG_alpgenpythia_w_lnu_p211100_v13
22T     /projects/201803/D0_physics/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5

d0srv244.fnal.gov 26T
7.6T    /projects/201804/D0_physics/wjets/CSG_alpgenpythia_w_lnu_p211100_v13
18T     /projects/201804/D0_physics/wjets/CSG_alpgenpythia_w_lnu_p211800_Run2b2_v6

d0srv237.fnal.gov 752G + 5.8T
222G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p211100_v13
202G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p211800_Run2b2_v6
522G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_mumu+2b_75_130_p212100_Run2b3_v5
474G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p211100_v13
211G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p211800_Run2b2_v6
458G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_mumu+2c_75_130_p212100_Run2b3_v5
1.7T    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_15_75_p212100_Run2b3_v5
242G    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz_mumu_130_250_p212100_Run2b3_v5
1.7T    /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz_mumu_15_75_p212100_Run2b3_v5
77G     /projects/201806/D0_physics/gamz/CSG_alpgenpythia_gamz_mumu_250_1960_p212100_Run2b3_v5
179G    /projects/201806/D0_physics/ttbar/CSG_alpgenpythia_t+t_2b+4lpc_m175_p212100_Run2b3_v5
135G    /projects/201806/D0_physics/ttbar/CSG_alpgenpythia_t+t_2l+2nu+2b_m175_p212100_Run2b3_v5
113G    /projects/201806/D0_physics/ttbar/CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p211100_v13
172G    /projects/201806/D0_physics/ttbar/CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p211800_Run2b2_v6
155G    /projects/201806/D0_physics/ttbar/CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p212100_Run2b3_v5

d0srv236.fnal.gov 8.4T
468G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p212100_Run2b3_v5
495G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p212100_Run2b3_v5
90G     /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_130_250_p211100_v13
170G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_130_250_p211800_Run2b2_v6
252G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_130_250_p212100_Run2b3_v5
951G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_15_75_p211100_v13
1.1T    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_15_75_p211800_Run2b2_v6
148G    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_250_1960_p211100_v13
95G     /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_250_1960_p211800_Run2b2_v6
81G     /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_250_1960_p212100_Run2b3_v5
1.7T    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_75_130_p211100_v13
1.2T    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_75_130_p211800_Run2b2_v6
1.9T    /projects/201807/D0_physics/gamz/CSG_alpgenpythia_gamz_ee_75_130_p212100_Run2b3_v5

d0srv205.fnal.gov 7.5T
522G    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_mumu+2b_75_130_p212100_Run2b3_v5
523G    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz+2b_tautau+2b_75_130_p212100_Run2b3_v5
458G    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_mumu+2c_75_130_p212100_Run2b3_v5
493G    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz+2c_tautau+2c_75_130_p212100_Run2b3_v5
1.7T    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz_mumu_75_130_p212100_Run2b3_v5
247G    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz_tautau_130_250_p212100_Run2b3_v5
1.8T    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz_tautau_15_75_p212100_Run2b3_v5
80G     /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz_tautau_250_1960_p212100_Run2b3_v5
1.8T    /projects/201808/D0_physics/gamz/CSG_alpgenpythia_gamz_tautau_75_130_p212100_Run2b3_v5

Copies in dCache

<d0srv245.fnal.gov> tree -d /pnfs/d0/
/pnfs/d0/
├── DIEM_skim
│   ├── VJets_2EM_RunIIa_v3
│   ├── VJets_2EM_RunIIb1_v2
│   ├── VJets_2EM_RunIIb2_v2
│   ├── VJets_2EM_RunIIb3_v2
│   └── VJets_2EM_RunIIb4
├── DIMU_skim
│   ├── VJets_2MU_RunIIa_v2
│   ├── VJets_2MU_RunIIb1_v2
│   ├── VJets_2MU_RunIIb2_v2
│   ├── VJets_2MU_RunIIb3_v2
│   └── VJets_2MU_RunIIb4
├── EMinclusive_skim
│   ├── VJets_EMinclusive_RunIIa_v1
│   ├── VJets_EMinclusive_RunIIb1_v1
│   ├── VJets_EMinclusive_RunIIb2_v1
│   ├── VJets_EMinclusive_RunIIb3_v1
│   └── VJets_EMinclusive_RunIIb4
├── EMMU_skim
│   ├── VJets_EMMU_RunIIa_v3
│   ├── VJets_EMMU_RunIIb1_v2
│   ├── VJets_EMMU_RunIIb2_v2
│   ├── VJets_EMMU_RunIIb3_v2
│   └── VJets_EMMU_RunIIb4
├── gamz
│   ├── CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p211100_v13
│   ├── CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz+2b_ee+2b_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz+2b_mumu+2b_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz+2b_tautau+2b_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p211100_v13
│   ├── CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz+2c_ee+2c_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz+2c_mumu+2c_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz+2c_tautau+2c_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_ee_130_250_p211100_v13
│   ├── CSG_alpgenpythia_gamz_ee_130_250_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz_ee_130_250_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_ee_15_75_p211100_v13
│   ├── CSG_alpgenpythia_gamz_ee_15_75_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz_ee_15_75_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_ee_250_1960_p211100_v13
│   ├── CSG_alpgenpythia_gamz_ee_250_1960_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz_ee_250_1960_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_ee_75_130_p211100_v13
│   ├── CSG_alpgenpythia_gamz_ee_75_130_p211800_Run2b2_v6
│   ├── CSG_alpgenpythia_gamz_ee_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_mumu_130_250_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_mumu_15_75_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_mumu_250_1960_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_mumu_75_130_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_tautau_130_250_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_tautau_15_75_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_gamz_tautau_250_1960_p212100_Run2b3_v5
│   └── CSG_alpgenpythia_gamz_tautau_75_130_p212100_Run2b3_v5
├── MUinclusive_skim
│   ├── VJets_MUinclusive_Moriond09_RunIIa_v1
│   ├── VJets_MUinclusive_RunIIb1and2
│   ├── VJets_MUinclusive_RunIIb3_v1
│   └── VJets_MUinclusive_RunIIb4
├── ttbar
│   ├── CSG_alpgenpythia_t+t_2b+4lpc_m175_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_t+t_2l+2nu+2b_m175_p212100_Run2b3_v5
│   ├── CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p211100_v13
│   ├── CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p211800_Run2b2_v6
│   └── CSG_alpgenpythia_t+t_lnu+2b+2lpc_m175_p212100_Run2b3_v5
└── wjets
    ├── CSG_alpgenpythia_w_lnu_p211100_v13
    ├── CSG_alpgenpythia_w_lnu_p211800_Run2b2_v6
    └── CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5

Accessing preserved files

How to access these files:

  1. NFSv4 disk mounts from d0mino0[4,5,6].fnal.gov, similar to access files on local disks – this method is recommended for listing directories only, use other methods below for copying files out from tape;
  2. Using dcap tools dccp -a $FILE_URL from a d0mino server;
  3. Using xrootd with xrootd URL, xrdcp $FILE_URL <Destination Path>;
  4. Using gfal-copy with either xrootd URL or davs URL, gfal-copy $FILE_URL <Destination Path>.

Please refer to the following for examples of dcap, xrootd, and davs URL.

# For the following file in the project disk
# (scroll right to see the full line)
/prj_root/201803/D0_physics/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5/CAF-MCv1-137006-tmb_p20.17.02_NumEv-10000_w+1lp-lnu+1lp_n.unw_dzero_mcp20_FZU-GRID_137006-129902941713880_p21.21.00_dq_dq.root 

# It will be moved to the following path (NFSv4 mounts)
/pnfs/d0/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5/CAF-MCv1-137006-tmb_p20.17.02_NumEv-10000_w+1lp-lnu+1lp_n.unw_dzero_mcp20_FZU-GRID_137006-129902941713880_p21.21.00_dq_dq.root 

# The corresponding dcap URL for use with dccp is:
dcap://fndca4a.fnal.gov:24138///pnfs/fnal.gov/usr/d0/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5/CAF-MCv1-137006-tmb_p20.17.02_NumEv-10000_w+1lp-lnu+1lp_n.unw_dzero_mcp20_FZU-GRID_137006-129902941713880_p21.21.00_dq_dq.root

# The xrootd URL is:
root://fndca1.fnal.gov/pnfs/fnal.gov/usr/d0/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5/CAF-MCv1-137006-tmb_p20.17.02_NumEv-10000_w+1lp-lnu+1lp_n.unw_dzero_mcp20_FZU-GRID_137006-129902941713880_p21.21.00_dq_dq.root

# The davs URL is:
davs://fndca1.fnal.gov:2880/pnfs/fnal.gov/usr/d0/wjets/CSG_alpgenpythia_w_lnu_p212100_Run2b3_v5/CAF-MCv1-137006-tmb_p20.17.02_NumEv-10000_w+1lp-lnu+1lp_n.unw_dzero_mcp20_FZU-GRID_137006-129902941713880_p21.21.00_dq_dq.root

Authentication

Method 3 and method 4 above requires authentication. With proper authentication, you can access the files from any other clients other than d0mino0[4,5,6].fnal.gov.

The files copied to dCache are publicly readable with any account which is authorized to any Fermilab VO (virtual organization). If you have a Fermilab account with any experiment, you can get authenticated via the following:

kinit YOUR_FNAL_USER_NAME@FNAL.GOV kx509 voms-proxy-init -voms fermilab:/fermilab -noregen # you can also use a proxy of your current experiments VO

List of files and corresponding URLs

For your convinience, a tarball containing file lists of NFS path, dcap URL, xrootd URL and davs URL is provided.

file_in_dcache subdirectory contains four subdirectoies. As the subdirectory name reveals, they contain corresponding file access path/URL.

file_in_project_disk subdirectory contains list files organized by project host server. There are two list files per host server with one containing the original path in project disks and the other containing the new path in dCache.

<d0mino04.fnal.gov> tree -d d0_data_preservation
d0_data_preservation
├── files_in_dcache
│   ├── davs
│   ├── dcap
│   ├── nfs
│   └── xrootd
└── files_in_project_disk

6 directories