P17/P20 Monte Carlo Production Software

Software and Documentation for MC production

• D-Zero application suite
• SAMGrid cut
• Test requests
• Statistics and Monitoring
• Certification
• Documentation and Tools
• Links of interest

SAM v7

June 17, 2008

Package	Version	Tarball in SAM
D0 Release	p20.09.03	d0_MC_p20.09.03.tar.gz
D0 Release	p20.09.02	d0_MC_p20.09.02_v4.tar.gz
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
D0 Release	p17.09.08	d0_MC_p17.09.08_v2.tar.gz
D0 Release	p17.09.07	d0_MC_p17.09.07_v1.tar.gz
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
D0 Release	p20.09.02gen-p17.09.07	d0_MC_gen-p20.09.02-p17.09.07_v2.tar.gz
D0 Release	p20.05.00gen-p20.09.03	d0_MC_gen-p20.05.00-p20.09.03.tar.gz
d0runjob	v07-09-10	d0runjob_v07-09-10.tar.gz

February 26, 2008

Package	Version	Tarball in SAM
D0 Release	p20.09.03	d0_MC_p20.09.03.tar.gz
D0 Release	p20.09.02	d0_MC_p20.09.02_v4.tar.gz
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
D0 Release	p17.09.08	d0_MC_p17.09.08_v2.tar.gz
D0 Release	p17.09.07	d0_MC_p17.09.07_v1.tar.gz
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
d0runjob	v07-09-06	d0runjob_v07-09-06.tar.gz

November 23, 2007

Package	Version	Tarball in SAM
D0 Release	p20.09.02	d0_MC_p20.09.02_v4.tar.gz
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
D0 Release	p17.09.08	d0_MC_p17.09.08_v2.tar.gz
D0 Release	p17.09.07	d0_MC_p17.09.07_v1.tar.gz
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
d0runjob	v07-08-01	d0runjob_v07-08-01.tar.gz

October 15, 2007

Package	Version	Tarball in SAM
D0 Release	p20.09.02	d0_MC_p20.09.02_v4.tar.gz
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
D0 Release	p17.09.08	d0_MC_p17.09.08_v2.tar.gz
D0 Release	p17.09.07	d0_MC_p17.09.07_v1.tar.gz
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
d0runjob	v07-07-06	d0runjob_v07-07-06.tar.gz

August 13, 2007

Package	Version	Tarball in SAM
D0 Release	p20.09.02	d0_MC_p20.09.02_v1.tar.gz
d0runjob	v07-07-04	d0runjob_v07-07-04.tar.gz

July 25, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-07-04	d0runjob_v07-07-04.tar.gz

May 24, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-07	d0runjob_v07-05-07.tar.gz

May 3, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-06	d0runjob_v07-05-06.tar.gz

May 1, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-05	d0runjob_v07-05-05.tar.gz

April 5, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-03	d0runjob_v07-05-03.tar.gz

April 1, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-02	d0runjob_v07-05-02.tar.gz

March 27, 2007

Package	Version	Tarball in SAM
D0 Release	p20.08.02	d0_MC_p20.08.02_v3.tar.gz
d0runjob	v07-05-01	d0runjob_v07-05-01.tar.gz

November 29, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
d0runjob	v07-02-06	d0runjob_v07-02-06.tar.gz

November 16, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.06	d0_MC_p17.09.06_samv7.tar.gz
d0runjob	v07-00-01	d0runjob_v07-00-01.tar.gz

Note that a magnetic field tarball is no longer needed.

SAM v5

September 13, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.06	d0_MC_p17.09.06_v2.tar.gz
MC_Runjob	v06-05-26	mc_runjob_v06-05-26.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

June 15, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.06	d0_MC_p17.09.06_v2.tar.gz
MC_Runjob	v06-05-22	mc_runjob_v06-05-22_v2.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

May 11, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v9.tar.gz
MC_Runjob	v06-05-22	mc_runjob_v06-05-22.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

March 13, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v9.tar.gz
MC_Runjob	v06-05-19	mc_runjob_v06-05-19_v2.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

February 15, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v9.tar.gz
MC_Runjob	v06-05-18	mc_runjob_v06-05-18.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

January 19, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v7.tar.gz
MC_Runjob	v06-05-10	mc_runjob_v06-05-10_v2.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

January 6, 2006

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v4.tar.gz
MC_Runjob	v06-05-10	mc_runjob_v06-05-10_v2.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

December 9, 2005

Package	Version	Tarball in SAM
D0 Release	p17.09.01	d0_MC_p17.09.01_v3.tar.gz
MC_Runjob	v06-05-07	mc_runjob_v06-05-07.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

August 22, 2005

Package	Version	Tarball in SAM
D0 Release	p17.06.02	d0_MC_p17.06.02.tar.gz
MC_Runjob	v06-04-02	mc_runjob_v06-04-02.tar.gz
Magnetic Field	v00-01-00	MagField_v00-01-00.tar.gz

SamGrid Release Cuts

Notes

For merging, the preferred way of specifying the files to be merged is writing the dataset definition query in the JDL itself using attribute merge_dataset_query. This will run consistency checks on your dataset and avoid that files are merged twice. To override these checks, create your own dataset definition via sam tools and pass it to the JDL using attribute merge_dataset_name.

JDL Examples

MC production JDL:

job_type = dzero_monte_carlo
sam_experiment = d0
sam_universe = prd
group = dzero
station_name = samgfarm
runjob_requestid = 22529
d0_release_version = p17.06.00
jobfiles_dataset = p17_06_00_dpcc_set2garzoglio
minbias_dataset = ccin2p3_minbias_dataset
runjob_numevts = 40
events_per_file = 10
check_consistency = true
instances = 1

MC merging JDL:

job_type = dzero_merge
station_name = samgfarm
sam_experiment = d0
sam_universe = prd
group = dzero
#### Mutually Exclusive options merge_dataset_name &  merge_dimension_query
#### What dataset to merge
merge_dataset_name=p17mergetest_un-tmb
### OR ###
#### Dimension query speciying the contraints for the files to be merged
#merge_dimension_query = global.jimglobaljobid garzogli_fndapq.fnal.gov_174032_1
d0_release_version=p17.06.00
jobfiles_dataset = p17_06_00_dpcc_set2garzoglio
check_consistency=true
instances = 1

The requests 24380, 25666, and 27131 have been created as p17 test requests. Requests 24380 and 27131 have all 4 phases and are clones of requests 24282 and 26511 respectively. Request 25666 is a clone of request 25529 with no Generated phase. It uses a datasetdefname/phase_dataset as input data for the Simulated phase. Please use these requests to test farm installations.

• P17/P20 Weekly MC Production Statistics
• P17/P20 Daily MC Production Statistics
• Non-Grid MC production at Lyon
• SAMGrid Job Efficiency statistics
• DOSAR P17 MC Production Statistics
• AutoMC Daemon Status
• D0 OSG MC Jobs

• Current p20 certification requests: 53412-53416 (old: 50772-50776)
• p17.09.06 Certification Status
• p17.09.01 Certification Status
• UK LCG Sites
• Certification Requirements Note (PDF)

• Step by step description to generate mcp17 MC with JIM by Cano Ay
• JIM Job Submission by J Snow
• Dial-A-Job - A GUI for MC Job Submission and daemon for automatic request processing
  • Dial-A-Job tarball for SAM v7 - new version 2009/05/25
  • DAJ Readme
  • DAJ Release Notes
  • Short DAJ Presentation
• Queue.py - MC Request Scheduler, reserves a prioritized request for a farm; SAM v7 version. This is included in the DAJ tarball for SAM v7. - new version 2008/02/26

• Data Reprocessing with SAMGrid
• D0runjob FAQ