Following table describes the testing environment -
| Jobtype | D0 RTE | D0Runjob | RequestId | Jobfile Dataset | Input Dataset |
|---|---|---|---|---|---|
| REPROCESSING - p17 | |||||
| dzero_reconstruction | p17.05.01 | v07.02.07 | - | - | - |
| dzero_reco_merge | p17.05.01 | v07.02.07 | - | - | - |
| REPROCESSING - p21 | |||||
| dzero_reconstruction | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | parag-test-d0reco-p20-dataset-1 |
| dzero_reco_merge | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | - |
| dzero_skimming | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | parag-test-d0skim-dataset-1 |
| MONTE CARLO | |||||
| dzero_monte_carlo (Pythia) | p17.09.08 | v07.07.06 | 50196 | d0mc_jobfiles_p17.09.08_samgridV7-6 | - |
| dzero_monte_carlo (Alpgen) | p20.08.02 | v07.07.06 | 65316 | d0mc_jobfiles_p20.08.02_samgridV7-3 | - |
| dzero_monte_carlo (Store D0GSTAR) | p20.08.02 | v07.07.06 | 55052 | d0mc_jobfiles_p20.08.02_samgridV7-4 | - |
| dzero_monte_carlo (Store DST) | p20.08.02 | v07.07.06 | 60592 | d0mc_jobfiles_p20.08.02_samgridV7-4 | - |
| dzero_merge | p17.09.08 | v07.04.04 | - | d0mc_jobfiles_p17.09.08_samgridV7-3 | - |
| dzero_monte_carlo (Phase dataset) | p20.08.02 | v07.07.06 | 69152 | d0mc_jobfiles_p20.08.02_samgridV7-4 | cpotter_cHiggs_200GeV_all_left_mu_CompHEP |
NOTE: THIS RELEASE CUT SHOULD NOT BE USED IN PRODUCTION.
This release cut is only for Sam test farms for further testing.
| Package Name | Package Version | Release Notes (Since Last Cut) |
|---|---|---|
| MIDDLEWARE PACKAGES | ||
| python | v2_4_2_sam | - NO CHANGE - |
| vdt | v1_8_1_1 | 1. VDT 1.8.1 for Head/Forwarding nodes. 2. InstallAsRoot action does not add PERL5LIB to /etc/xinetd.d/globus-gatekeeper. Instead, it patches $VDT_DIR/vdt/services/vdt-run-globus-gatekeeper.sh to setup ups perl to fix the perl library issues. This action should only be executed if you are installing and tailoring vdt through ups. If you are tailoring ups version of vdt to use an externally installed vdt, you should not perform this action. |
| pacman | v3_20 | 1. Pacman for VDT 1.8.1 |
| sam_gsi_config | v2_3_5 -q vdt | 1. Use CA certificates from the VDT if we are using VDT 1.8.1+ 2. If we are using VDT 1.8.1+, jim_gridftp, gridftp, jim_advertise, jim_broker_client use common CA certificate dir instead of product specific CA dir. 3. Generate edg-mkgridmap configuration files during tailoring. 4. Generate gridmap file for submission site with new tool generate_submission_site_gridmap. 5. Added certificates from latest release of VDT |
| sam_gsi_config_util | v2_1 -q vdt | - NO CHANGE - |
| tomcat | v4_3_4_1 | - NO CHANGE - |
| pyxml | v0_8_4 | - NO CHANGE - |
| xml_common_lib | v1_0 | - NO CHANGE - |
| xml_meta_configurator | v2_0_1 | - NO CHANGE - |
| jim_config | v2_0_8 | 1. Expansion of the API to support new monitoring tools |
| xmldb_client | v3_0_4 | - NO CHANGE - |
| xmldb_server | v1_0_6 | 1. Changed the config template to have default values for forwarding node |
| samgrid_util | v3_1_9 | Set of useful tools now distributed in the package to ease operations 1. Log rotation and archiving tool for OSG forwarding nodes 2. Tool to cleanup jobs in condor queue on samgrid.fnal.gov 3. Tool to cleanup jobs in condor queue on OSG forwarding nodes 4. Tool to relocate old spool directories on samgrid.fnal.gov to handle with 32k sub directory limit in ext3 4. Tool to clean old sandboxes and globus files |
| samgrid_logger_client | v0_4 | - NO CHANGE - |
| server_run | v1_3_1 | 1. Changed the config template to have default values for forwarding node |
| SAM CLIENT PACKAGES | ||
| sam_fcp | v1_0_28 | - NO CHANGE - |
| sam_config | v7_1_5 | - NO CHANGE - |
| sam_cp | v7_2 | - NO CHANGE - |
| sam | v8_2_2 | - NO CHANGE - |
| CLIENT SITE PACKAGES | ||
| jim_client | v4_0_2 | 1. Support for new VDT 2. Removed the dependancy of jim_client on vdt v1_3_2 for MyProxy. MyProxy is available by default in new VDT. store_myproxy and get_myproxy.sh now use MyProxy available with new VDT. 3. Default value of jobmanager changed from jobmanager-runjob to jobmanager-samgrid. 4. Added job retrieval tool for Reco jobs. 5. Improved samg list performance and allowed the use of Condor constraints to from user. 6. Reco jobs now support new parameter runjob_requestid, same way as MC jobs. 7. All jobs now support new samgrid JDL parameter grid_globusrl. This can be used to specify Globus RSL for remote OSG sites. This should be used only when submitting jobs to an OSG site directly and not using OSG ReSS. 8. Support for two generic job types dzero_direct_io_type, dzero_indirect_io_type 9. Changed configuration template to use myproxy.fnal.gov as default MyProxy server 10. Fixed the bug in MC jobs where phase dataset was not correctly propagated to the grid job via the arguments |
| SUBMISSION SITE PACKAGES | ||
| jim_broker_client | v1_3_1 | 1. Changed the config template to have default values as per standard configuration |
| jim_www_sandbox | v2_0_2 | - NO CHANGE - |
| EXECUTION SITE PACKAGES | ||
| jim_advertise (NATIVE SAMGRID SITES) | v1_4_7 | - NO CHANGE - |
| jim_advertise (SAMGRID OSG FWD NODES) | v1_5_2 | 1. Changed the config template to have default values for forwarding node |
| jim_sandbox | v2_4_17 | 1. Changed the config template to have default values for forwarding node 2. Use output packaging feature in new runjob |
| sam_client | v2_1_22 | 1. New version of packages |
| jim_job_managers | v3_4_2 | 1. Changed the config template to have default values for forwarding node 2. Transferred output packaging functionality to D0runjob 3. Added support for requestId in the Reco jobs. Needs d0runjob_v07-09-06 or higher for reco jobs 4. Reco now uses new runjob macro format 5. Reco and Skimming jobs donot try to analyse the runjob exit code and exit with runjob's exit code 6. Support of generic job type dzero_direct_io_type which is based on dzero_reconstruction. This should be used for new jobs that need sam project. 7. Support of generic job type dzero_indirect_io_type which is based on dzero_monte_carlo. This should be used for new jobs that do need sam project. |
| jim_gridftp | v3_0_0 | 1. jim_gridftp service using new VDT |
| samgrid_osg_client (OSG FWD NODES ONLY) | v0_1_0 | 1. Product to store condor_config specific to CondorG usedto submit jobs to OSG |
| samgrid_batch_adapter* | v7_2_9 | 1. Default scratch manager with improved checks 2. Updated sam_osg_handler based on new VDT 3. Bug fixes to osg_site_selector.py 4. Use samgrid_osg_client to setup CONDOR_CONFIG 5. Latest sam_osg_handler.sh 6. OSG site selector is more resilient from errors resulting from condor queries 7. sam_osg_handler will use GRID_GLOBUSRSL if available. 8. Changed the MyProxy server from fermigrid4.fnal.gov to myproxy.fnal.gov 9. Improvments to sam_osg_handler and osg_site_selector.py to reduce the condor_q queries to half and only query productions forwarding nodes. 10. Proxy fetched from myproxy server by sam_osg_handler.sh is valid for 336 hours instead of 120 hours. |
| jim_info_providers | v1_1_1 -q GCC-2.95.2 | - NO CHANGE - |
| SAM STATION PACKAGES | ||
| sam_station | v6_0_5_22_srm -q GCC-3.1 | 1. Station with SRM support |
| sam_context_service | v1_3 -q GCC-3.1 | - NO CHANGE - |
| sam_bootstrap | v8_2_2 | 1. Start and stop new jim_gridftp/sam_gridftp services. New services should be named as gridftp3 and jim_gridftp3 in the server list file. |
| sam_gridftp | v3_0_0 | 1. sam_gridftp service using new VDT |
| PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED) | ||
| jim_merge** | v2_0_29 | 1. Transferred output packaging functionality to D0runjob. Backward comaptible when used with D0runjob older than v07-08-04. |
* samgrid_batch_adapter is a new package in SAM. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package