Following table describes the testing environment -
| Jobtype | D0 RTE | D0Runjob | RequestId | Jobfile Dataset | Input Dataset |
|---|---|---|---|---|---|
| REPROCESSING - p17 | |||||
| dzero_reconstruction | p17.05.01 | v07.02.07 | - | - | - |
| dzero_reco_merge | p17.05.01 | v07.02.07 | - | - | - |
| REPROCESSING - p21 | |||||
| dzero_reconstruction | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | parag-test-d0reco-p20-dataset-1 |
| dzero_reco_merge | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | - |
| dzero_skimming | p21.01.00 | v07.02.07 | - | d0repro_jobfiles_p21.01.00_samgridV7-3 | parag-test-d0skim-dataset-1 |
| MONTE CARLO | |||||
| dzero_monte_carlo (Pythia) | p17.09.08 | v07.07.06 | 50196 | d0mc_jobfiles_p17.09.08_samgridV7-6 | - |
| dzero_monte_carlo (Alpgen) | p20.08.02 | v07.07.06 | 65316 | d0mc_jobfiles_p20.08.02_samgridV7-3 | - |
| dzero_monte_carlo (Store D0GSTAR) | p20.08.02 | v07.07.06 | 55052 | d0mc_jobfiles_p20.08.02_samgridV7-4 | - |
| dzero_monte_carlo (Store DST) | p20.08.02 | v07.07.06 | 60592 | d0mc_jobfiles_p20.08.02_samgridV7-4 | - |
| dzero_merge | p17.09.08 | v07.04.04 | - | d0mc_jobfiles_p17.09.08_samgridV7-3 | - |
| dzero_monte_carlo (Phase dataset) | p20.08.02 | v07.07.06 | 69152 | d0mc_jobfiles_p20.08.02_samgridV7-4 | cpotter_cHiggs_200GeV_all_left_mu_CompHEP |
NOTE: THIS RELEASE CUT SHOULD NOT BE USED IN PRODUCTION.
This release cut is only for Sam test farms for further testing.
| Package Name | Package Version | Release Notes (Since Last Cut) |
|---|---|---|
| MIDDLEWARE PACKAGES | ||
| python | v2_4_2_sam | - NO CHANGE - |
| vdt | v1_10_1_6 | 1. VDT 1.10.1 for Head/Forwarding nodes. 2. InstallAsRoot action requires you to specify list of services you want to enable of disable using vdt-control. Name of the services to be used in the services list can be found by running command 'vdt-control --list' and the services are specified as a colon separated list. Example: ups installAsRoot vdt -O "--enableServices=globus-gatekeeper:vdt-update-certs --disableServices=apache" 3. Bug fix to the synchronize script 4. Install only VOMS-Client vdt package instead of complete VOMS from vdt. This was to get around a issue of VOMS installation in Samgrid environment for x86_64 platform and python v2_4_2_sam |
| pacman | v3_26 | 1. Pacman for VDT 1.10.1 |
| sam_gsi_config | v2_3_9 -q vdt | 1. Use CA certificates from the VDT if we are using VDT 1.8.1+ 2. If we are using VDT 1.8.1+, jim_gridftp, gridftp, jim_advertise, jim_broker_client use common CA certificate dir instead of product specific CA dir. 3. Generate edg-mkgridmap configuration files during tailoring. 4. Generate gridmap file for submission site with new tool generate_submission_site_gridmap. 5. Added certificates from latest release of VDT 6. Added new KCA CA certificate 7. globus-host-ssl.conf.1c3f2ca8 globus-user-ssl.conf.1c3f2ca8 grid-security.conf.1c3f2ca8 are now distributed in $SAM_GSI_CONFIG_DIR/grid-security/CA-conf and copied to the X509_CERT_DIR of the products while 'ups install_ca' action. These files are required by grid-cert-request to request host and sam service certificates with the CA 1c3f2ca8. Users using CA other than 1c3f2ca8 for host/service certificates should generate those files for the CA they want to use and put them in X509_CERT_DIR of the products for sam_cert_request to work. 8. Bug fixes to generate_submission_site_gridmap |
| sam_gsi_config_util | v2_1 -q vdt | - NO CHANGE - |
| tomcat | v4_3_4_1 | - NO CHANGE - |
| pyxml | v0_8_4 | - NO CHANGE - |
| xml_common_lib | v1_0 | - NO CHANGE - |
| xml_meta_configurator | v2_0_1 | - NO CHANGE - |
| jim_config | v2_0_11 | ?? |
| xmldb_client | v3_0_4 | - NO CHANGE - |
| xmldb_server | v1_0_6 | 1. Changed the config template to have default values for forwarding node |
| samgrid_util | v3_1_10 | Set of useful tools now distributed in the package to ease operations 1. Log rotation and archiving tool for OSG forwarding nodes 2. Tool to cleanup jobs in condor queue on samgrid.fnal.gov 3. Tool to cleanup jobs in condor queue on OSG forwarding nodes 4. Tool to relocate old spool directories on samgrid.fnal.gov to handle with 32k sub directory limit in ext3 5. Tool to clean old sandboxes and globus files 6. Tool to create gridmapfile for jim_broker_client from VOMS |
| samgrid_logger_client | v0_4 | - NO CHANGE - |
| server_run | v1_3_1 | 1. Changed the config template to have default values for forwarding node |
| SAM CLIENT PACKAGES | ||
| sam_fcp | v1_0_28 | - NO CHANGE - |
| sam_config | v7_1_6 | 1. Current version |
| sam_cp | v7_2 | - NO CHANGE - |
| sam | v8_4_1 | 1. Current version |
| CLIENT SITE PACKAGES | ||
| jim_client | v4_0_2 | 1. Support for new VDT 2. Removed the dependancy of jim_client on vdt v1_3_2 for MyProxy. MyProxy is available by default in new VDT. store_myproxy and get_myproxy.sh now use MyProxy available with new VDT. 3. Default value of jobmanager changed from jobmanager-runjob to jobmanager-samgrid. 4. Added job retrieval tool for Reco jobs. 5. Improved samg list performance and allowed the use of Condor constraints to from user. 6. Reco jobs now support new parameter runjob_requestid, same way as MC jobs. 7. All jobs now support new samgrid JDL parameter grid_globusrl. This can be used to specify Globus RSL for remote OSG sites. This should be used only when submitting jobs to an OSG site directly and not using OSG ReSS. 8. Support for two generic job types dzero_direct_io_type, dzero_indirect_io_type 9. Changed configuration template to use myproxy.fnal.gov as default MyProxy server 10. Fixed the bug in MC jobs where phase dataset was not correctly propagated to the grid job via the arguments |
| SUBMISSION SITE PACKAGES | ||
| jim_broker_client | v1_3_5 | 1. Changed the config template to have default values as per standard configuration 2. Config sync script assume reasonable defaults when the vdt is not installed or configured 3. Added new parameters to condor_config template as per the existing jim_broker_client on samgrid.fnal.gov |
| jim_www_sandbox | v2_0_3 | ?????????? |
| EXECUTION SITE PACKAGES | ||
| jim_advertise (NATIVE SAMGRID SITES) | v1_4_7 | - NO CHANGE - |
| jim_advertise (SAMGRID OSG FWD NODES) | v1_5_3 | 1. Changed the config template to have default values for forwarding node 2. Changed sync config on install to accept reasonable defaults if vdt is not configured and not to fail with exceptions |
| jim_sandbox | v2_4_18 | 1. Changed the config template to have default values for forwarding node 2. Use output packaging feature in new runjob 3. New CA certs in the gridftp client |
| sam_client | v2_1_23 | 1. New version of packages |
| jim_job_managers | v3_4_2 | 1. Changed the config template to have default values for forwarding node 2. Transferred output packaging functionality to D0runjob 3. Added support for requestId in the Reco jobs. Needs d0runjob_v07-09-06 or higher for reco jobs 4. Reco now uses new runjob macro format 5. Reco and Skimming jobs donot try to analyse the runjob exit code and exit with runjob's exit code 6. Support of generic job type dzero_direct_io_type which is based on dzero_reconstruction. This should be used for new jobs that need sam project. 7. Support of generic job type dzero_indirect_io_type which is based on dzero_monte_carlo. This should be used for new jobs that do need sam project. |
| jim_gridftp | v3_0_0 | 1. jim_gridftp service using new VDT |
| samgrid_osg_client (OSG FWD NODES ONLY) | v0_1_1 | 1. Product to store condor_config specific to CondorG used to submit jobs to OSG 2. Make condor_config independent of vdt version/release dir |
| samgrid_batch_adapter* | v7_2_11 | 1. Default scratch manager with improved checks 2. Updated sam_osg_handler based on new VDT 3. Bug fixes to osg_site_selector.py 4. Use samgrid_osg_client to setup CONDOR_CONFIG 5. Latest sam_osg_handler.sh 6. OSG site selector is more resilient from errors resulting from condor queries 7. sam_osg_handler will use GRID_GLOBUSRSL if available. 8. Changed the MyProxy server from fermigrid4.fnal.gov to myproxy.fnal.gov 9. Improvments to sam_osg_handler and osg_site_selector.py to reduce the condor_q queries to half and only query productions forwarding nodes. 10. Proxy fetched from myproxy server by sam_osg_handler.sh is valid for 336 hours instead of 120 hours. 11. Support for new nodes in OSG site selector |
| jim_info_providers | v1_1_1 -q GCC-2.95.2 | - NO CHANGE - |
| SAM STATION PACKAGES | ||
| sam_station | v6_0_5_22_srm -q GCC-3.1 | 1. Station with SRM support |
| sam_context_service | v1_3 -q GCC-3.1 | - NO CHANGE - |
| sam_bootstrap | v8_2_2 | 1. Start and stop new jim_gridftp/sam_gridftp services. New services should be named as gridftp3 and jim_gridftp3 in the server list file. |
| sam_gridftp | v3_0_0 | 1. sam_gridftp service using new VDT |
| PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED) | ||
| jim_merge** | v2_0_29 | 1. Transferred output packaging functionality to D0runjob. Backward comaptible when used with D0runjob older than v07-08-04. |
* samgrid_batch_adapter is a new package in SAM. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package