SamGrid Release Cuts

Table of Contents

  1. Samgrid V7 Production 2007 Release Cuts
    1. June - 2007
    2. April - 2007
    3. March - 2007
  2. Samgrid V7 Production 2006 Release Cuts
    1. November - 2006
    2. September - 2006
    3. August - 2006
  3. SamGrid V7 Development/Testing Environment
  4. SamGrid V7 Development/Testing Release Cut
  5. 2005 Release cuts

2007 Release cuts

For detailed installation instructions please refer to Samgrid Page


SamGrid V7 June - Cut (Updated: June 08, 2007)

Bug Fixes

Package Name Package Version Release Notes
MIDDLEWARE PACKAGES
python v2_4_2_sam - NO CHANGE -
vdt v1_1_14_13 - NO CHANGE -
pacman v2_116_1 - NO CHANGE -
sam_gsi_config v2_2_32 -q vdt 1. New UK eScience CA
2. New GermanGrid CA
sam_gsi_config_util v2_1 -q vdt - NO CHANGE -
tomcat v4_3_4_1 - NO CHANGE -
pyxml v0_8_4 - NO CHANGE -
xml_common_lib v1_0 - NO CHANGE -
xml_meta_configurator v2_0_1 - NO CHANGE -
jim_config v2_0_6 1. Improved sam_storage_negotiator
xmldb_client v3_0_4 - NO CHANGE -
xmldb_server v1_0_5 - NO CHANGE -
samgrid_util v3_0_1b - NO CHANGE -
samgrid_logger_client v0_4 - NO CHANGE -
server_run v1_3 - NO CHANGE -
SAM CLIENT PACKAGES
sam_fcp v1_0_28 1. Bug fixes. Exit with non zero exit code in case of errors
sam_config v7_1_5 - NO CHANGE -
sam_cp v7_2 - NO CHANGE -
sam v8_1_5 1. New SAM
CLIENT SITE PACKAGES
jim_client v3_0_3 1. Changed the format for the temporary Condor jdf created in /tmp. Now the random filename uses timestamp and username instead of just pid.
2. Use sam group 'dzero' instead of 'test' to create the dataset.
SUBMISSION SITE PACKAGES
jim_broker_client v1_3_0 - NO CHANGE -
jim_www_sandbox v2_0_2 - NO CHANGE -
EXECUTION SITE PACKAGES
jim_advertise v1_4_7 - NO CHANGE -
samgrid_batch_adapter* v7_1_0 1. Updated sam_osg_handler to use OSG Resource selection service
jim_sandbox v2_4_15 1. Updated the CA fingerprints in gridftp_client.tar
sam_client v2_1_17 1. jim_merge v2_0_28
2. sam_fcp v1_0_27
3. jim_config v2_0_6
jim_job_managers v3_2_6 1. Bug fix to handle merging of mc files with event count other than 250
jim_gridftp v2_3_3 - NO CHANGE -
jim_info_providers v1_1_1 -q GCC-2.95.2 - NO CHANGE -
SAM STATION PACKAGES
sam_station v6_0_5_7 -q GCC-3.1 - NO CHANGE -
sam_context_service v1_3 -q GCC-3.1 - NO CHANGE -
sam_bootstrap v8_1_0 - NO CHANGE -
PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED)
jim_merge** v2_0_28 1. Look for core files only in the Copydoom directory
2. Bug fix to handle merging of files with partition number 000 3. Bug fix to handle merging of mc files with event count other than 250 4. SAM Storage locations for fetching binaries and unmerged thumbnailscan be configured separately using incoming storage locations.

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


SamGrid V7 Production - April Cut (Updated:April 30, 2007)

Bug Fixes to Reco and MC.
Support for Alpgen/Pythia requests.

Package Name Package Version Release Notes (Since Last Cut)
MIDDLEWARE PACKAGES
python v2_4_2_sam - NO CHANGE -
vdt v1_1_14_13 - NO CHANGE -
pacman v2_116_1 - NO CHANGE -
sam_gsi_config v2_2_30 -q vdt - NO CHANGE -
sam_gsi_config_util v2_1 -q vdt - NO CHANGE -
tomcat v4_3_4_1 - NO CHANGE -
pyxml v0_8_4 - NO CHANGE -
xml_common_lib v1_0 - NO CHANGE -
xml_meta_configurator v2_0_1 - NO CHANGE -
jim_config v2_0_4 - NO CHANGE -
xmldb_client v3_0_4 - NO CHANGE -
xmldb_server v1_0_5 - NO CHANGE -
samgrid_util v3_0_1b - NO CHANGE -
samgrid_logger_client v0_4 - NO CHANGE -
server_run v1_3 - NO CHANGE -
SAM CLIENT PACKAGES
sam_fcp v1_0_20 - NO CHANGE -
sam_config v7_1_5 - NO CHANGE -
sam_cp v7_2 - NO CHANGE -
sam v8_1_0 - NO CHANGE -
CLIENT SITE PACKAGES
jim_client v3_0_1 - NO CHANGE -
SUBMISSION SITE PACKAGES
jim_broker_client v1_3_0 - NO CHANGE -
jim_www_sandbox v2_0_2 - NO CHANGE -
EXECUTION SITE PACKAGES
jim_advertise v1_4_7 - NO CHANGE -
samgrid_batch_adapter* v7_0_4 1. Latest sam_osg_handler.sh
jim_sandbox v2_4_13 1. Create a randomize version of output_kludge base on JIM_JOB_NUMBER
sam_client v2_1_9 1. Use sam_fcp v1_0_25
jim_job_managers v3_2_5 1. Support for Alpgen/Pythia requests
2. Untested support for storing intermediate files
3. For jobs on OSG, fetch the binaries from OSG_APP if they are available.
4. Macro changes to store dst files.
5. Fixed a bug while untarring files introduced in v3_2_1.
6. Added jobDonePostprocess() that can be used to execute tasks like stopping SAM project forecfully or any other cleanup action.
jim_gridftp v2_3_3 - NO CHANGE -
jim_info_providers v1_1_1 -q GCC-2.95.2 - NO CHANGE -
SAM STATION PACKAGES
sam_station v6_0_5_7 -q GCC-3.1 - NO CHANGE -
sam_context_service v1_3 -q GCC-3.1 - NO CHANGE -
sam_bootstrap v8_1_0 1. New version from core SAM team
PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED)
jim_merge** v2_0_24 - NO CHANGE -

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


SamGrid V7 Production - March Cut (Updated:March 02, 2007)

Bug Fixes to Reco and MC.
Supports new job type dzero_skimming.
Several new features to logging info in xmldb.

Package Name Package Version Release Notes (Since Last Cut)
MIDDLEWARE PACKAGES
python v2_4_2_sam - NO CHANGE -
vdt v1_1_14_13 - NO CHANGE -
pacman v2_116_1 - NO CHANGE -
sam_gsi_config v2_2_329 -q vdt 1. New CA fingerprints
sam_gsi_config_util v2_1 -q vdt - NO CHANGE -
tomcat v4_3_4_1 - NO CHANGE -
pyxml v0_8_4 - NO CHANGE -
xml_common_lib v1_0 - NO CHANGE -
xml_meta_configurator v2_0_1 - NO CHANGE -
jim_config v2_0_4 1. Support "affinity" mode for selecting input/output storage
2. Improved storage negotiator
3. Fixed the sync_config.py to correctly identify the path from links
xmldb_client v3_0_4 1. Store facility information for jobs in xmldb
2. Store TargetedResource information for jobs in xmldb
xmldb_server v1_0_5 - NO CHANGE -
samgrid_util v3_0_1b 1. Bug fix to durable location cleanup script
samgrid_logger_client v0_4 - NO CHANGE -
server_run v1_3 - NO CHANGE -
SAM CLIENT PACKAGES
sam_fcp v1_0_20 - NO CHANGE -
sam_config v7_1_5 - NO CHANGE -
sam_cp v7_2 - NO CHANGE -
sam v8_1_0 1. Fixes to polling part of sam dh get lite
2. Use standard sam from now
3. Store files directly to durable location bypassing the fss buffer
CLIENT SITE PACKAGES
jim_client v3_0_1 1. Support for skimming job type. In JDL use -
job_type = dzero_skimming
Other JDL parameters are identical to that of reco jobs
2. Do not consider bad merged files in isMerged() check
SUBMISSION SITE PACKAGES
jim_broker_client v1_3_0 - NO CHANGE -
jim_www_sandbox v2_0_2 - NO CHANGE -
EXECUTION SITE PACKAGES
jim_advertise v1_4_7 - NO CHANGE -
samgrid_batch_adapter* v7_0_4 1. Updated the default scratch manager and sam_osg_handler
jim_sandbox v2_4_12 - NO CHANGE -
sam_client v2_1_8 1. Use standard SAM
2. New jim_merge
3. Fixed the Sync action in table file to not synch the xml config file as there is none useful.
4. New jim_config
jim_job_managers v3_1_8 1. Fixed the ProducedForName in the MC Metadata
2. Support new job type dzero_skimming
3. Log the incoming storage name in the XML DB
4. Do not specify minBiasDir in MC macro if minbias dataset isn't used
5. Fixed the table file to set $JIM_JOB_MANAGERS_DIR variable
6. Explicity specify the application family for establishing consumer
7. Establish process to explicitly limit one file only to avoid station running out of files.
8. Log the FacilityName in the xmldb.
9. Interpret TargetedResource=%__TARGETED_RESOURCE__ in the output of job lookup command and store the info in xmldb. Useful only in case of OSG/LCG.
jim_gridftp v2_3_3 - NO CHANGE -
jim_info_providers v1_1_1 -q GCC-2.95.2 - NO CHANGE -
SAM STATION PACKAGES
sam_station v6_0_5_7 -q GCC-3.1 - NO CHANGE -
sam_context_service v1_3 -q GCC-3.1 1. Bug fixes
sam_bootstrap v7_7_0 - NO CHANGE -
PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED)
jim_merge** v2_0_24 1. Use temporaryTransferLocation while storing files
2. Use SAM's builtin function to calculate file CRC
3. Use sam api's to store files instead of sam commands
4. Remove the thumbnail section from the MD of recocert files
5. Fixed the arglist passed to 'sam dh get lite' to use nodeName instead of node
6. Explicitly select good children to do merge check
7. Enable consistency checks for Reco Merge

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


2006 Release cuts

SamGrid V7 Production - November Cut (Updated: November 28, 2006)

Several Bug Fixes to MC Metadata handling.
Supports storing Zerobias files.

Package Name Package Version Release Notes (Since last cut)
MIDDLEWARE PACKAGES
python v2_4_2_sam - NO CHANGE -
vdt v1_1_14_13 - NO CHANGE -
pacman v2_116_1 1. Removed the dependency on python v2_1
sam_gsi_config v2_2_26 -q vdt 1. Updated the certificate request procedure
sam_gsi_config_util v2_1 -q vdt - NO CHANGE -
tomcat v4_3_4_1 1. New Tomcat
pyxml v0_8_4 - NO CHANGE -
xml_common_lib v1_0 - NO CHANGE -
xml_meta_configurator v2_0_1 - NO CHANGE -
jim_config v2_0_0 - NO CHANGE -
xmldb_client v3_0_2 - NO CHANGE -
xmldb_server v1_0_5 1. Reorganized the dependencies
samgrid_util v3_0_0 - NO CHANGE -
samgrid_logger_client v0_4 - NO CHANGE -
server_run v1_3 - NO CHANGE -
SAM CLIENT PACKAGES
sam_fcp v1_0_20 - NO CHANGE -
sam_config v7_1_5 1. sam_config for SAM V7 services
sam_cp v7_2 - NO CHANGE -
sam v7_5_3_jim7 - NO CHANGE -
CLIENT SITE PACKAGES
jim_client v2_2_12 1. Support for storing Zerobias files. Support following parameter in Samgrid JDL:
store_zerobias_file = true|false (defaults to false)
2. Jim client is more verbose. Messages printed to std_out/std_err have timestamps
SUBMISSION SITE PACKAGES
jim_broker_client v1_3_0 - NO CHANGE -
jim_www_sandbox v2_0_2 1. Removed the dependency on Python 2.1
EXECUTION SITE PACKAGES
jim_advertise v1_4_7 - NO CHANGE -
samgrid_batch_adapter* v7_0_2 - NO CHANGE -
jim_sandbox v2_4_12 - NO CHANGE -
sam_client v2_0_26 1. New packages
jim_job_managers v3_0_11 1. Support for storing zerobias files
2. Support to add facilityname to the file metadata
jim_gridftp v2_3_3 - NO CHANGE -
jim_info_providers v1_1_1 -q GCC-2.95.2 1. Removed the dependency on Python 2.1
SAM STATION PACKAGES
sam_station v6_0_5_7 -q GCC-3.1 1. SAM V7 station services
sam_context_service v1_3 -q GCC-3.1 1. Bug fixes
sam_bootstrap v7_7_0 1. Support for SAM V7 services
PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED)
jim_merge** v2_0_18 1. Support for Zerobias merging
2. Support to add facilityname to merged file metadata

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


SamGrid V7 Production - September Cut (Updated: September 07, 2006)

Supports MC (all phases) in addition to previous Release Cut.
Supports Recocert jobs to be run after merging.

Package Name Package Version Release Notes
python v2_4_2_sam New Python
vdt v1_1_14_13 - NO CHANGE -
sam_gsi_config v2_2_22 -q vdt
tomcat v4_3_3_9
xmldb_server v1_0_3
xmldb_client v3_0_2 1. Support for Python 2.4
2. Bug fix to idmgr
jim_config v2_0_0 1. Support Sam V7
pyxml v0_8_4 1. Support for Python 2.4
xml_meta_configurator v2_0_1 1. Support for Python 2.4
xml_common_lib v1_0 1. Support for Python 2.4
samgrid_util v3_0_0 1. Support Sam V7
samgrid_logger_client v0_4 1. Added retrial while connecting to the server port
server_run v1_3 1. Removed the dependency on Python 2.1
2. Support for different config files based on hostname
sam_cp v7_2 1. New sam_cp
jim_client v2_2_8 1. Support Sam V7
2. Tested support for Reconstruction
3. Tested support for MonteCarlo
4. Depends only on frozen sam client
5. Tested support for recocert. Support following two parameters in Samgrid JDL:
run_recocert = true|false (defaults to false)
recocert_durable_location = (durable storage to store root histograms)
6. Fixed the bug where MC unmerged tmbs were not correctly identified when they were merged
sam v7_5_3_jim7 Enjoy new SAM!
jim_broker_client v1_3_0
jim_job_managers v3_0_4 1. Support Sam V7
2. Tested support for Reconstruction
3. Tested support for MonteCarlo
4. Tested support for recocert
jim_sandbox v2_4_12 1. Support Sam V7
jim_advertise v1_4_7 - NO CHANGE -
sam_client v2_0_18 1. Support Sam V7
2. Support for Reconstruction
3. Support for MonteCarlo
4. Support for multiple streams
5. Support for recocert
samgrid_batch_adapter* v7_0_2 1. Support Sam V7
jim_merge** v2_0_11 1. Support for Sam V7
2. Support for d0runjob
3. Support for recocert in reco_merge
4. Fixed the monitoring bug for Recocert jobs
5. Fixed the MD for MC merged tmb to have d0sim as parents
6. Enabled optional monitoring in d0runjob

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


SamGrid V7 Production - August Cut (Updated: August 15, 2006)

This release cut supports Primary Reprocessing, Merging and Processing with multiple streams.

Package Name Package Version Release Notes
python v2_4_2_sam New Python
vdt v1_1_14_13 - NO CHANGE -
sam_gsi_config v2_2_22 -q vdt
tomcat v4_3_3_9
xmldb_server v1_0_3
xmldb_client v3_0_1 1. Support for Python 2.4
jim_config v2_0_0 1. Support Sam V7
pyxml v0_8_4 1. Support for Python 2.4
xml_meta_configurator v2_0_1 1. Support for Python 2.4
xml_common_lib v1_0 1. Support for Python 2.4
samgrid_util v3_0_0 1. Support Sam V7
server_run v1_3 1. Removed the dependency on Python 2.1
2. Support for different config files based on hostname
sam_cp v7_2 1. New sam_cp
jim_client v2_2_5 1. Support Sam V7
2. Tested support for Reconstruction
3. Untested support for MonteCarlo
4. Depends only on frozen sam client
sam v7_5_3jim7 Enjoy new SAM!
jim_broker_client v1_3_0
jim_job_managers v3_0_2 1. Support Sam V7
2. Tested support for Reconstruction
3. Tested support for MonteCarlo
jim_sandbox v2_4_11 1. Support Sam V7
jim_advertise v1_4_7 - NO CHANGE -
sam_client v2_0_14 1. Support Sam V7
2. Tested support for Reconstruction
3. Support for MonteCarlo
4. Support for multiple streams
samgrid_batch_adapter* v7_0_2 1. Support Sam V7
jim_merge** v2_0_8 1. Support for Sam V7

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


SamGrid V7 - Development/Testing Environment (Updated: August 08, 2007)

Following table describes the testing environment -

Jobtype D0 RTE D0Runjob RequestId Jobfile Dataset Input Dataset
REPROCESSING - p17
dzero_reconstruction p17.05.01 v07.02.07 - - -
dzero_reco_merge p17.05.01 v07.02.07 - - -
REPROCESSING - p21
dzero_reconstruction p21.01.00 v07.02.07 - d0repro_jobfiles_p21.01.00_samgridV7-3 parag-test-d0reco-p20-dataset-1
dzero_reco_merge p21.01.00 v07.02.07 - d0repro_jobfiles_p21.01.00_samgridV7-3 -
dzero_skimming p21.01.00 v07.02.07 - d0repro_jobfiles_p21.01.00_samgridV7-3 parag-test-d0skim-dataset-1
MONTE CARLO
dzero_monte_carlo (Pythia) p17.09.08 v07.07.06 50196 d0mc_jobfiles_p17.09.08_samgridV7-6 -
dzero_monte_carlo (Alpgen) p20.08.02 v07.07.06 65316 d0mc_jobfiles_p20.08.02_samgridV7-3 -
dzero_monte_carlo (Store D0GSTAR) p20.08.02 v07.07.06 55052 d0mc_jobfiles_p20.08.02_samgridV7-4 -
dzero_monte_carlo (Store DST) p20.08.02 v07.07.06 60592 d0mc_jobfiles_p20.08.02_samgridV7-4 -
dzero_merge p17.09.08 v07.04.04 - d0mc_jobfiles_p17.09.08_samgridV7-3 -
dzero_monte_carlo (Phase dataset) p20.08.02 v07.07.06 69152 d0mc_jobfiles_p20.08.02_samgridV7-4 cpotter_cHiggs_200GeV_all_left_mu_CompHEP

SamGrid V7 Development/Testing - Cut (Updated: September 27, 2007)

NOTE: THIS RELEASE CUT SHOULD NOT BE USED IN PRODUCTION.
This release cut is only for Sam V7 test farms for further testing.

Package Name Package Version Release Notes (Since Last Cut)
MIDDLEWARE PACKAGES
python v2_4_2_sam - NO CHANGE -
vdt v1_1_14_13 - NO CHANGE -
pacman v2_116_1 - NO CHANGE -
sam_gsi_config v2_2_33 -q vdt 1. Copy signing policies and other files while using --force-copy
sam_gsi_config_util v2_1 -q vdt - NO CHANGE -
tomcat v4_3_4_1 - NO CHANGE -
pyxml v0_8_4 - NO CHANGE -
xml_common_lib v1_0 - NO CHANGE -
xml_meta_configurator v2_0_1 - NO CHANGE -
jim_config v2_0_6 - NO CHANGE -
xmldb_client v3_0_4 - NO CHANGE -
xmldb_server v1_0_5 - NO CHANGE -
samgrid_util v3_0_1b - NO CHANGE -
samgrid_logger_client v0_4 - NO CHANGE -
server_run v1_3 - NO CHANGE -
SAM CLIENT PACKAGES
sam_fcp v1_0_28 - NO CHANGE -
sam_config v7_1_5 - NO CHANGE -
sam_cp v7_2 - NO CHANGE -
sam v8_1_5 - NO CHANGE -
CLIENT SITE PACKAGES
jim_client v3_0_3 - NO CHANGE -
SUBMISSION SITE PACKAGES
jim_broker_client v1_3_0 - NO CHANGE -
jim_www_sandbox v2_0_2 - NO CHANGE -
EXECUTION SITE PACKAGES
jim_advertise v1_4_7 - NO CHANGE -
samgrid_batch_adapter* v7_1_0 - NO CHANGE -
jim_sandbox v2_4_15 - NO CHANGE -
sam_client v2_1_20 1. sam v8_1_5
2. Fixed the init_sam.sh to work with latest sam
jim_job_managers v3_3_5 1. Needs D0runjob v7.07.06+
2. Use the D0runjob preprocessor macro for MC jobs.
3. Flatten the D0runjob preprocessor macro to use [jdl] section
4. Fix a bug where jim_job_managers would error out if a job type is not configured instead of using defaults.
5. Support phase datasets.
6. Phase dataset jobs no longer try to unpack cardfiles.
7. Compatibility with LCG JIDs
8. Restrict core file names to core
jim_gridftp v2_3_3 - NO CHANGE -
jim_info_providers v1_1_1 -q GCC-2.95.2 - NO CHANGE -
SAM STATION PACKAGES
sam_station v6_0_5_7 -q GCC-3.1 - NO CHANGE -
sam_context_service v1_3 -q GCC-3.1 - NO CHANGE -
sam_bootstrap v8_1_0 - NO CHANGE -
PACKAGES FOR REFERENCE (INSTALLATION NOT REQUIRED)
jim_merge** v2_0_28 - NO CHANGE -

* samgrid_batch_adapter is a new package in SAM V7. It is equivalent to sam_batch_adapter in SAM V5.
** Independent installation of jim_merge not required. This package is part of sam_client package


WWW Server Account
Last modified: Mon Sep 12 10:33:41 CDT 2005

Valid HTML 4.01 Transitional