DØ Run Plan Standard Instructions
Last Updated: 03-Mar-2002 by Leslie Groer
Change Log:
| 01-Dec-2001 | Version 2.0 of Run plan |
| 10-Dec-2001 | Many minor modifications |
| 14-Dec-2001 | Update FPD pot motion plans; update shiftset instructions |
| 18-Dec-2001 | Update schedule for magnet polarities |
| 03-Jan-2002 | New Silicon Radiation Instructions |
| 22-Jan-2002 | Moved interim CFT operating procedures into Standard Run Plan
Updated general shift procedures and added begin of store procedure.
|
| 12-Feb-2002 | Updated Luminosity instructions
|
| 17-Feb-2002 | Moved CDF Pot motion monitoring
instructions into Standard Run Plan
Added link to Beam's Division schedule
Removed instructions for Day shift Captain to attend the Beams Division 9:00 meeting.
Added new magnet configuration schedule
|
| 18-Feb-2002 | Modified CFT instructions
Updated Captain's general instructions |
| 27-Feb-2002 | Updated link for new SMT radiation monitoring instructions |
| 03-Mar-2002 | Added Electronic Logbook instructions |
Contents
The Run Plan Standard Instructions can be found at
http://www-d0.fnal.gov/runcoor/runplans/runplan_standard.html
The Current Daily Plan can be found at
http://www-d0.fnal.gov/runcoor/runplans/runplan.html
The current Beams Division schedule can be found on the web
at http://www-bdnew.fnal.gov/operations/schedule/schedule.html.
The
default running condition for a store, unless otherwise specified and
approved by the Run Coordinator, is
to run with all available readout crates in the global run. Captains
are responsible for enforcing the run plans and resolving conflicts.
Work that influences or impacts the DAQ between stores must be
scheduled in advance and approved by the Commissioning Coordinator.
Access Requests
Check the Control Access Request lists in the Control Room and written
on the White Board on the South side of the Control Room. Contact the
Run Coordinator if there is a chance of access for approval.
Controlled Access Requirements
You will need to have your Controlled Access and other training up to
date to get into the collision hall during accesses. Please ensure
you are qualified. Contact Bill Freeman (wfree@fnal.gov) if there are
problems.
Training needed is:
- DØ Hazard Awareness
- Lock-Out Tag-Out (LOTO) I Training
- Radiological Worker (CR)
- Fermilab Controlled Access
To check your training, go to the
Training Plans page (FNAL
domain access only),
enter your ID and select the ITH (Individual Training History) under Option 1.
The Due Date shows when your training will expire. If this has
happened or will happen soon get yourself trained!
Film badges must be worn in the collision hall. Temporary badges are
available in the control room.
Electronic Logbook
The "Config Change" form in the e-log is intended for any "major" configuration
change in any
subsystem - examples might be installation of new hardware or firmware,
addition of detectors, loss or regain of power supplies etc, etc.
The keyword to search on is CONFIG_CHANGE. Contact Leslie Groer
if more fields are needed.
CFT Operations
Until further notice, to aid debugging and commissioning the CFT, the
following plan is in effect. When there is no colliding beam, the CFT
crates are under the control of the CFT shifter.
During colliding beam:
- The CFT shifter will communicate with the Captain and DAQ shifter and
request whether the CFT crates (0x50,0x51,0x52,0x53) are to be included
in the primary global run or not. Removal of CFT crates from the
global run for reasons other then fixing immediate hardware/software
problems must be approved by George Ginther or Andrew Alton. The
default condition, unless explicitly approved is to leave the crates in the
global run running in suppressed mode.
- If approved, CFT crate(s) can be excluded from the
global run and sDAQ runs with the CFT only may be run independently.
- If independent CFT pDAQ runs or unsuppressed CFT running in the global
runs are requested, the Run Coordinator must approve the run. This
does not apply to sDAQ runs.
Silicon Microstrip Detector
Simplified instructions for Captains if no SMT shifter is present.
http://www-d0online.fnal.gov/www/groups/smt/captain_instr.html
Forward Proton Detector
There is a formal DØ/BD plan for how and when the FPD roman pots
can be moved. This agreement applies to Roman pot insertion
from December 14, 2001 onward:
DØ
plans to move the Roman pots in to standard positions most stores
not earlier than one half hour after the beginning of the store.
The MCR and CDF will be notified before pot motion. The default positions
will be A1U = 33.1 mm, A1D = 37.9 mm, A2U = 35 mm, A2D = 38 mm
P1U = 27.2 mm, P1D = 27.1 mm, P2U = 29.9 mm and P2D = 30.5 mm
(determined since the October 2001 shutdown ended as safe positions),
with the beampipe axis roughly at 45 mm. Pot insertion
will be done in a similar manner as in the last weeks before the
shutdown, with the final couple mm at slow speed allowing time to react
to an unanticipated change in beam orbit. DØ should be notified
of any planned changes in beam position. The pots will remain at these
positions for most/all of the store retracting the pots prior to the
beam being aborted or machine studies.
In some subsequent end of stores we plan to do studies to define dipole
pot operating positions and test whether beam conditions have changed.
Approval from BD run coordinator will be obtained
prior to these studies. An acceptable new position for now is defined
as one that does not increase the DOslash; losses by more than 10% or
significantly affect CDF losses.
The MCR and CDF must be notified before any pot motion so they
can watch for losses. CDF has asked to be notified about which pots
are being moved so they can correlate the motion with their losses.
FPD shifters will be present for all pot motion.
The FPD pager number is (630) 266-2635 if there are any questions.
Monitoring CDF Pot motion
CDF will be moving their forward proton pots at the end of some stores.
The MCR will inform D0 before they start. There is a parameter page with
the pot position information at Acnet page
S4 (SPARE PARAM PAGE) and page to the 4th page. The Acnet variables are
C:TPOT1M, C:TPOT2M, C:TPOT3M. The pots will be moved in together in steps of
100 counts (about 3.5 mm), while watching the losses at CDF and D0. Normal
LVDT readings are approximately -900 at the outer limit and +180 to +200
at the inner limit.
The Captain should monitor the motion of the pots and the D0 losses.
High Voltage Instructions (Detector and Luminosity)
Shift Captains are responsible for communicating to all detector
shifters about the begining of a store (when scraping is completed). The
Shift Captain should specifically instruct detector shifters
(for now muon and SMT) to set their HV to 100%. Data taking (including
adjustment of prescales) should be started after HV is at 100% for
all detectors in trigger/readout.
A few minutes before the store is terminated (D0 is supposed to receive a call
from the MCR about planned terminations) Captain has to instruct DAQ expert
to stop global running and ask detector experts to set their detector HV
to "Standby". To avoid confusion, refer to the table below for which systems
need to regulate their HV depending on beam conditions.
Luminosity counter phototubes are very sensitive to the presence of the
solenoidal magnetic field. Whenever current in the solenoid is changed
(turning solenoid ON, OFF or changing polarity) it is the responsibility of the
Shift Captain to set the HV on the luminosity counters according to specific
instructions outlined below by Gregor Geurkov.
Note that the Luminosity HV stays ON at all times, even during
beam studies, but the setting of the HV to lower or higher percentages
depends on the solenoidal field being off or on.
Setting Luminosity HV
How to tell if the Luminosity information is updating in ACNET
| | Beam conditions |
|---|
| Detector | Shifter | Collisions | Injection | Beam studies | No Beam (Calibrations) |
| SMT | SMT shifter | 100% | OFF | OFF | 100% |
| CAL | CAL shifter | 100% at all times |
| ICD | CAL shifter | 100% at all times |
| MUON | MUON shifter | 100% | Standby | Standby | Standby |
| LUM | Captain | 70% at all times with solenoid off 100% at all times with solenoid on) |
Magnets
Before the solenoid or toroid are turned on or off, MCR must be notified.
Contact the Operations Technicians in DAB to ramp the magnets. The
solenoid takes about 20 minutes to discharge and the toroid about 10 minutes.
The shift captain should check with the operation technicians that these
are interlocked after they are ramped down.
Plan for Magnet Operations
-
The Shift Captain is responsible for providing D0 Ops Shifter with
instructions on turning D0 magnets ON/OFF or changing polarities.
-
Any changes in magnet currents should occur when there is no
store in the Tevatron. The Main Control Room should be notified by the Shift
Captain at least 10 minutes before any changes in D0 magnet operating
conditions.
-
The polarity of the magnets is to be changed every week. Changes are to
be done before the first store that starts after 00:00 o'clock Monday, and
will be done independent of the amount of data collected during previous
week(s) or any other conditions.
-
For the next few months, the sequence of polarities changes is:
(R - Reverse, F - Forward)
| Week of |
2/4 |
2/11 |
2/18 |
2/25 |
3/4 |
3/11 |
3/18 |
3/25 |
4/1 |
4/8 |
4/15 |
4/22 |
4/29 |
5/5 |
| Solenoid |
F |
R |
F |
F |
R |
R |
R |
F |
F |
R |
F |
F |
R |
R |
| Toroid |
R |
R |
R |
F |
F |
R |
F |
F |
R |
R |
R |
F |
F |
R |
-
Special modes of operation for the magnets (no field for detector
studies, etc.) will be described on a case by case basis in the daily run
plan. As soon as such studies are over, we should return to the sequence
outlined in step 4. above.
-
In order to reduce operating expenses, the solenoid and toroids should be
powered OFF if it is known that collisions are not expected within the next
24 hours. They should be turned ON at least 1 hour before the expected
shot setup.
-
During magnet current changes, follow the procedures outlined in the run
plan for operating the luminosity counters high voltage. No other detectors
are known to be affected by magnetic field changes.
DAQ
The main task of the shift crew is to collect data in stable global runs
during colliding beam and to support the debugging/commissioning efforts
when there are no collisions and
to ensure that the DAQ and all subsystems are operational before collisions
starts. All detectors should have calibration runs performed
prior to beam. Cosmic ray or zero bias runs should continue with all systems
at the discretion of the detector subsystem coordinators. Captains should be
cogniscent of the
Run Coordinator's general instructions.
The major shift tasks are:
- Keep DAQ running collecting colliding beam data.
Recording must
be kept ON for all runs.
- All test runs and trigger configurations must be stopped and freed
before starting the global data taking run with colliding beam.
CFT special runs may only start after the global run is going.
- Captains will inform the DAQ shifter when the begin store
command should be issued (after scraping is complete) and when to issue the
end store command which should be done before high voltages are
ramped down or before accelerator studies begin.
- Include all front-end and readout crates in the data taking; experts have
to be called in the case of problems.
Detector experts should clearly indicate the status of crates
on the white board in the Control Room.
- Conduct Captain and shifters' walkthroughs, fill check lists and
report all problems to experts.
- Run all detectors at full voltages (beam conditions permitting).
- Monitor beam losses and silicon radiation doses.
- Help experts with short controlled accesses.
- Run all detector Examines under Detector shifter control. Report any
problems to the subdetector coordinators.
Until further notice the Global Examine is broken and need not be run.
- When there is no beam, calibration runs should be taken. These runs
should be coordinated with the DAQ shifter.
- The offline farms will process all data in global
physics runs i.e. no special shiftsets are required.
If there are special runs (cosmics, halo, etc) that needs to be reprocessed
on the farms, then the persons requesting the special data collection is
required to fill in the
shiftset request form and to send mail to
d0-farms@fnal.gov.
Colliding Beam
The default running condition is to take data with the global trigger
list (see the current run plan for details) with all available crates.
Shot Setup
To ensure that we maximize our data collecting ability with colliding beam,
here is the procedure for shot setup:
- Shot setup can last 2-3 hours sometimes. Once all the anti-protons are
loaded and they are injecting protons then things are getting serious!
- Stop all calibration, test runs etc and download the global trigger file
and start a non-recorded global run with all crates included. If there are
DAQ or system problems you still have time to contact the DOC or experts to
get things working before collisions start.
Note that the HV on the Muon of SMT does
not have to be on to run global runs.
- As soon as scraping is complete, stop the run, the SMT and Muon shifters
should be notified by the Captain to raise their High Voltage and the DAQ
expert should be notified to issue the begin_store
command and to dowload the appropriate prescale file, and
start a recorded run.
- If there are DAQ or other problems at this point, do not hesitate to
contact the experts and have them come in if the problems can not be solved
remotely.
At the begin of stores, the store number must be entered into COOR by the
DAQ shifter via
-
setup d0online
-
store_begin number.
Similarly, the end of store command is
-
store_end
At the beginning of a store, Captains should record all the information from
Channel 13 (the Beam's Status page) in the elog.
No Collisions (e.g. proton only or anti-proton only beam)
Allow detector experts to work on commissioning activities, under
the Shift Captain's approval. All experts must return their
systems to working order before they complete their work.
Note: If there are severe conflicts with the use of the
DAQ system because of instabilities and people starting/stopping runs, issuing
SCL inits, etc then it is the Shift Captain's duty to determine priorities
and to enforce them. Contact the Commissioning Coordinator if need be.
No Beam in the Tevatron
If there is no beam, then calibration runs should be conducted by the
various subdetector shifters.
The Shift Captain and the Run Coordinator
will determine priorities for various subsystems to have exclusive use of the
DAQ system in the case of interference.
Standard Trigger Files
For no beam in the machine, the default file is: zero_bias_only-1.30.xml
For cosmic ray running, the default file is: cosmics-1.30.xml
For proton-only beam running: proton_halo_only-1.2.xml
General Shifter Tasks
The Operations Technicians are taking care of the safety walk through.
Captains are
responsible for safety walkthroughs on the first two pages
including the 2nd floor of the Fixed Counting House. Heidi Schellman
has put together a very useful Pictorial
Guide to components in the Control Room and in DAB.
Silicon Radiation Monitoring
The Captain should make sure that the Silicon Radiation Monitoring is running.
See the online instructions for details.
(http://d0server1.fnal.gov/users/lipton/www/radmon_shift.html)
SAM Dataset Definitions
All global physics runs will be processed by the reconstruction farms.
If a special run (e.g. cosmics, halo, etc) needs to be reprocessed on the
farms, then the person/s requesting the special data collection is/are
required to fill in the
shiftset
request form and to send mail to
d0-farms@fnal.gov. There are older
more explicit
instructions about how to define a shiftset.
Examines and Monitoring
The default event display d0ve should be run at all times for colliding data
start_daq d0ve
Run Examines and Event displays at all times. In particular:
| Examine |
Shifter |
Node |
| Vertex Examine | Captain | d0ol04 |
| Event Display (d0ve) | DAQ shifter | d0ol10 |
| Calorimeter Examine | Calorimeter shifter | d0ol06/d0ol23 |
| Muon Examine | Muon shifter | d0ol09 |
| SMT Examine | SMT shifter | d0ol05 |
| CFT Examine | CFT shifter | d0ol08 |
COOR records the begin and end of runs along with the crate configurations.
DAQ shifters must still enter the relevant information in the taker
pop-up windows. For details, see the
message from Alan Stone.
DAQ Shifter should print the L1 and L3 trigger monitor
output page once per shift during colliding beam or after any major
configuration change.
Captains should summarize the runs taken with colliding beam
and indicate their quality:
start end run# trigger #events toroid/solenoid crate list data quality (good/bad/unknown) Comments
(off,for,rev) (CAL,CFT,CPS,MUO,SMT)
These summaries should be put into the shift summary for distribution to
d0shiftsummary and posted to
D0NEWS in the OPERATIONS folder.
| | | Office | Pager | Cell | Home |
| Run Coordinator | Dmitri Denisov | x3851 | (630) 218-4498 | (630) 531-0413 | (630) 879-6725 |
| Commissioning Coordinator |
Leslie Groer | x5587 | (630) 218-8421 | (630) 399-0024 | (630) 208-8151 |
DAQ On-Call (DOC) Troubleshooter | | | (630) 218-4801 | | |
Send comments/corrections to Leslie Groer
Last modified: Tue Oct 22 05:33:07 CDT 2002