closeout briefing - accelerator readiness review of …...charge to the committee •“the...

Closeout Briefing - Accelerator Readiness Reviewof the Muon Campus 13W Beam to the Diagnostic

AbsorberFebruary 18-20, 2020

Charge to the Committee• “The Committee is requested to conduct a readiness

review of the updates to the Muon Campus for 13W beam operation to the Diagnostic Absorber to assess if the hardware, personnel, and administrative systems and programs are ready for commissioning and operations within the proposed ASE.”

Team Members Assigned Areas

Harry Fanning, JLab, Chair CRAD 2.6 Commissioning & Operations Plan, CRAD 3.1 Accelerator Component ReadinessCRAD 3.2a Training and Qualifications - Accelerator Operations Personnel

David Kestell, LBNL CRAD 2.1 - SAD, CRAD 2.2 - ASE, 2.3 - USI, 2.5 Safety Config. Management.CRAD 3.3 Operations Procedures, CRAD 3.4 - Work Planning and ControlCRAD 3.5 - Radiation Protection, CRAD 3.6 - Credited Controls

Petra Grivins, FRIB CRAD 2.6, Commissioning & Operations Plan, CRAD 3.1 Accelerator Component ReadinessCRAD 3.2a Training and Qualifications - Accelerator Operations Personnel

Peter Shanahan, FNAL CRAD 2.1 - SAD, CRAD 2.2 - ASE, 2.3 - USI, 2.5 Safety Config. Management.CRAD 3.3 Operations Procedures, CRAD 3.4 - Work Planning and ControlCRAD 3.5 - Radiation Protection, CRAD 3.6 - Credited Controls

Cindy Joe, FNAL CRAD 2.6 Commissioning & Operations Plan, CRAD 3.1 Accelerator Component ReadinessCRAD 3.2a Training and Qualifications - Accelerator Operations Personnel

DOE Observers - Rachel Madiar, Chuck Mansfield, John Hauck

Specific Charge Elements

1. Are the necessary safety program elements of the Contractor Requirements Document for DOE O420.2C, Safety of Accelerator Facilities, in place?

i. A Contractor Assurance System that maintains an internal assessment process;

ii. A Facility Configuration Management Program that is related to accelerator safety; and

iii. Credited controls and appropriate administrative processes related to accelerator safety (e.g. training, procedures, etc.

Specific Charge Elements

2. Has the Laboratory developed a process for ensuring safe operations?

3. Are the necessary credited controls, accelerator hardware, beamline controls and monitoring systems, trained personnel, and administrative processes in place and adequate to support the commissioning and operations of 13W Beam to the Muon Campus Diagnostic Absorber?

Formula for feedback• Findings are statements of fact that summarize noteworthy

information presented during the review

• Comments are judgment statements about the facts presented during the review and are based on reviewers’ experience and expertise

• Recommendations are suggestions for considering a different approach, calculation method, parameter, requirement, or data to the project that may impact the project

Presentation Outline• There were 34 findings – these reflect the level of engagement

and participation by the reviewers and reviewees – we will not focus these during the outbrief

• We will focus on comments and recommendations – these are color coded

– There are 24 comments

– There are 11 prestart recommendations

– There are 9 post-start recommendations

• Many recommendations reflect your own identified issues and activities necessary for safe operation

Charge 1i - Assurance (PG) 1. Are the necessary safety program elements of the Contractor Requirements

Document for DOE O420.2C, Safety of Accelerator Facilities, in place?


• Findings

1. 16 previous management systems have been distilled down to 10, to focus on those that cross-cut the the entire organization

2. An executive dashboard has been created

3. Assurance council membership has been updated

4. An additional review is planned for later this year

Charge 1i - Assurance (PG)1. Are the necessary safety program elements of the Contractor Requirements



Comments

1. Creating a more streamlined group of management systems is commendable2. Assurance council is made up of people that are empowered to make changes

Recommendations

1. Fermilab should develop a formal ASO compliance assurance program to ensure the processes and systems necessary to protect credited controls are reviewed on a periodic basis [Post-start].

Charge 1ii - Configuration Management (PS)1. Are the necessary safety program elements of the Contractor Requirements


ii. A Facility Configuration Management Program that is related to accelerator safety;

Finding

1. Configuration management was reviewed in the context of Radiation Monitoring

& Credited Controls, Unreviewed Safety Issues, Document Management and

defense-in-depth institutional programs.

2. The overall approach, specific implementing processes and their associated

procedures, and records resulting from those procedures were described.

3. Discussions with staff demonstrated their understanding of the value of these

programs and their commitment to executing them appropriately.

Charge 1ii - Configuration Management (PS)Are the necessary safety program elements of the Contractor Requirements Document for DOE O420.2C, Safety of Accelerator Facilities, in place?

A Facility Configuration Management Program that is related to accelerator safety;

Comments

1. Credited controls are protected adequately through the implementation of this program. SCM at Fermilab is consistent with DOE expectations.

Recommendations

1. Consider including an assessment of the configuration control log in the new ASO assurance program to ensure any leading indicators or lessons learned are identified [Post-start]

Charge 1iii - Credited Controls (PS)


iii. Credited controls and appropriate administrative processes related to accelerator safety (e.g. training, procedures, etc.)

• Finding

1. Credited controls clearly flow from the SAD to the ASE.

2. Three types of CCs are listed in the ASE (passive, active engineered and administrative) along with the management and surveillance practices that maintain effectiveness.

3. The CCs and supporting activities are clearly understood by staff we interviewed including the accelerator operations staff.

4. Verification of CC integrity is a prerequisite for beam authorization to specific areas of the accelerator complex.

Charge 1iii - Credited Controls (PS)


iii. Credited controls and appropriate administrative processes related to accelerator safety (e.g. training, procedures, etc.).

Comments

1. The Credited Controls identified in the ASE necessary for Muon Campus operations are effectively in place and managed along with supporting procedures and processes.

Recommendations

1. None

Charge 2 (DK)

2. Has the laboratory developed a process for ensuring safe operations?

i. Reference CRAD 2.1 Safety Assessment Document (SAD)

ii. Reference CRAD 2.2 Accelerator Safety Envelope (ASE)

iii. Reference CRAD 2.3 Unreviewed Safety Issues (USI)

iv. Reference CRAD 2.6 Commissioning Plan

v. Reference CRAD 3.4 Work Planning and Control Related to Accelerator Safety

Charge 2i - SAD (DK)2. Has the Laboratory developed a process for ensuring safe operations?

i. Safety Assessment Document (SAD)

Findings

1. Fermilab maintains a modular SAD document for the complex, updating the relevant sections as needed for additions or modifications.

2. Updates to the SAD originate in the relevant Department with the Accelerator Division, are reviewed by a subcommittee of FESHCom, and approved by the relevant Division head, the CSO, and Director, and the FSO Manager as part of the ASE review and approval.

Comments

1. The SAD has been approved by the Lab Director

Recommendations

1. Consider expanding the membership of the Shielding and the SAD review committees to include additional Lab stakeholders (e.g. experimentalists) [Post-start]

Charge 2ii - ASE (DK)

2. Has the Laboratory developed a process for ensuring safe operations?

ii. Accelerator Safety Envelope (ASE)

Findings

1. The ASE contains all the Credited Controls from the SAD2. The ASE contains violation determination and actions to take - this is noteworthy

Comments

1. The ASE will be sent to DOE for approval shortly

Recommendations

1. The ASE must be approved by DOE prior to accelerator operations commencing [Pre-start]

Charge 2iii - USI (DK)2. Has the Laboratory developed a process for ensuring safe operations?

iii. Unreviewed Safety Issue (USI)

Findings

1. Fermilab has a USI determination process that is triggered by either a proposed modification to activities or previously unevaluated hazard observed during operations.

2. A negative USI determination allows modifications to proceed according to applicable requirements of FESHM, FRCM, and QAM.

3. A positive USI determination requires modification of the SAD with FNAL Director approval. Changes to the ASE require approval of the FSO Manager.

4. Approximately 36 people are trained to perform USI determinations

Charge 2iii - USI (DK)2. Has the Laboratory developed a process for ensuring safe operations?

iii. Unreviewed Safety Issue (USI)

Comments

1. The Fermilab work control process ensures that all work is reviewed and approved by a USI-knowledgeable individual prior to execution - this is noteworthy.

Recommendations

1. None

Charge 2 iv - Commissioning (CJ)2. Has the laboratory developed a process for ensuring safe operations?

iv. Commissioning Plan

Findings

1. The Commissioning Plan is detailed and organized for “Straight Through” and “Single Turn” extractions, with input from all stakeholders.

Comments

1. The Muon department has a great deal of combined experience in beamline commissioning and accelerator operations. This is commendable.

2. The inter-department communication between Muon and Accelerator Operations appears well-established.

3. Both departments are invested in the training process.4. Available commissioning time depends upon scheduling with g-2 operations.

Conflicts could prove problematic.

Charge 2 iv - Commissioning (CJ)2. Has the laboratory developed a process for ensuring safe operations?

iv. Commissioning Plan

Recommendations

1. Recommend that the department come up with a way to consistently and carefully document beam studies. [Post-start]

2. Current commissioning plan details the straight through and single turn extractions but could benefit from adding detail for resonant extraction. [Post-start]

3. Evaluate the level and rigor for the review necessary to evaluate the hardware and documentation required for resonant extraction. [Post-start]

Charge 2 v - Work Planning (DK)2. Has the laboratory developed a process for ensuring safe operations?

v. Work Planning and Control Related to Accelerator Safety

Finding

1. Fermilab has a thorough process for work planning and control related to accelerator safety.

2. Fermilab recently issued a revised FESHM Chapter 6020, “Work Planning & Control”, and continues to update its work planning process

Comment

1. Fermilab has recognized that front line supervisor awareness of management of scope change & work authorizations being an envelope is in need of strengthening.

Recommendations

1. Continue to strengthen front line supervisor awareness by providing necessary training. [Post-start]

Charge 3 (HF)

3. Are the necessary credited controls, accelerator hardware, beamline controls and monitoring systems, trained personnel, and administrative processes in place and adequate to support the commissioning and operations of the Muon Campus 13W Beam to the Diagnostic Absorber?

i. Reference CRAD 3.1 Accelerator Component Readiness

ii. Reference CRAD 3.2 Accelerator Operations Training and Qualification Program

iii. Reference CRAD 3.3 Accelerator Operations Procedures

iv. Reference CRAD 3.5 Radiological Protection

Charge 3i - Readiness (HF)


i. Accelerator Component Readiness

Findings:

1. Components are mainly installed and those that are not yet installed, have a plan for installation.

2. G-2 project has priority and will grant time for installation during available windows.

Charge 3i - Readiness (HF)



Comments

1. Components are mostly installed for beam delivery to Mu2e diagnostic absorber.

2. Plans are in place for installation of remaining items and are well thought out.

Charge 3i - Readiness (HF)3. Are the necessary credited controls, accelerator hardware, beamline controls

and monitoring systems, trained personnel, and administrative processes in place and adequate to support the commissioning and operations of the Muon Campus 13W Beam to the Diagnostic Absorber?


Recommendations

1. Install vacuum window at V907 to allow magnet motion [Pre-start]

2. Install fixed aperture collimator downstream of beam stops [Pre-start]

3. Move interlocks to permanent M4 enclosure entrance door [Pre-start]

4. Install M4 enclosure key core in entrance door [Pre-start]

5. Move M4 chipmunk to gate at end of enclosure [Pre-start]

6. Verify gas flow to ion chamber IC933 [Pre-start]

7. Electrical and Critical Device test H910 [Pre-start]

8. Collimator motion controls will be implemented as needed after beam is

transported down the beam line [Post-start]

Charge 3 ii - Training (PG)3. Are the necessary credited controls, accelerator hardware, beamline controls


ii. Accelerator Operations Training and Qualification Program

Findings

1. The Laboratory training system tracks employee training and retraining as necessary. Internal department training is also tracked.

2. Three ring binder procedures are are being updated typically every six months

3. OJT is documented and happens in the field and control room

4. Muon OJT is being integrated into the training scheme

Charge 3ii - Training (PG)3. Are the necessary credited controls, accelerator hardware, beamline controls and

monitoring systems, trained personnel, and administrative processes in place and adequate to support the commissioning and operations of the Muon Campus 13W Beam to the Diagnostic Absorber?


Comments

1. It takes an average of 1.5 years of training to go from new operator to Operator II

2. Operator II personnel are involved in training new people. This facilitates more experienced operators keeping up on procedures

3. Attention is given to assure basic consistency of training across shifts and crews.

4. Accelerator Operations has a well established system of training their operations staff and a plan for completing training for the 13W & 170W beam to the Absorber.

Charge 3ii - Training (PG)3. Are the necessary credited controls, accelerator hardware, beamline controls



Recommendations

1. Complete the training packages for Mu2e beam to the Absorber [Pre-start]2. Train the Operations staff to the use of new Mu2e components and

procedures. [Pre-start]

Charge 3iii - Ops Procedures (PG)3. Are the necessary credited controls, accelerator hardware, beamline controls and


iii. Accelerator Operations Procedures

Findings1. Emergency procedures are available at multiple locations, either via paper or

electronically2. A required reading database has been established3. Re-qualification on certain procedures takes place annually.

Charge 3iii - Ops Procedures (PG)3. Are the necessary credited controls, accelerator hardware, beamline controls and


iii. Accelerator Operations Procedures

Comment1. The LOTO training has levels of approval before employees can perform the task.

This is a commendable method to assure safe task completion2. There is a hand-off process to translate expert procedures to operational

procedures. This is accomplished using personnel matrixed between Muon and Operations

3. Use of Kirk locks to minimize human errors in LOTO seems to be working well4. Pictures of properly-LOTO’d lockboxes posted next to lockboxes useful as a visual

aid for LOTO performer as well as for everyone using the box.5. Usage of checklists in the field is a good practice.

Charge 3iii - Ops Procedures (PG)


iii. Accelerator Operations ProceduresRecommendation

1. Finish the procedures related to the beam delivery to the Mu2e diagnostic Absorber [Pre-Start]

Charge 3 iv - Rad Protection (DK)3. Are the necessary credited controls, accelerator hardware, beamline controls


iv. Radiological Protection

Findings

1. The Fermilab Radiation Protection Program is mature and effective.

2. Radiation safety and ALARA are integrated into accelerator operations and effectively support the scientific mission

3. The shielding assessment process is mature and robust.

Charge 3 iv - Rad Protection (DK)3. Are the necessary credited controls, accelerator hardware, beamline controls


iv. Radiological Protection

Comments

1. The Fermilab Radiation Protection Program has fully evaluated and addressed the proposed 13W beam to the Diagnostic Absorber.

Recommendations

1. Ensure shielding control postings that

contain trefoils meet 10CFR835 requirements

[Post-start]

Closing CommentsThanks to the Lab staff for their participation: ARRs are a overview and sampling process that evaluates the readiness of equipment, people, and processes for safe commissioning and operation.

Thanks to the presenters and interviewees for their time and efforts, without which this review would not have gone as smoothly.

The walk through events, the many discussions, and presentations to (and patience with) the review team members made for a performance-based ARR.

Closing CommentsIt can be difficult to find the right timing for an ARR - The timing for this ARR was very good.

The Lab was well prepared. This showed in the ARR Plan, the information made available in advance, and in the selection of Cindy Joe and Peter Shanahan as internal ARR Team members.

Thanks to the Review Team for taking the time out of their busy schedules to provide their perspective and input to this review.

Special Thanks (HF)• Maddie, Matt, and Jerry for facilitating this Accelerator Readiness Review

• Don Cossairt for being awesome over 42 years at Fermilab

• Marilyn & Rebecca for their tireless assistance in preparation before and during the review

Closing Comments

We are very impressed with the project progress and overall readiness. We are excited for Fermilab and glad to play a small part in the effort!

closeout briefing - accelerator readiness review of …...charge to the committee •“the...

Documents