november 3-5, 2015, federal technical capability program ... · •instructional goal 1.0 present...

Oversight Curriculum National Training Center

FTCP

DRAFT DOE TrainingCurriculum

DOE-100DE Federal Staff

Orientation Training

DOE-120DOE Oversight and

Implementation

DOE-140Developing Integrated Oversight

Plans(Managers/Supervisors)

PHY-128DEBasic Survey

Overview

PHY-130Basic Survey

VAP-335Fundamentals of

Performance Testing

DOE-200DEAssessment

Fundamentals

DOE-210Assessment Preparation

DOE-220Assessment Techniques

DOE-130Performance Management Fundamentals

DOE-310Oversight Data

Analysis & Reporting

DOE-320Causal Analysis & Corrective Action

Safety TrackSafeguards and Security Track

3 Day IL

2 Day IL

3 Day IL

eLearning

5 Day IL

4 Day IL2 Day IL

In-Progress

eLearningIn-Progress

2 Day IL

2 Day IL

2 Day ILIn-Progress

DOE-110DEDOE Oversight Fundamentals

eLearning (Future)

eLearning

Managers/Supervisors/

Position Specific

EM Requirements

elearning

EM Plan Development

Process IL

PAAAeLearning

NTSeLearning

DOE O 227eLearning

Conducting & Reporting O/S

ActivitieseLearning

Example of Functional Area Specific Training

Emergency Management

EnforcementIndependent

Oversight

STS-100DEeLearning

STS-2003 Day IL

SBA-100DEeLearning

SBA-2003 Day IL

Senior Technical

Safety Manager

Nuclear Safety Specialist

Example of Functional Area Specific Training

ISC-121DEeLearning

ISC-2213 Day IL

PER-099DEeLearning

PER-1013 Day IL

Information Security

Personnel Security

PHY-121DEeLearning

PHY-1205 Day IL

VAP-1405 Day IL

VAP-3168 Day IL

Physical Security

Vulnerability Assessment

Oversight Curriculum

Develop Performance Measures & Targets

Determine Level & Mix of Oversight

Conduct Oversight Activities

Analyze Data & measure

performance

Feedback & Improve

Conduct Federal Self-Assessments

Contractor implements self-assessment

program and Contractor Assurance System

Determine Issues and Corrective

Action Management

DOE-110DE and DOE-120

DOE-130 DOE-140DOE-310

DOE-320

DOE-200DE; DOE-210; DOE-220

Virtual Facility

FTCP

Course Interrelationship

• 4 or 5 Master Scenario Event Lists (MSELs) will be developed

• Each MSEL package will contain the documentation, scripts, and data sets to allow students to identify, analyze and correct issues.

• MSELs will connect the courses• Issues identification in DOE-220 and DOE-310

• Issue analysis in DOE-310

• Issue correction in DOE-320

FTCP

DOE-110DEOversight

Fundamentals

FTCP

Oversight Fundamentals

• Instructional Goal1.0 Present the fundamental concept of Department of Energy safety

oversight. Prepare students for future oversight courses such as DOE-120, DOE Oversight and Implementation and DOE-220, Assessment Techniques.

• Instructional Objectives

1. Name and characterize the documents that guide DOE oversight.

2. Explain the basic requirements of oversight.

3. Describe a DOE oversight program at a high level.

4. Explain a CAS.

5. Explain a simplified DOE oversight process.

FTCP

DOE-120Oversight and

Implementation

FTCP

Oversight Process Map

FTCP

Lesson 1: Determine Scope of Oversight

• Instructional Goal

1.0 Students will develop list of oversight requirements.


1.1 Define oversight activities.

1.2 Describe where baseline oversight requirements are found.

1.3 Define supplemental oversight activities.

1.4 Prepare a list of oversight requirements.

FTCP

Lesson 2: Performance Measurements and Targets


2.0 Students will describe the process to develop performance objectives, measures, and expectations.


2.1 Discuss the attributes for developing performance expectations.

2.2 Describe the purpose and scope of performance objectives, measures, and expectations.

2.3 Describe the process used to develop performance measurements.

FTCP

Lesson 3: Program Performance and CAS Confidence


3.0 Students will describe the process used to determine program performance and Contractor Assurance System (CAS) confidence.


3.1 Define program performance.

3.2 Define CAS confidence.

3.3 Describe the process used to determine program performance and CAS confidence.

FTCP

Lesson 4: Level and Mix of Oversight Activities


4.0 Students will describe the process used to determine the level and mix of oversight activities used in the Integrated Oversight Plan (IOP).


4.1 Describe the activities used to conduct oversight.

4.2 Describe the process used to determine the level and mix of oversight activities.

FTCP

Lesson 5: Integrated Oversight Plan• Instructional Goal

5.0 Students will develop an integrated oversight plan (IOP).


5.1 Describe the objectives, mechanisms, and plans used for Field element nuclear facility oversight.

5.2 Describe the purpose and scope of an IOP.

5.3 Describe the process used to develop an IOP.

5.4 Use the process to develop an IOP.

FTCP

Lesson 6: Oversight Activities—Assessments


6.0 Students will describe the process to conduct assessments.

Instructional Objectives

6.1 State the purpose of conducting assessments.

6.2 Describe the scope of conducting assessments.

6.3 Describe the process used to conduct assessments.

FTCP

Lesson 7: Oversight Activities—Operational Awareness Activities • Instructional Goal

7.0 Students will conduct an operational awareness activity.


7.1 State the purpose of operational awareness activities.

7.2 Describe the scope of operational awareness activities.

7.3 Describe the process used to conduct operational awareness activities.

7.4 Use the process to conduct an operational awareness activity.

FTCP

Lesson 8: Analyze Data


8.0 Students will describe the process used to analyze oversight data.


8.1 State the purpose of data analysis and trending.

8.2 Describe the scope of data analysis and trending.

8.3 Describe the process used to analyze and trend data.

8.4 Describe the purpose of issue identification.

8.5 Describe the scope of issue identification.

8.6 Describe the process used to identify and communicate issues.

8.7 Use the process to identify and communicate issues.

FTCP

Lesson 9: Feedback and Improvement


9.0 Students will describe the processes used to provide feedback and improvement based on oversight activities.


9.1 State the purpose and scope of lessons learned.

9.2 Describe the process used to identify, develop, and disseminate lessons learned.

9.3 Use the process to identify, develop, and discuss the dissemination of lessons learned.

9.4 Describe the purpose of evaluating contractor performance.

9.5 Describe the scope of evaluating contractor performance.

FTCP

Lesson 9: Feedback and Improvement Cont.


9.6 Describe the process used to evaluate contractor performance.

9.7 Describe the purpose of system maintenance and control.

9.8 Describe the scope of system maintenance and control.

9.9 Describe the process used for system maintenance and control.

FTCP

Lesson 10: Self-Assessment Process


10.0. Students will describe the key elements of a self-assessment process.


10.1 Describe the key elements of a self-assessment process.

10.2 State the purpose and scope of an issues management system.

10.3 Describe a corrective action process.

10.4 Review the purpose and scope of oversight.

10.5 Review the process used to conduct oversight.

FTCP

Determine Level & Mix of Oversight Activities

DOE-130 Fundamentals of

Performance Management

FTCP

Performance Measurement Development Process

Lesson 1: Overview of Performance Measurement Systems


1.0 Describe the basic components of a performance measurement system.


1.1 Describe in general terms, the various components (or actions) of any performance measurement system.

1.2 Describe the goal of performance measurement.

FTCP

Lesson 2: Understanding Performance


2.0 Discuss the drivers that affect performance


2.1 Define and describe the concepts of performance, variability, trend and limit.

2.2 Describe the beneficial role of innovation in performance improvement and how it affects the plot of a performance curve.

2.3 Describe some practical implications for improving performance.

FTCP

Lesson 3: Developing a Performance Measurement System • Instructional Goal

3.0 Given an area of interest, develop an initial performance measurement system that meets the criteria contained in the lesson material.

• Instructional Objectives3.1 Describe the process used to create a performance measurement system.

3.2 Describe and illustrate the basic types of performance measures.

3.3 Describe and develop a group of (key) performance measures.

3.4 Describe and develop a performance measurement hierarchy.

FTCP

Lesson 3: Developing a Performance Measurement System Cont.• Instructional Objectives

3.5 Develop relevant units of measures for a given performance measurement.

3.6 Develop a rudimentary performance measurement collection and distribution system.

3.7 Develop a basic performance measurement display system.

FTCP

Lesson 4: Cautions and Limitations


4.0 Describe the cautions and limitations involved with performance management systems


4.1 Describe the limitations and potential dangers of predictive and trending measures.

4.2 Describe how performance measures may drive unwanted behaviors.

4.3 Describe the roadblocks to implementing a performance management system.

FTCP

Lesson 4: Cautions and LimitationsCont.


4.4 Discuss the limitations of using data results to drive performance improvements.

4.5 Discuss some of the major pitfalls of measurement systems.

FTCP

Lesson 5: Course Summary


5.0 Describe the basic concept and steps associated with a performance management system.

• Instructional Objective

5.1 Describe the basic concept and steps associated with a performance management system.

FTCP

SPO Development Exercise

• Develop a concise and effective strategic performance objective for one identified ‘x’ factor. Should include:

• Action verb(s)

• Subject matter(s)

• Performance goal(s)–expressed either quantitatively or qualitatively

FTCP

DOE-200DEAssessment

Fundamentals

FTCP

Lesson 1: Introduction to DOE/NNSA Assessment• Instructional Goal

1.0 Identify where assessments fit in the DOE ISMS Program and describe the fundamental elements of an assessment, with 80% accuracy.


1.1 Review what is involved in oversight (DOE-110DE, Oversight Fundamentals)

1.2 Identify how the Integrated Safety Management (ISM) Core Functions relate to assessments.

1.3 Identify the purpose of assessments.

1.4 Identify assessment categories and assessment approaches.

1.5 Identify the techniques involved in a typical assessment process.

FTCP

Lesson 2: Planning


2.0 Identify the planning associated with preparing an assessment, with 80% accuracy.


2.1 Outline the process for planning an assessment.

2.2 Identify the components of the Criteria and Review Approach Documents (CRADs).

2.3 Identify the planning steps of developing an assessment.

FTCP

Lesson 3: Data Collection


3.0 Identify the methods while conducting data collection with 80% accuracy.


3.1 Outline the process for collecting data.

3.2 Identify the requirements for performing a document review.

3.3 Identify the requirements for conducting an interview.

3.4 Identify the requirements for direct observation.

FTCP

Lesson 4: Analysis


4.0 Identify the phrases of analyzing assessment data while forming conclusions with 80% accuracy.


4.1 Outline the three steps for reviewing and analyzing data.

4.2 Reorganize assessment data into the analysis steps.

4.3 Identify the levels of information significance.

FTCP

Lesson 5: Reporting


5.0 Identify the reporting results of an evaluation process with 80% accuracy.


5.1 Outline the final step in the typical assessment process.

5.2 Identify Report Results based on the Problem, Reason, and Example (PRE) method.

5.3 Review briefings and reports.

FTCP

DOE-210Assessment Preparation

FTCP

Lesson 1: Assessment Plans


1.0 Given an assigned safety management functional area, prepare to develop and assessment plan that meets the expectations presented in this lesson.


1.1 Discuss the purpose of an assessment plan.

1.2 Describe the elements of an assessment plan.

FTCP

Lesson 2: Use of Existing CRADS


2.0 Using existing safety management functional area CRADS, discuss the use of the information from those existing CRADs in the development of the CRADs for the assessment.


2.1 Review existing safety management functional area CRADS.

2.2 Determine information from those CRADS which could be applicable to the assessment.

FTCP

Lesson 3: CRADS: Performance Objectives


3.0 Given an assigned safety management functional area, a defined assessment scope, and existing CRADS, develop performance objectives that meet the SMART criteria.


3.1 Define performance objectives.

3.2 Describe the purpose of performance objectives.

3.3 Explain the relationship between performance objectives and safety management functional area requirements.

3.4 Discuss the SMART criteria as it applies to performance objectives.

FTCP

Lesson 3: CRADS: Performance ObjectivesCont.


3.5 Develop performance objectives

3.6 Determine if developed performance objectives comply with the

SMART criteria.

FTCP

Lesson 4: CRADS: Criteria• Instructional Goal

4.0 Given the performance objectives developed in lesson 3 and existing CRADs, develop criteria that support the objectives and meet the SMART criteria.


4.1 Describe the purpose of performance objective supporting criteria.

4.2 Explain the relationship between performance objective supporting criteria and safety management functional area requirements.

4.3 Discuss how to develop performance objective criteria.

4.4 Develop criteria for each performance objective development in

lesson 3.

FTCP

Lesson 5: CRADS: Lines of Inquiry


5.0 Given the performance objective criteria development in lesson 4, develop lines of inquiry for each criteria.


5.1 Define lines of inquiry.

5.2 Describe the purpose of lines of inquiry.

5.3 Discuss how to create lines of inquiry.

5.4 Develop lines of inquiry for the criteria development in lesson 4.

FTCP

Lesson 6: CRADS: Approach


6.0 Using the safety management functional are performance objectives and criteria developed in lesson 3 and 4, develop the approach needed to assess if the criteria and objective are met.


6.1 Define the approach to record reviews.

6.2 Define the approach to personnel interviews.

6.3 Define the approach to performance observations.

6.4 Develop the approach to assess the performance objectives and criteria development in lesson 3 and 4.

FTCP

Lesson 7: Final Assessment Plan


7.0 Given an assigned safety management functional area and the CRADs developed in lessons 3, 4 and 6, develop an assessment plan that meets the expectations presented in lesson 1.


7.1 Review the purpose of an assessment plan

7.2 Review the elements of an assessment plan

7.3 Develop an assessment plan.

DOE-220Assessment Techniques

Lesson 1: Assessment Process


1.0 The students will understand the fundamentals elements of an assessment and basic skills required to be an assessor.


1.1 Describe assessment purposes.

1.2 Describe assessment elements.

1.3 Describe the three techniques used in conducting an assessment.

1.4 Identify assessor qualification and good characteristics.

FTCP

Lesson 2: Criteria Review and Approach Document


2.0 The students will understand how to develop a CRAD.


2.1 Define the purpose of the CRAD.

2.2 Identify elements of a CRAD.

2.3 Prepare a CRAD.

FTCP

Lesson 3: Document Review


3.0 The students will understand how to perform a document review and record the results.


3.1 Describe types of documents essential to assessments.

3.2 Describe the document review process.

3.3 Perform and record a document review.

FTCP

Lesson 4: Interviewing


4.0 The students will understand how to conduct an assessment interview.


4.1 Identify the fundamentals of good interviewing.

4.2 Conduct and evaluate an interview.

FTCP

Lesson 5: Observations


5.0 The students will understand how to conduct an observation and correctly identify strengths and issues.


5.1 Explain the purpose of observations.

5.2 Describe the fundamentals of good observations.

5.3 Perform an observation.

FTCP

Lesson 6: Analyzing and Categorizing Data


6.0 The students will understand how to analyze and categorize data collected during the previous activities.


6.1 Define management concerns, findings, weaknesses, opportunities for improvement, and strengths.

6.2 Describe high, medium, and low significance.

6.3 Describe the process used to document findings and management concerns.

FTCP

Lesson 7: Reporting Results


7.0 The students will understand how to use a report format and a presentation format for communicating assessment results.


7.1 Discuss assessment report requirements.

7.2 Explain the different assessment reporting strategies.

7.3 Discuss different methods that can be used to avoid challenges.

7.4 Conduct an assessment results briefing.

FTCP

PHY-128DEBasic Survey

Overview

FTCP

FTCP

Lesson 1: Program Overview

Instructional Goal

1.0 The students will understand the purpose and essential elements of overview activities.


1.1 Identify the Purpose of Department of Energy (DOE) Oversight.1.2 Identify the difference between a self assessment and survey.

1.3 Explain the difference between internal and external assessments.

1.4 Describe the types of surveys.

FTCP

Lesson 2: Planning for the Survey

Instructional Goal

2.0 The students will understand essential elements when planning the survey.


2.1 Identify the survey team members.

2.2 Identify the purpose of data collection activities and methods.

2.3 Describe the document review process.

2.4 Describe a performance/compliance test.

FTCP

Lesson 3: Conducting the Survey

Instructional Goal

3.0 The students will understand survey etiquette, corrective actions, data validation, and findings.


3.1 Apply survey etiquette.

3.2 Define a finding.

3.3 Describe validating data.

3.4 Summarize the role of identifying corrective actions.

FTCP

Lesson 4: Reporting the Results

Instructional Goal

4.0 The students will understand what takes place after the survey and administrative requirements.


4.1 Explain how ratings are determined.

4.2 Identify the different types of ratings.

4.3 Explain the executive summary.

4.4 Identify the final report content.

4.5 Describe the function of the Safeguards and Security Information Management System (SSIMS).

PHY-130Basic Survey

FTCP

FTCP

Lesson 1: Survey Fundamentals

Instructional Goal

1.0 Students will understand the fundamentals of surveys and self-assessments.


1.1 Identify the purpose and requirements of DOE surveys and self-assessments.

1.2 List and describe the roles and responsibilities of the team.

1.3 List and define the types of surveys.

FTCP

Lesson 2: Survey Planning

Instructional Goal2.0 Students will understand the survey planning process.

Terminal Performance Objective Given the Uranium Reprocessing Facility Safeguards and Security Plan and the Survey Planning Exercise supporting documents, students will plan the survey in accordance with DOE and National policy.

Enabling Objectives

2.1 Determine the survey scope.

2.2 Develop line of inquiry.

2.3 Determine data call documents.

2.4 Select survey methodologies.

2.5 Develop a survey schedule.

*Exercise - Planning the Survey

FTCPLesson 3: Conducting the Survey and

Reporting ResultsInstructional Goal

3.0 Students will understand the process for conducting a survey and reporting the results.

Terminal Performance ObjectiveUsing the survey plan from the Planning Exercise, students will conduct a survey at the Uranium Reprocessing Facility then report the results in accordance with the criteria identified in DOE and National policy.

Enabling Objectives

3.1 Conduct briefings.

3.2 Collect survey data.

3.3 Analyze gathered data.

3.4 Assign survey ratings.

*Exercise – Conducting the Survey and Reporting Results

FTCPLesson 4: Report Preparation and Post-Survey

ActivitiesInstructional Goal

3.0 Students will understand the report preparation process and post-survey activities.

Terminal Performance ObjectiveUsing information collected during the conducting the survey and reporting survey results exercise at the Uranium Reprocessing Facility, students will prepare and deliver an exit brief and identify post survey activities in accordance with DOE and National policy.

Enabling Objectives4.1 Prepare and deliver the exit brief.

4.2 Prepare the survey final report.

4.3 Identify requirements and responsibilities regarding an effective Corrective Action Plan.

*Explain the benefits of Tracking, Trending, and communicating Lessons Learned.

*Exercise - Preparing and Presenting the Exit Brief

VAP-335Fundamentals of

Performance Testing

FTCP

FTCP

Lesson 1: Introduction to Performance Testing Policy

Instructional Goal

1.0 The student will understand the application of the Department of Energy (DOE) performance testing policy.


1.1 Define key terms.

1.2 Identify DOE directives pertaining to performance testing.

1.3 Define requirements for recoding, tracking, and trending performance testing results.

1.4 Explain the role of the performance test committee.

FTCP

Lesson 2: Performance Assurance Program

Instructional Goal2.0 The student will understand the vulnerability assessment (VA) and

performance testing implications of the Department of Energy (DOE) performance assurance requirements.

Terminal Performance ObjectiveStudents will use information presented in this lesson to develop a performance test requirements document.

Enabling Objectives2.1 Identify key requirements of the DOE Performance Assurance Program

(PAP).

2.2 Describe methods for defining “essential elements.”

*Activity - Essential Elements

FTCP

Lesson 3: Performance Test Planning

Instructional Goal3.0 The student will understand the development of the components of a

performance test requirements document.

Terminal Performance ObjectivesStudents will use information presented in this lesson to develop a performance test requirements document.

Enabling Objectives3.1 Identify the sequence of the performance test (PT) planning process.

3.2 Describe the exercise planning phase, to include roles and responsibilities.

3.3 Describe the key components of a test requirements document.

*Activity - Write a PT Document

*Activity - Acceptance Test Requirements Document 20130716

FTCP

Lesson 4: Performance Test Plan

Instructional Goal

4.0 The student will understand the components of a test plan.

Terminal Performance ObjectiveStudents will use information presented in this lesson to develop a draft performance test plan.

Enabling Objectives

4.1 Identify the purpose of the test plan.

4.2 Describe the test plan development phase, to include types of administrative controls.

*Activity - Data Collection Form

FTCP

Lesson 5: Conduct of Test and Post-Exercise/ Test Activities

Instructional Goal

5.0 The student will understand how to obtain and utilize post-test data.


5.1 Describe the exercise execution phase.

5.2 Identify the key topics to be covered in a post-exercise/test AAR.

5.3 Identify the data to be extracted from test evaluation forms.

5.4 Describe specific information to be obtained from the post-exercise/test AAR.

5.5 Define the type of information necessary for a post-exercise/test report.

5.6 Describe the importance of lessons-learned information.

FTCP

Lesson 6: Integration of Testing Results into the VA/SRM

Instructional Goal6.0 The student will understand the process for integrating performance test

data into the vulnerability assessment (VA).

Terminal Performance ObjectiveStudents will use information presented in this lesson to estimate probabilities for performance testing data using various Excel formulas/spreadsheets.

Enabling Objectives6.1 Determine which performance test data are used to estimate probability of detection.

6.2 Determine which performance test data are used to estimate delay and traversal time.

6.3 Determine which performance test data are used to estimate response force time.

6.4 Describe how detection, delay, and response force time performance-test data impact probability of interruption.

6.5 Describe how force-on-force exercise data are used to estimate probability of neutralization.

FTCP

Lesson 7: Scenario Development

Instructional Goal7.0 The student will understand the relationship between the review, development,

and validation of an adversary scenario that employs effective and realistic adversary tactics, techniques, and procedures (TTPs) to the performance testing process.

Terminal Performance ObjectiveStudents will use information presented in this lesson to review, develop, and validate a fictional adversary scenario that employs effective and realistic adversary tactics, techniques, and procedures.

Enabling Objectives7.1 Identify the characteristics of an effective scenario.

7.2 Describe an effective opposing force (OPFOR).

7.3 Describe the principles of effective OPFOR tactics.

FTCP

Lesson 8: Performance Testing: What an Inspector Looks For

Instructional Goal

8.0 The student will understand how the Department of Energy (DOE) inspection process applies to performance testing (PT).


8.1 Identify key areas that will be inspected.

8.2 Identify what an inspector will require a facility to produce to document why the facility did or did not take credit for system effectiveness.

8.3 Describe how an inspection of the performance testing process can assist a facility in the vulnerability assessment (VA) process.

DOE-310Oversight Data

Analysis and Reporting

FTCP

Lesson 1: Introduction to Data Analysis


1.0 Discuss the purpose and scope of data analysis.


1.1 Discuss the purpose for data analysis.

1.2 Describe what's included in the analysis process.

1.3 Discuss the scope and timing data analysis.

1.4 Discuss the use of graphs in data analysis.

FTCP

Lesson 2: Examining Data Sets


2.0 Given a data set, students will examine the data set and reach conclusions on what can and can't be learned.


2.1 Define a data set.

2.2 Determine what can and can't be learned from a data set.

2.3 Given a data set, examine the data set and reach conclusions on what can and can't be learned.

FTCP

Lesson 3: Plotting Distributions and Identification of Limits, Variability, and Mode • Instructional Goal

3.0 Given a data set, students will plot distributions and identify limits, variability, and modes.


3.1 Discuss plotting distribution graphs.

3.2 Identify limits, variability, and mode.

3.3 Given a data set, students will plot distributions and identify limits, variability, and modes.

FTCP

Lesson 4: Qualitative Data Analysis


4.0 Using appropriate qualitative data analysis techniques, analyze a provided data set and reach appropriate conclusions.


4.1 Describe the purpose and use of qualitative data analysis.

4.2 Describe the concept of designing and managing data sets used in qualitative data analysis.

4.3 Explain how coding, jottings, and memoing are used to condense data.

4.4 Describe the different types of coding methodologies used in data condensation.

4.5 Describe the purpose and scope of displaying data in qualitative data analysis.

FTCP

Lesson 4: Qualitative Data Analysis


4.6 Describe different matrices and network data displays used to explore, order and explain qualitative data analysis results.

4.7 Describe the tactics used to generate meaning from qualitative data sets.

4.8 Describe the tactics used to test or confirm findings.

4.9 Describe the standards used to confirm the quality of conclusions.

4.10 Using appropriate qualitative data analysis techniques, analyze a provided data set and reach appropriate conclusions.

FTCP

Lesson 5: Check Sheets


5.0 Students will create and interpret a check sheet.


5.1 Describe the purpose and use of check sheets.

5.2 Describe the process to create check sheets.

5.3 Create and interpret a check sheet.

FTCP

Lesson 6: Comparison Charts


6.0 Given a data set, students will plot and interpret a comparison chart.


6.1 Define and describe the use of standard deviations.

6.2 Describe the purpose and use of a comparison chart.

6.3 Given a data set, plot and interpret a comparison chart.

FTCP

Lesson 7: Pareto Charts


7.0 Students will create and interpret a pareto chart.


7.1 Describe the purpose and use of Pareto charts.

7.2 Describe the process to create a Pareto chart.

7.3 Create and interpret a Pareto chart.

FTCP

Lesson 8: Correlation Charts


8.0 Students will create and interpret a correlation chart.


8.1 Describe the purpose and use of correlation charts.

8.2 Describe the process to create correlation charts.

8.3 Create and interpret a correlation chart.

FTCP

Lesson 9: Control Charts


9.0 Students will create and interpret a control chart.


9.1 Describe the purpose and use of control charts.

9.2 Describe the process to create a control chart.

9.3 Create and interpret a control chart.

FTCP

Lesson 10: Reporting


10.0. Using data analysis techniques, describe the basis for and significance of identified adverse performance issues.


10.1 Describe the purpose and scope of an issue statement.

10.2 Explain the advantage of using the PRE/PREP method in developing an issue statement.

10.3 Using the result of previous data analysis, determine if a systemic issue is present, and develop an appropriate issue statement.

10.4 Describe how to communicate an issue to contractor and Federal senior managers.

FTCP

Data Analysis Exercise

FTCP

DOE-320 Casual Analysis and Corrective Action

FTCP

Lesson 1: Fundamentals of Issue Management


1.0 Describe the basic elements of a Department of Energy (DOE) issues management system.


1.1 Explain the requirements of a DOE issues management system.

1.2 Describe the purpose and scope of an issues management system.

1.3 Describe the required elements of an issues management system.

FTCP

Lesson 2: Categorizing Issues


2.0 Based on risk and priority, categorize given issues and determine their significance.


2.1 Define issue.

2.2 Describe the two primary sources of issues.

2.3 Define and describe the concepts of risk and priority.

2.4 Describe the concept of a risk matrix.

2.5 Describe the concept of a priority matrix.

FTCP

Lesson 2: Categorizing IssuesCont.


2.6 Define and describe the concepts of determining the extent and scope of issues.

2.7 Given blank risk and priority matrices, develop categorization criteria for each factor.

2.8 Using the developed risk and priority matrices, categorize provided issues and determine their significance.

FTCP

Lesson 3: Casual Analysis


3.0 Using an identified causal analysis technique, perform a causal analysis to determine the root and contributing causes of an issue.

• Instructional Objectives3.1 Define the following terms: root cause, apparent cause, direct cause,

contributing cause, common cause, and causal factor.

3.2 Discuss the attributes and appropriate application for each of the following causal analysis methodologies: change management analysis, barrier analysis, event and causal factor analysis, management oversight and risk trees (MORT) and cause and effect analysis.

FTCP

Lesson 3: Casual AnalysisCont.


3.3 Discuss the attributes and appropriate application of the 5 WHYS analysis technique.

3.4 Given a high significance issue, determine the best causal analysis technique or combination of techniques to use.

3.4 Using the identified technique, perform a causal analysis to determine the root and contributing causes of the provided issue.

FTCP

Lesson 4: Developing Corrective Actions• Instructional Goal

4.0 Given direct and contributing causes of an issue, develop a corrective action plan that includes appropriate corrective actions and the criteria used to determine their effectiveness.


4.1 Define corrective action and three different types of corrective actions.

4.2 Explain the corrective action process.

4.3 Discuss the considerations used in developing corrective actions.

4.4 Describe the purpose and scope of corrective action plans (CAP).

4.5 Discuss the contents of a CAP.

FTCP

Lesson 4: Developing Corrective ActionsCont.• Instructional Objectives

4.6 Discuss the process used to develop criteria to determine the effectiveness of corrective actions.

4.7 Given direct and contributing causes of an issue, develop a corrective action plan that includes appropriate corrective actions and the criteria used to determine their effectiveness.

FTCP

Lesson 5: Validate Effectiveness of Corrective Actions• Instructional Goal

5.0 Given effectiveness criteria from Lesson 4, identify appropriate effectiveness review activities for each criterion.


5.1 Describe the corrective action effectiveness review process.

5.2 Discuss the purpose and scope of a corrective action effectiveness review plan.

5.3 Describe the considerations for determining corrective action effectiveness review participants.

FTCP

Lesson 5: Validate Effectiveness of Corrective ActionsCont.


5.4 Describe the different types of review activities, including the advantages and limitations of each.

5.5 Discuss the considerations used when reporting the results of a corrective action effectiveness review.

5.6 Given effectiveness criteria from Lesson 4, identify appropriate effectiveness review activities for each criterion.

FTCP