oi/oig seminar hrtd · oi/oig seminar determining & using frequency – what are the odds? the...

26
OI/OIG Seminar RISK ASSESSMENT RISK ASSESSMENT HR T D Human Resources Training & Development 3/22/10 3/22/10 - slide slide 0 G-112 OIG/OI Reactor & Materials Overview 112 OIG/OI Reactor & Materials Overview RISK ASSESSMENT RISK ASSESSMENT

Upload: others

Post on 07-Oct-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

RISK ASSESSMENTRISK ASSESSMENT

HRTDHuman ResourcesTraining & Development

3/22/10 3/22/10 -- slide slide 00GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

RISK ASSESSMENTRISK ASSESSMENT

Page 2: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Objectives

• Understand the basics of risk application

3/22/10 3/22/10 -- slide slide 11GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

• Understand how NRC applies risk in regulating power reactors

Page 3: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

What is Risk?• Arises from a “Danger” or “Hazard”

• Always associated with undesired

3/22/10 3/22/10 -- slide slide 22GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

• Always associated with undesired occurrences

• Involves both:

• Likelihood of undesired occurrences

• Severity (magnitude) of the consequences

Page 4: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Definition of “Risk Triplet”• What can happen?

• Possible scenario

3/22/10 3/22/10 -- slide slide 33GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

• How likely is it?

• Frequency, probability

• What will be the outcome?

• Consequences

Page 5: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Basic Terminology

• Probability - Likelihood of an event occurring

• Frequency or rate - number of occurrences of some event

3/22/10 3/22/10 -- slide slide 44GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Frequency or rate number of occurrences of some event of interest in some defined interval of time

• Consequence - The ultimate result of an event or sequence of events in terms of impacts on public and employee health and safety, impacts on the environment, and costs or damage

Page 6: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Ways to Assess Risk

“Objectively”• Numerical Approaches

3/22/10 3/22/10 -- slide slide 55GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Subjectively• Expert Panels

Page 7: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Ways to Use Risk Information

Licensing• Evaluate designs for vulnerabilities• Evaluate designs for adequate safety

3/22/10 3/22/10 -- slide slide 66GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

g q y• Remove requirements that offer minimal safety

benefit

Inspection• Select inspection areas with risk (safety) significance• Properly evaluate the significance of inspection

findings• Monitor day-to-day risk management

Page 8: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Risk-Informed versus Risk-Based Regulation

• Risk-Informed – Using risk to supplement deterministic methods of regulation

3/22/10 3/22/10 -- slide slide 77GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

• Risk-Based – Basing regulatory decisions on risk numbers alone

Page 9: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Numerical Approaches

3/22/10 3/22/10 -- slide slide 88GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Numerical Approaches

Page 10: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Basic Terminology

Risk Magnitude of ConsequencesUnit of Time =[ ]

3/22/10 3/22/10 -- slide slide 99GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Frequency XScenario

Unit of Time

Consequences Magnitude Scenario

[

[

]

]

Page 11: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Consequence FrequencyAlternate Frequency

Super Bowl 1/yr. 1.14e-4/hr.

Considering Frequency…

3/22/10 3/22/10 -- slide slide 1010GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Prednisone Purchase for Boudreaux

1/mo. 12/yr.

Paydays (NRC) 1/2wks. .071/day

Saturday Morning 1/wk. 9.92e-5/min

Commute 2/day 10/wk.

Going to Bed 1/day 7/wk.

Page 12: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Determining & Using Frequency – What are the Odds?

What are the odds

3/22/10 3/22/10 -- slide slide 1111GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

odds

that a coin toss

will come

up heads?

Page 13: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Determining & Using Frequency – What are the Odds?

In reactor applications, the “Consequence” can be:

3/22/10 3/22/10 -- slide slide 1212GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

What is the “Consequence?”

“Consequence” can be:

• An initiating event

• The failure of a component

• The failure of a fission product barrier

Page 14: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Determining & Using Frequency – What are the Odds?

The math works out like this:

• Event of interest = Heads

F ½ T

3/22/10 3/22/10 -- slide slide 1313GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

What is the “Frequency?”

• Frequency = ½ per Toss

• .5 heads per toss

Carrying this out further, if you tossed the coin 30 times per hour, the frequency could be expressed as:

15 heads per hour360 heads per day131,400 heads per annum

Page 15: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Determining & Using Frequency – What are the Odds?

3/22/10 3/22/10 -- slide slide 1414GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

The Reactor Version

Frequencies of Interest

• Scrams/Yr.

• Component Failure/Start

• Component Failure/Mission

Page 16: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

The Next Level…

What are the odds of tossing heads twice in a row?

First, the “consequence” is tossing heads t ice consec ti el

3/22/10 3/22/10 -- slide slide 1515GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Multiple Events

heads twice consecutively…

Probabilities are combined by multiplying, so…

.5 heads/toss x .5 heads/toss = .25/attempt

What are the odds of tossing heads thrice in a row?

.5 x .5 x .5 = .125/attempt

Page 17: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Let’s Talk Hardware…

You’re outside Wal Mart and you decide to get a 25 cent coke. What can go wrong?

• You can drop your only quarter under the machine

• You can put your quarter in the machine and it gets stuck before being counted

3/22/10 3/22/10 -- slide slide 1616GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

• Your quarter is counted, but the machine doesn’t allow you to select a drink

• You can select a drink but the can gets stuck before coming out of the machine

• The “Make Another Selection” lights are all burned out and the coin return doesn’t work

Can we calculate the odds of getting a coke?

What information do we need?

Page 18: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG SeminarFrom your extensive and frustrating previous attempts at getting drinks at Wal-Mart, you compile the following consequences and frequencies:

Consequence Frequency of Occurrence Frequency of Success

Dropped/Lost Quarter 1 in 20 Attempts (.05/Attempt) 19 in 20 (.95/Attempt)

3/22/10 3/22/10 -- slide slide 1717GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Stuck Quarter 1 in 15 Attempts (.067/Attempt) 14 in 15 (.93/Attempt)

Quarter Counted/No Delivery 1 in 100 Attempts (.01/Attempt) 99 in 100 (.99/Attempt)

Stuck Coke 1 in 50 Attempts (.02/Attempt) 49 in 50 (.98/Attempt)

No Coke/No Coin Return 1 in 3 Attempts (.33/Attempts) 2 in 3 (.66/Attempt)

Now, how many different ways can things go wrong?

Page 19: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG SeminarRepresenting the case graphically…

I Want a CokeDropped/Lost

QuarterStuck Quarter

Quarter Counted/No

DeliveryStuck Coke

No Coke/No Coin Return

Outcome

3/22/10 3/22/10 -- slide slide 1818GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Succ

ess

Fai

lure

Page 20: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG SeminarConverting Graphics to Numbers…

I Want a CokeDropped/Lost

QuarterStuck Quarter

Quarter Counted/No

DeliveryStuck Coke

No Coke/No Coin Return

Frequency

99/

.98/attempt

.67/attempt

3/22/10 3/22/10 -- slide slide 1919GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Succ

ess

Fai

lure

.05/attempt

.95/attempt

.93/attempt

.067/attempt

.99/attempt

.01/attempt

.02/attempt

.33/attempt

Page 21: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG SeminarSame Approach for a Reactor Plant

Loss of Offsite Power

Reactor TripMain

Feedwater?Heat Sink?

Pressure Control?

Volume Control?

End State

Stable RCS

3/22/10 3/22/10 -- slide slide 2020GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Succ

ess

Fai

lure

Level Prob.

Press Prob.Temp Control

Temp Control

ATWS

Page 22: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Event FrequenciesLevel 1

Types of Risk Assessments

3/22/10 3/22/10 -- slide slide 2121GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Event Progression, Barrier Response

Release of Radioactive Material

Consequences

Level 2

Level 3

Page 23: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Numerical Methods Share Commonalities• Identify Possible Scenarios• Estimate the Likelihood of Occurrence• Estimate Consequences

3/22/10 3/22/10 -- slide slide 2222GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Differences in Methods Exist• Scope

• CDF as Surrogate for Consequences• Individual Plant Examination vs. Individual Plant

Examination for External Events• Complexity• Calculational Methodology

Page 24: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Advantages of PRA• Rigorous, Systematic Tool• Information Integration (multidisciplinary)• Considers Complex Interactions• Develops Qualitative Design Insights

3/22/10 3/22/10 -- slide slide 2323GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

p Q g g• Quantitative Decision-Making Possible• Uncertainty Analysis Possible

Limitations of PRA• Adequacy of Data• Sensitivity to Analytic Assumptions• Frequently not Comparable Site to Site• Not “Living Documents”

Page 25: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

Seminal Moments in the History of Risk Assessment in Nuclear Power

PRA Policy Statement (ca. 1995)• Held that probabilistic approaches enhanced traditional deterministic approaches• Probabilistic approaches seen as improving decision-making• Offered the possibility of reduced regulatory burden

3/22/10 3/22/10 -- slide slide 2424GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Risk-Informed and Performance-Based White Paper (ca. 1998)• Held risk-informed approach as preferred• Maintained value of defense-in-depth• Espoused performance-based approaches to regulation where possible

Risk-Informed Regulation Regulatory Guides and Standard Review Plans• Issued to allow PRA use for specific applications

Maintenance Rule (1999)• First regulation to require licensees to manage risk at plants

Page 26: OI/OIG Seminar HRTD · OI/OIG Seminar Determining & Using Frequency – What are the Odds? The math works out like this: • Event of interest = Heads F½T GG--112 OIG/OI Reactor

OI/OIG Seminar

3/22/10 3/22/10 -- slide slide 2525GG--112 OIG/OI Reactor & Materials Overview112 OIG/OI Reactor & Materials Overview

Questions?