caddis - risk-based prioritization and diagnosing the risk drivers

52
1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team

Upload: pete

Post on 12-Jan-2016

31 views

Category:

Documents


1 download

DESCRIPTION

CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers. Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team. Cumulative Risks. Cumulative Causes. Assessments of Cumulative Causes, CADDIS, and a Case. Given this effect, what is the probable cause?. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

1

CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers

Susan Cormier, Ph.D. NCEA-Cincinnatiand the whole CADDIS team

Page 2: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

2

Assessments of Cumulative Causes, CADDIS,

and a Case

Cumulative Causes

Cumulative Risks

Page 3: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

3Given this cause, what is the probable effect?

Risk Given C what will E be?– Given what we know of the mixture or the

individual components of the mixture, what are the probabilities and types of effects that may occur?

Given this effect, what is the probable cause?

Cause Given E what was C?– Given what we know of the effects, what is

the likely exposure scenario or combination of exposures that caused these effects?

Page 4: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

4

Cumulative Causes

Cumulative Risks

Different Questions Different Analyses

Different Logic

Page 5: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

5

Cumulative Risks

Cumulative Causes

Different Kinds of Assessments

Different Questions Different Analyses

Different Logic

Page 6: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

6

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 7: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

7

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Problem Detection

Page 8: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

8

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Problem Resolution

Page 9: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

9

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

En

viro

nm

enta

l E

pid

emio

log

y

Analysis from Effect to Cause

Page 10: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

10

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

Page 11: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

11

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

En

viro

nm

enta

l E

pid

emio

log

y

Problem Resolution

Problem Detection

Analysis from Effect to Cause

Page 12: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

12

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Risk

Outcome Assessment

Environmental Management

Problem Resolution

Problem Resolution

Criteria Setting, Risk Assessment

Page 13: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

13

Condition Assessment

Biological

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive AssessmentOutcome Assessment

Environmental Management

Problem Resolution

Problem Resolution

Meet Aquatic Life Standards

Page 14: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

14

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Management

Risk

Outcome Assessment

Environmental Management

Problem Resolution

SourceCause

Outcome

Endangered Species

Problem Resolution

Page 15: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

15

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Management

Risk

Outcome Assessment

Environmental Management

Problem Resolution

Outcome

Hurricane Approaching

Problem Resolution

Page 16: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

16

CADDIS: EPA Website for Ecological Causal Assessment

Condition Assessment

Outcome Assessment

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

En

viro

nm

enta

l E

pid

emio

log

y

Problem Resolution

Problem Detection

Analysis from Effect to Cause

Causal Assessments

Predictive Assessments

Page 17: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

17

Ecoepidemiological assessments reflect cumulative causes and effects

CADDIS is a guide to causal inference for specific cases

larvae adult

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

www.epa.gov/caddis

Page 18: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

18

Home Page

Page 19: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

19

Page 20: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

20

Step-by Step Guide Introduction

Page 21: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

21

Candidate CausesAlso useful for

Risk Assessment

Page 22: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

22

Analyzing DataAlso useful for

Risk Assessment

Page 23: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

23

Conceptual Models Also useful for

Risk Assessment

Databases

Page 24: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

24

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 25: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

25

Stream Organisms

Degraded Stream

Organisms

mayfly caddisflystonefly

blackfly

pouch snail

chironomid

Page 26: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

26

Page 27: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

27

Case Study - Willimantic River, CT

#

Clean Water Act305b report to Congress

TMDLs target Cu, Pb, Zn

POTW

Page 28: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

28

Roaring Brook, Willimantic River Watershed

Page 29: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

29

Below POTW

Willimantic River

Above POTW

Page 30: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

30

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Moderately impaired

Define the Biological Impairment

First appearance of downstream impairment

Compared to further upstream

Not impaired

Impaired

Page 31: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

31

Willimantic River Study Area

• Area of concern

• Upstream impairment identified

POTW

#

MR1 MR3

Page 32: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

32

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 33: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

33

• Specific Causation– Causal: Did smoking cause my cancer– Risk: Will my smoking cause cancer

• General Causation– Causal: Does smoking cause cancer– Risk: Can smoking cause cancer

Types of Causation

Page 34: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

34

• General Causation– Does C cause E– Can C cause E

• Specific Causation– Did C cause E– Will C cause E

Types of Causation

Evidence from the Case

Evidence from

the Elsewhere

Sources of Data for Evidence

Page 35: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

35

Develop and Evaluate Evidence

• Refutation

• Diagnosis

• Weight of evidence

Page 36: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

36Percent Fines

Pro

babi

lity

of

Obs

ervi

ng <

9 E

PT

Tax

a

0 20 40 60 80 100

0.0

0.2

0.4

0.6

0.8

1.0

Exposure Characterization

Cause/Effect Model

Logistic Regression MAIA Probability of <9 EPT for %fines

Risk of effect

Risk

Assessment

Page 37: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

37Percent Fines

Pro

babi

lity

of

Obs

ervi

ng <

9 E

PT

Tax

a

0 20 40 60 80 100

0.0

0.2

0.4

0.6

0.8

1.0

Exposure Characterization

Cause/Effect Model

Logistic Regression MAIA Probability of <9 EPT for %finesCausal

Assessment

Page 38: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

38

Middle River

Page 39: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

39

Furnace Brook

Page 40: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

40

List of Candidate Causes

1. toxicity from metals, ammonia (NH3), or a complex mixture

2. high flows removal of organisms during

3. settled particles filling interstitial habitat

4. low dissolved oxygen

5. thermal stress 6. altered food resources favoring filter feeders

Page 41: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

41

Weight of evidence

• Types of evidence – Adapted from Hill’s Considerations

• Scoring– Source of information

• Observation• Manipulation• General Knowledge

– Quality of evidence• From the case or elsewhere• Specificity, Consistency and other qualities

Page 42: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

42

Willimantic case study Metals NH3 Flow SiltLow DO

Temp Food Episodic

Mix

Spatial/Temporal Co-Occurrence

+ - + - - - + +

Evidence of Biological Mechanism

+ + - - + + + +

Causal Pathway - + - - + + +

Stressor-Response from the Field

+ - - + +

Manipulation of Exposure + + +

Verified Predictions + + +

Stressor-Response from Other Field Studies

- - +

Stressor-Response from Laboratory

+ + - - +

Consistency of Evidence - - - - - + + + + +

Weighted Body of Evidence

Page 43: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

43

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Cause: Toxic mixture

Source: Broken effluent pipe

Moderately impaired

Not impaired

Impaired

Page 44: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

44

Unknown source

Sustained exposure

Episodic exposure

Ammonia levels greater upstream

Cr Cd & CuAl, Fe, Pb,

Ni, ZnAmmonia Mixture

Cr benchmark exceeded, but form not likely hexavalent Cr

Cu & Cd benchmarks

exceeded, but unimpaired sites also exceeded

Al, Fe, Pb, Ni, Zn did not exceed toxic benchmarks

Ammonia did not exceed toxic levels

After repairing broken pipe, Al, Cd, Cr, Pb, Fe, Zn decreased &

more species observed

Death or reproductive

failure

Loss of invertebrate

species

~ ~~~

~

Page 45: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

45

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Moderately impaired

Not impaired

Impaired

Cause: Heat &Altered food resources

Sources: Impoundments

Page 46: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

46

Predictive Assessment

Risk: Repairing broken effluent pipe and reducing metal release from POTW—no risk assessment, legally required remedies and no associated risks.

Expectation: reduce toxic effects, returning this segment to condition similar to those upstream. Moderate effects from stressors associated unless old mill dams were

removed.

Risk: Removing dams: risk assessments of removal options necessary because unmanaged release of sediment would bury downstream reach and may contain toxic substances

Page 47: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

47

Predictive AssessmentManagement: • Repair pipe —None, responsible parties complied. • More stringent NPDES permit at POTW—none,

responsible parties complied and monitoring of effluent continues.

• Removal of dams—Due to concerns about cost, social acceptance, and uncertainty of causes, CT DEP chose to study effects of impervious surfaces and dams on biological condition throughout the state. Small dams could provide aesthetically attractive cascades. Consultation with public would be required for optimizing benefits of selective dam removal.

Page 48: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

48

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 49: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

49

After fixing the illicit discharge

Willimantic River WL 1

0102030405060708090

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

iteMiddle River MR3

0

20

40

60

80

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

ite

Meets Water Quality Criteria

Meets Water Quality Criteria

Willimantic River WL 1

0102030405060708090

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

iteMiddle River MR3

0

20

40

60

80

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

ite

Meets Water Quality Criteria

Meets Water Quality Criteria

Page 50: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

50

CADDIS is a guide to causal inference for specific cases

www.epa.gov/caddis

[email protected]

513-569-7995

Page 51: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

51

SHORT COURSE: Causal Analysis/Stressor Identification

by Susan Cormier

National Center for Environmental Assessment, USEPA, Cincinnati

Page 52: CADDIS -  Risk-based Prioritization and Diagnosing the Risk Drivers

52

Thank You

After viewing the links to additional resources, please complete our online feedback form.

Thank You

Links to Additional ResourcesLinks to Additional Resources

Feedback FormFeedback Form

52