validly estimating true dose-response when only treatment ...sekhon.berkeley.edu/bamm/ef_don.pdf ·...

29
Validly Estimating True Dose-Response When Only Treatment versus Control is Randomized: Principal Stratification for Causal Inference with Extended Partial Compliance Hui Jin & Donald B. Rubin Department of Statistics Harvard University December, 2006 Donald B. Rubin [email protected]

Upload: others

Post on 15-Jan-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

Validly Estimating True Dose-Response WhenOnly Treatment versus Control is Randomized:

Principal Stratification for Causal Inferencewith Extended Partial Compliance

Hui Jin & Donald B. Rubin

Department of StatisticsHarvard University

December, 2006

Donald B. Rubin [email protected]

Page 2: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

Overview

Background: Efron and Feldman (1991) - EF:One of the earliest statistical articles to addressnon-compliance in randomized experiments.EF analyzed data from the Lipid Research ClinicsCoronary Primary Prevention Trial (LRC-CPPT) to studythe effectiveness of cholestyramine for lowering cholesterollevels.LRC-CPPT: Randomized treatment versus placebo, notdose.EF discussed inference for “dose-response” fromnon-randomized data.

Donald B. Rubin [email protected]

Page 3: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

Overview

Our work:Analyze the same data within the framework of PrincipalStratification (Frangakis and Rubin, 2002).Explicate possible assumptions, including more flexibleones.Check EF’s assumptions within our model.Formalize inference for dose-response.Our idea applies to any setting where dose is notrandomized, e.g., amount of studying, hours of job-training.

Donald B. Rubin [email protected]

Page 4: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

LRC-CPPT Data

Specific features of LRC-CPPT:Placebo-controlled double blind randomized clinical trial tostudy the effectiveness of cholestyramine.164 men were randomized to the treatment group andassigned the drug.171 men were randomized to the control group andassigned placebo.For each patient, cholesterol levels were measured beforeand after taking the drug (or placebo).The outcome variable, Y , was the decrease in cholesterollevel: the only variable available to EF or to us, besidestreatment assigned and dose taken.

Donald B. Rubin [email protected]

Page 5: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

LRC-CPPT Data

Partial Compliance Complications:Most patients in the treatment group only took a proportionof the assigned drug.Most patients in the control group only took a proportion ofthe assigned placebo.

Data Available:Zi : treatment assignmentDi(T ) or di(C): compliance to drug under treatment orcompliance to placebo under controlYi(T ) or Yi(C): outcome under treatment or outcomeunder control

Donald B. Rubin [email protected]

Page 6: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

LRC-CPPT Data: Figure 1

Relationship Between Observed Cholesterol Reduction andObserved Compliance

0.0 0.2 0.4 0.6 0.8 1.0

−20

020

4060

8010

0

Treatment Group

Observed Compliance to Drug

Obs

erve

d C

hole

ster

ol R

educ

tion

0.0 0.2 0.4 0.6 0.8 1.0

−20

020

4060

8010

0

Control Group

Observed Compliance to Placebo

Obs

erve

d C

hole

ster

ol R

educ

tion

Donald B. Rubin [email protected]

Page 7: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

LRC-CPPT Data: Figure 2

Histograms of Observed Compliances

Donald B. Rubin [email protected]

Page 8: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

OverviewLRC-CPPT DataLRC-CPPT Data Figures

LRC-CPPT Data: Figure 3

Q-Q Plot of Observed Drug and Observed Placebo Compliances

Donald B. Rubin [email protected]

Page 9: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Stratification FrameworkAssumptionsPrincipal Stratification for LRC-CPPT

Full Principal Stratification with Extended Compliance

i Xi Zi Di(T ) Di(C) di(T ) di(C) Yi(T ) Yi(C)

1 × T × ? × ? × ?2 × T × ? × ? × ?3 × T × ? × ? × ?4 × T × ? × ? × ?5 × C ? × ? × ? ×6 × C ? × ? × ? ×7 × C ? × ? × ? ×8 × C ? × ? × ? ×

Individual Causal Effect: Ei = Yi(T )− Yi(C)Principal Stratum: Si = [Di(T ), Di(C), di(T ), di(C)];“Full”⇒strata considered property of patients.Principal Causal Effect: Es = AVEi∈S[Yi(T )− Yi(C)].Average causal effect in principal stratum S.

Donald B. Rubin [email protected]

Page 10: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Stratification FrameworkAssumptionsPrincipal Stratification for LRC-CPPT

Standard Assumptions

Stable Unit Treatment Value Assumption (SUTVA):One patient’s treatment assignment will not affect otherpatients’ potential outcomes;No hidden versions of treatment and no hidden versions ofcontrol.Ignorable Treatment Assignment of T versus C:True for randomized experiment.

These are accepted by both EF and us.

Donald B. Rubin [email protected]

Page 11: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Stratification FrameworkAssumptionsPrincipal Stratification for LRC-CPPT

Assumptions at the Individual Level

(1) Access Monotonicity(1.A) General: Di(T ) ≥ Di(C) and di(C) ≥ di(T )(1.B) Strong: Di(C) = 0 and di(T ) = 0(2) Side-Effect Monotonicity(2.A) Negative: Di(T ) ≤ di(C)(2.B) Positive: Di(T ) ≥ di(C)

(3) Perfect Blind: Di(T ) = di(C)

(4) Equipercentile Equating of Compliances:Di(T ) = F−1

D {Fd [di(C)]}Align percentiles of Di(T ) and di(C).

For LRC-CPPT:EF assumed: (1.B) and (4)⇐ true in expectationWe assume: (1.B) and (2.A)⇐ weaker than (4)

Donald B. Rubin [email protected]

Page 12: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Stratification FrameworkAssumptionsPrincipal Stratification for LRC-CPPT

EF’s Assumption: Figure 3 Revisited

Q-Q Plot of Observed Drug and Observed Placebo Compliances

Donald B. Rubin [email protected]

Page 13: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Stratification FrameworkAssumptionsPrincipal Stratification for LRC-CPPT

Full Principal Stratification for LRC-CPPT

i Zi Di(T ) Di(C) di(T ) di(C) Yi(T ) Yi(C)

1 T × 0 0 ? × ?2 T × 0 0 ? × ?... T × 0 0 ? × ?nT T × 0 0 ? × ?

nT + 1 C ? 0 0 × ? ×nT + 2 C ? 0 0 × ? ×

... C ? 0 0 × ? ×n C ? 0 0 × ? ×

Principal Stratum: Si = [Di(T ), 0, 0, di(C)] = [Di , di ] fornotational simplicity.Recall, Si is property of patients; modified later.Principal Causal Effect: Es = AVEi∈S[Yi(T )− Yi(C)].Average causal effect in principal stratum S.

Donald B. Rubin [email protected]

Page 14: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Parametric Model

Parametric model:di |θ, ρ ∼ Beta(α1, α2);Didi|di , θ, ρ ∼ Beta(α3, α4).

Yi(C)|Di , di , θ, ρ ∼ N(β0 + β1Di + β2di , σ2C).

Yi(T )|Yi(C), Di , di , θ ∼ N[(γ0 + γ1Di + γ2D2i + γ3di) +

ρσTσC

(Yi(C)− β0 − β1Di − β2di), (1− ρ2)σ2T ].

Partial correlation ρ: sensitivity parameter.Therefore, θ = (α1, α2, α3, α4, β0, β1, β2, γ0, γ1, γ2, γ3, σC , σT ).Prior distribution π(θ|ρ):

π(α1, α2, α3, α4|ρ): corresponds to adding 6 extraobservations with complete (D, d) values.π(β0, β1, β2, γ0, γ1, γ2, γ3, σC , σT |α1, α2, α3, α4, ρ) ∝(σCσT )−2.

Donald B. Rubin [email protected]

Page 15: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Parametric Model: Figure 4 - Prior Distribution

Prior Data Points for π(α1, α2, α3, α4|ρ)

Donald B. Rubin [email protected]

Page 16: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Data Structure with Prior Data Points

i Zi Di(T ) Di(C) di(T ) di(C) Yi(T ) Yi(C)

(1) ? × 0 0 × ? ?(2) ? × 0 0 × ? ?(...) ? × 0 0 × ? ?(6) ? × 0 0 × ? ?1 T × 0 0 ? × ?2 T × 0 0 ? × ?... T × 0 0 ? × ?nT T × 0 0 ? × ?

nT + 1 C ? 0 0 × ? ×nT + 2 C ? 0 0 × ? ×

... C ? 0 0 × ? ×n C ? 0 0 × ? ×

Donald B. Rubin [email protected]

Page 17: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Computation: MCMC

This is a missing data problem, and we can use MCMC tomake Bayesian inference:

Parameters: θ (fixed ρ)Key missing data: missing Di or missing di

In MCMC, given parameters θ, draw key missing data Di ordi ; then given missing data, draw parameters; iterate untilconvergence.After convergence, we can simulate missing Yi(T ) or Yi(C)and obtain a set of complete data.

Therefore, we can get the posterior distribution of everyestimand: θ, principal causal effects, principal stratum of eachpatient,...

Donald B. Rubin [email protected]

Page 18: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Figure 5 - Scientific Estimands

Principal Causal Effects:Posterior Median and 95% Interval with ρ = 0

Donald B. Rubin [email protected]

Page 19: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Figure 6 - Diagnostic Checks of EF’s Assumption

Four Posterior Draws of Principal Stratafor All the Patients with ρ = 0

Donald B. Rubin [email protected]

Page 20: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Figure 7 - Diagnostic Checks of Our Model

One Posterior Draw of D.mis and d.mis with ρ = 0

Donald B. Rubin [email protected]

Page 21: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Parametric ModelComputationResults

Sensitivity Analysis

Posterior Medians and Intervals of PCE for Different Values of ρ

Donald B. Rubin [email protected]

Page 22: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Understanding Principal Strata

Meaning of Di and di :di : compliance to placebo indicates patient i ’spsychological compliance status.Di : compliance to drug includes both patient i ’spsychological compliance status and his tolerance tonegative side effects of the drug.di is more “fundamental” or “personal” than Di .But Di hints at possibility of estimating dose-response.Similar comments in EF.

Donald B. Rubin [email protected]

Page 23: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Estimating the Dose-Response Relationship

Dose-Response within the Principal StratificationFramework:

To estimate a dose-response relationship, we need ahypothetical experiment where different doses of drug arerandomly assigned and strictly enforced (Also in EF).In the EF data, we need an additional assumption: for eachcohort of patients with the same d , the assignment of D isstochastic and “latent ignorable” (Frangakis and Rubin1999).With this additional assumption, we need a modifiedPrincipal Stratification framework, where Di is no longer astratum indicator.

Donald B. Rubin [email protected]

Page 24: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Estimating the Dose-Response Relationship

Specific hypothetical experiment:Measure d∗i = baseline compliance for each patient.Randomly divide patients into Treatment and Control.In the treatment group, stochastically assign dose ZDi ≤ d∗iaccording to a certain “rule”.In the control group, assign full placebo and measure di .We notice di = d∗i in the control group, then “lose” d∗i in thecontrol group and in the treatment group.⇒ Non-ignorable assignment of ZDi ,...but latent ignorable given d∗i .Also, “forget” the rule for the assignment of ZDi .

Donald B. Rubin [email protected]

Page 25: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Estimating the Dose-Response Relationship

Modified Principal Stratification Framework for Dose-Response

Donald B. Rubin [email protected]

Page 26: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Modified Parametric Model

di |θ ∼ Beta(α1, α2);ZDidi|di , θ ∼ Beta(α3, α4).

– Prior distribution remains “the same” for (ZDi , di).Yi(C)|di , θ ∼ N(β0 + β2di , σ

2C).

– No dependence on randomly assigned dose, ZDi .

Yi(ZDi)|Yi(C), di , θ ∼N[Yi(C) + γ1ZDi + γ2Z 2

Di + γ3ZDidi , σ2T .C ],

where γ1 ≥ 0, γ2 ≥ 0, γ1 + γ3 ≥ 0.– When ZDi = 0, expectation of Yi(ZDi)− Yi(C) = 0.– Dose-response is monotonely increasing.

Donald B. Rubin [email protected]

Page 27: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Figure 8 - Dose-Response Results

Dose-Response

Donald B. Rubin [email protected]

Page 28: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Discussion of the Dose-Response Results

Full Principal Stratification results are not causal fordose-response, but descriptive given principal strata.Dose-response results are causal under debatableassumptions.Is Pr(ZD|d , {Y}) = Pr(ZD|d), “Nature’s randomization” ofdose ZDi given di , plausible?Or do we need Pr(ZD|d , {Y} , M) = Pr(ZD|d , M), where Mrefers to medical side effects of the drug beyond d?⇒ Not latent ignorable given d , but latent ignorable given dand M.Sensitivity analysis to M? ⇒ future work.

Donald B. Rubin [email protected]

Page 29: Validly Estimating True Dose-Response When Only Treatment ...sekhon.berkeley.edu/bamm/EF_Don.pdf · LRC-CPPT Data LRC-CPPT Data Figures LRC-CPPT Data Specific features of LRC-CPPT:

IntroductionPrincipal Stratification

InferenceDiscussion

Principal Strata and Dose-ResponseModified Parametric ModelReferences

Main References

Efron, B., Feldman, D. (1991), “Compliance as anExplanatory Variable in Clinical Trials,” Journal of theAmerican Statistical Association 86, 9-17.Frangakis, C.E. and Rubin, D.B. (2002), “PrincipalStratification in Causal Inference,” Biometrics 58, 20-29.Hirano, K., Imbens, G.W., Rubin, D.B. and Zhou X.-H.(2000), “Assessing the Effect of an Influenza Vaccine in anEncouragement Design,” Biostatistics 1, 69-88.Frangakis, C.E. and Rubin, D.B. (1999), “AddressingComplications of Intention-to-Treat Analysis in theCombined Presence of All-or-None Treatment -Noncompliance and Subsequent Missing Outcomes,”Biometrika 86, 365-379.

Donald B. Rubin [email protected]