the role of risk stratification and biomarkers in prevention of cvd
DESCRIPTION
Presented by Mark Pletcher, MD, MPH, at UCSF's symposium "The Role of Risk Stratification and Biomarkers in Prevention of Cardiovascular Disease" in Jan 2012.TRANSCRIPT
![Page 1: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/1.jpg)
The role of risk stratification and biomarkers in prevention of CVD
CVD Risk Biomarker SymposiumMark J. Pletcher, MD, MPH
1/30/2012
![Page 2: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/2.jpg)
Objective
• Objective: – Complete translation of biomarkers into
clinical practice when beneficial
![Page 3: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/3.jpg)
Objective
• Objective: – Complete translation of biomarkers into
clinical practice when beneficial
• Gaps: – Need evidence that will convince guideline
committees and clinicians to recommend and use the biomarker in clinical practice
– Need tools to encourage implementation and a good dissemination strategy
![Page 4: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/4.jpg)
Outline
• Framework– Phases of evaluation of a biomarkers– Measuring health impact– RCTs and decision analysis modeling
![Page 5: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/5.jpg)
Framework
• Objective: – Complete translation of biomarkers into clinical
practice when beneficial
• Gaps: – Need evidence that will convince guideline
committees and clinicians to recommend and use the biomarker in clinical practice
– Need tools and strategy to implement and disseminate
What KIND of evidence?
![Page 6: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/6.jpg)
Framework
Circulation 2009;119: 2408-16.
![Page 7: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/7.jpg)
Framework
Circulation 2009;119: 2408-16.
Association
(Discrimination)
![Page 8: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/8.jpg)
Framework
Circulation 2009;119: 2408-16.
Reclassification
![Page 9: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/9.jpg)
Framework
Circulation 2009;119: 2408-16.
Impact
![Page 10: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/10.jpg)
Framework
• My thesis:
– Credible evidence of positive net health impact is and should be absolutely required
Circulation 2011;123:1116-1124
![Page 11: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/11.jpg)
Framework
• My thesis:
– Credible evidence of positive net health impact is and should be absolutely required
• Association, discrimination, reclassification measures are not enough
• Decision analysis modeling and/or studies directly measuring health impact outcomes are required
Circulation 2011;123:1116-1124
![Page 12: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/12.jpg)
Framework
• My thesis:
– Credible evidence of positive net health impact is and should be absolutely required
• Association, discrimination, reclassification measures are not enough
• Decision analysis modeling and/or studies directly measuring health impact outcomes are required
– Magnitude of impact and cost (i.e., cost-effectiveness) should also be considered
Circulation 2011;123:1116-1124
![Page 13: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/13.jpg)
Framework
• 2 high profile examples
![Page 14: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/14.jpg)
Example 1: Multimarker panel
• 10 biomarkers– CRP, BNP, homocysteine, Ualb/cr ratio, etc
• “Evaluate incremental usefulness”
NEJM 2006;355:2631-9
![Page 15: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/15.jpg)
Example 1: Multimarker panel
• Association
NEJM 2006;355:2631-9
![Page 16: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/16.jpg)
Example 1: Multimarker panel
• Association
NEJM 2006;355:2631-9
![Page 17: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/17.jpg)
Example 1: Multimarker panel
• Discrimination
NEJM 2006;355:2631-9
C-statistic:
0.80 0.82
![Page 18: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/18.jpg)
Example 1: Multimarker panel
• Conclusion
– “Adds only moderately to standard risk factors”
• Should we adopt? Abandon hope for CVD biomarkers?
NEJM 2006;355:2631-9
![Page 19: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/19.jpg)
Example 2: CRP
• C-reactive protein
• “Compare prediction models”
Annals 2006;145:21-29
![Page 20: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/20.jpg)
Example 2: CRP
• Association– RR-adj for ln(hsCRP) = 1.22, highly significant
Annals 2006;145:21-29
![Page 21: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/21.jpg)
Example 2: CRP
• Association– RR-adj for ln(hsCRP) = 1.22, highly significant
• Model “fits better” with CRP– BIC improves (6969.60 6960.25)– Calibration poor without (p=.039), good with
(p=.23)
Annals 2006;145:21-29
![Page 22: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/22.jpg)
Example 2: CRP
• Association– RR-adj for ln(hsCRP) = 1.22, highly significant
• Model “fits better” with CRP– BIC improves (6969.60 6960.25)– Calibration poor without (p=.039), good with
(p=.23)
• Discrimination improves a tiny bit– C-index 0.813 0.815– More improvement with CRP than with LDL
Annals 2006;145:21-29
![Page 23: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/23.jpg)
Example 2: CRP
• Reclassification
Annals 2006;145:21-29
Intermediate risk ppts reclassified:
20%
(And reclassified persons’ expected risk closer to what was observed)
![Page 24: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/24.jpg)
Example 2: CRP
• Reclassification– Might make a different treatment decision for
those 20% reclassified
Annals 2006;145:21-29
![Page 25: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/25.jpg)
Example 2: CRP
• Conclusion
– CRP “improves cardiovascular risk classification”
• Should we adopt? Abandon hope for CRP?
Annals 2006;145:21-29
![Page 26: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/26.jpg)
The Common Flaw
• All presented measures:– Ignore the clinical decisions they influence– Do not reflect the health consequences of
making a good vs. bad decision– Do not account for the downsides of
measuring the biomarker itself• Harm, also cost
Circulation 2011;123:1116-1124
![Page 27: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/27.jpg)
The Common Flaw
• All presented measures:– Ignore the clinical decisions they influence– Do not reflect the health consequences of
making a good vs. bad decision– Do not account for the downsides of
measuring the biomarker itself• Harm, also cost
• Cannot estimate net health impact!
Circulation 2011;123:1116-1124
![Page 28: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/28.jpg)
The Answer
• Measure health impact
Circulation 2011;123:1116-1124
![Page 29: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/29.jpg)
The Answer
• Measure health impact
• Instead of:– RR, C-statistic, Hosmer-Lemeshow, IDI, NRI
• Measure:– Death, MI, fractures, disability scale, quality of
life, life-years, QALY’s
Circulation 2011;123:1116-1124
![Page 30: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/30.jpg)
Measuring Health Impact
• It’s hard to measure health impact– Events you care about are rare– How to balance the harms against benefits?– Biomarker impact depends on specifics of the
interventions, and on the algorithm for using the biomarker
Circulation 2011;123:1116-1124
![Page 31: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/31.jpg)
Measuring Health Impact
• It’s hard to measure health impact– Events you care about are rare– How to balance the harms against benefits?– Biomarker impact depends on specifics of the
interventions, and on the algorithm for using the biomarker
• RCTs vs. Decision/cost-effectiveness modeling (vs. both)
Circulation 2011;123:1116-1124
![Page 32: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/32.jpg)
Measuring Health Impact
• RCTs and DCEA models– Overview– Strengths and weaknesses
Circulation 2011;123:1116-1124
![Page 33: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/33.jpg)
Measuring Health Impact
• Randomized controlled trials (RCTs)
Study sample Randomize
Do not measure biomarker
Intervention tailored to biomarker level
Standard intervention
Measure health outcomes
Measure health outcomes
Measure biomarker
Circulation 2011;123:1116-1124
![Page 34: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/34.jpg)
Measuring Health Impact
• Randomized controlled trials (RCTs)– Strengths: A “real-world”(?) unbiased estimate
of effectiveness• Imperfect test performance• Imperfect adherence to algorithm• Estimate portability of the intervention and
effectiveness in a specific population• Can measure utilization, unexpected downsides
Circulation 2011;123:1116-1124
![Page 35: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/35.jpg)
Measuring Health Impact
• Randomized controlled trials (RCTs)– Weakness #1: $$$$$
• Big sample size, long follow-up– Uncommon events like MI are the most interesting...– “The Unreclassified Fraction”– Power for both upwards and downwards reclassification
• You get 1 shot at this! Choose the RIGHT algorithm– Choose the best biomarker, and best measurement method– Choose the right intervention and treatment threshold (new
drug, $generic, new evidence, new guidelines)– Strict vs. loose enforcement of the algorithm?
Circulation 2011;123:1116-1124
![Page 36: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/36.jpg)
Measuring Health Impact
• Randomized controlled trials (RCTs)– Weakness #2: Hard to blind
• Clinicians need to know biomarker results to change treatment
• Co-interventions, biased outcome ascertainment
– Weakness #3: Long-term rare events missed• e.g., Radiation-induced cancer
Circulation 2011;123:1116-1124
![Page 37: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/37.jpg)
Measuring Health Impact
• Decision analysis
![Page 38: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/38.jpg)
Measuring Health Impact
• Decision analysis– Compare strategies
• Effectiveness (QALY’s, etc)• Cost ($)• Incremental cost-effectiveness ratios (ICER,
$/QALY)
Circulation 2011;123:1116-1124
![Page 39: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/39.jpg)
Measuring Health Impact
• Decision analysis– Strengths: Relatively cheap!
• Can run lots of scenarios– Different biomarkers, different interventions, different
algorithms– Systematic approach to identifying the optimal strategy
• Sensitivity analysis for “what if…” and to identify key parameters
Circulation 2011;123:1116-1124
![Page 40: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/40.jpg)
Measuring Health Impact
• Decision analysis– Weakness #1: “All models are wrong…”
• Imperfect evidence and estimates• Unknown/unanticipated effects • Can’t run all possible sensitivity analyses• Fundamental structure flaws
Circulation 2011;123:1116-1124
![Page 41: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/41.jpg)
Measuring Health Impact
• Decision analysis– Weakness #2: Common metric assumptions
• Utilitarian perspective– Is it better to save the life of a young person than an old
person?
• Weighing apples vs. oranges– Quality of life/utility estimates differ, pt preferences
• Ideal strategy depends on– Willingness to pay threshold: ICER<$50,000/QALY?– Total available resources
Circulation 2011;123:1116-1124
![Page 42: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/42.jpg)
Measuring Health Impact
• Which to use?
![Page 43: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/43.jpg)
Measuring Health Impact
• Which to use?
• ANSWER: USE BOTH
RCT
DCEA Model
![Page 44: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/44.jpg)
Measuring Health Impact
• ANSWER: USE BOTH– RCT
• Proof of concept• Identify unanticipated effects• Test real world implementation
– DCEA model• Systematic evaluation of strategies• Identification of key uncertainties• Synthesize evidence including long-term effects• Include cost and cost-effectiveness
![Page 45: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/45.jpg)
Measuring Health Impact
• Comparative effectiveness iterations– 1: RCT shows treatment X is effective– 2: Cohort shows biomarker Y predicts risk– 3: Model shows test-and-treat strategy might be cost-
effective, identifies key parameters/uncertainty– 4: Observational study nails down key parameters– 5: Redo model to identify an “ideal” strategy– 6: RCT to test the “ideal” strategy shows benefit but
identifies unanticipated harm and implementation barriers
– 7: Redo model again including long-term harms and imperfect implementation: still cost-effective?…
![Page 46: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/46.jpg)
For the rest of the day…
• Focus on:– Cardiovascular disease interventions– Biomarkers of CVD risk– Coronary calcium
• Present both RCT and DCEA plans
• Present DCEA preliminary results
• Get your feedback on theory and how to optimize
![Page 47: The Role of Risk Stratification and Biomarkers in Prevention of CVD](https://reader033.vdocuments.site/reader033/viewer/2022060118/558a113ed8b42a0f248b465d/html5/thumbnails/47.jpg)
Thank you to our sponsors!
• UCSF Clinical and Translational Science Institute (CTSI)– Provided food and administrative
support
• NHLBI– Grant support!