assessing outcomes and safety steven r. cummings, md director, sf coordinating center
TRANSCRIPT
![Page 1: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/1.jpg)
Assessing Outcomes and SafetyAssessing Outcomes and Safety
Steven R. Cummings, MDSteven R. Cummings, MDDirector, SF Coordinating Center Director, SF Coordinating Center
![Page 2: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/2.jpg)
Outline: OutcomesOutline: Outcomes
• Primary and secondary aimsPrimary and secondary aims
• Composite outcomesComposite outcomes
• Surrogate markersSurrogate markers
• Adverse experiencesAdverse experiences
![Page 3: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/3.jpg)
MorboneMorbone
• A company wants help designing a trial A company wants help designing a trial of Morbone new treatment for of Morbone new treatment for osteoporosisosteoporosis
• Animal models: improves bone mass Animal models: improves bone mass and bone strengthand bone strength
• Planning a clinical trialPlanning a clinical trial
• Would like FDA approval to market Would like FDA approval to market MorboneMorbone
![Page 4: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/4.jpg)
Morbone TrialMorbone Trial
Potential outcomesPotential outcomes
• Bone density (BMD) Bone density (BMD)
• Vertebral fractures (by spine x-ray)Vertebral fractures (by spine x-ray)
• Nonvertebral fractures (by clinical dx) Nonvertebral fractures (by clinical dx)
• Hip fracturesHip fractures
![Page 5: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/5.jpg)
How to start?How to start?
• Designate one “primary” and the others Designate one “primary” and the others as “secondary” outcomesas “secondary” outcomes
![Page 6: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/6.jpg)
Why one “primary” outcome?Why one “primary” outcome?
• To calculate sample sizeTo calculate sample size
• For testing statistical significance For testing statistical significance without penaltywithout penalty
• Greater credibilityGreater credibility
• The FDA requires that an outcome be The FDA requires that an outcome be “primary” in order to approve a drug for “primary” in order to approve a drug for that indicationthat indication–Beneficial effects on secondary outcomes Beneficial effects on secondary outcomes
can’t be used for ‘indication’can’t be used for ‘indication’
![Page 7: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/7.jpg)
Which primary for Morbone?Which primary for Morbone?
• Bone density (BMD) Bone density (BMD)
• Vertebral fractures (by x-ray)Vertebral fractures (by x-ray)
• Nonvertebral fractures (by clinical dx)Nonvertebral fractures (by clinical dx)
• Hip fracturesHip fractures
![Page 8: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/8.jpg)
ConsiderationsConsiderations
• Clinical importanceClinical importance
• FeasibilityFeasibility–Sample size and costSample size and cost
• Scientific / biological interestScientific / biological interest
• (For new drugs: What does FDA need in (For new drugs: What does FDA need in order to approve an indication for order to approve an indication for prescribing the drug?)prescribing the drug?)
![Page 9: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/9.jpg)
Clinical importanceClinical importance
• Hip fracture: causes almost all of the deaths, Hip fracture: causes almost all of the deaths, and 75% of the costs of fracturesand 75% of the costs of fractures
• ‘‘Nonvertebral’ fractures: the most common Nonvertebral’ fractures: the most common kind of fracture. kind of fracture.
• Vertebral fracture by x-ray: about 1/3 cause Vertebral fracture by x-ray: about 1/3 cause recognized pain and disability. Mild changes recognized pain and disability. Mild changes might not be real fractures.might not be real fractures.
• BMD: loss leads to greater risk of fracturesBMD: loss leads to greater risk of fractures
![Page 10: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/10.jpg)
Which Primary Outcome?Which Primary Outcome?Sample sizeSample size
AlternativesAlternatives
• Improvement in Improvement in BMDBMD
• Vertebral fracturesVertebral fractures
• Nonvertebral Nonvertebral fracturefracture
• Hip fracturesHip fractures
Sample size/duration Sample size/duration
• 200 / 1 year200 / 1 year
• 2,500 / 3 yrs2,500 / 3 yrs
• 5,000 / 3 yrs5,000 / 3 yrs
• 8,000 / 4 yrs8,000 / 4 yrs
![Page 11: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/11.jpg)
Why not make BMD the Why not make BMD the primary outcome?primary outcome?
• Best choice to minimize costBest choice to minimize cost
• Issue: is it a valid surrogate marker of Issue: is it a valid surrogate marker of clinical outcomes?clinical outcomes?
![Page 12: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/12.jpg)
Clean up your language!Clean up your language!
• Not all markers are ‘surrogates’Not all markers are ‘surrogates’
• BiomarkersBiomarkers– Measurement of a process or state.Measurement of a process or state.
• ‘‘Surrogate’ markerSurrogate’ marker– Substitute for clinical outcomeSubstitute for clinical outcome
• Validated surrogateValidated surrogate– You can trust it. Effect of treatment on marker has You can trust it. Effect of treatment on marker has
been established to consistently represent the been established to consistently represent the effect on clinical outcome.effect on clinical outcome.
![Page 13: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/13.jpg)
Surrogate markers for trialsSurrogate markers for trials
• ‘‘A laboratory or physical sign that is A laboratory or physical sign that is used in trials as a substitute for a used in trials as a substitute for a clinically meaningful endpoint.’ clinically meaningful endpoint.’
![Page 14: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/14.jpg)
Criteria for validating a surrogate Criteria for validating a surrogate marker for treatmentsmarker for treatments
• Biologically plausibleBiologically plausible
• Marker strongly predicts the clinical Marker strongly predicts the clinical outcomeoutcome
• Treatment changes the markerTreatment changes the marker–Treatment changes the rate of disease in Treatment changes the rate of disease in
the predicted directionthe predicted direction
* Prentice, 1989
![Page 15: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/15.jpg)
Bone densityBone density
• Biologically plausible: YESBiologically plausible: YES
• Marker strongly predicts the clinical Marker strongly predicts the clinical outcome: YESoutcome: YES
• Treatment changes the marker*Treatment changes the marker*–YES: treatment improves BMD~5%YES: treatment improves BMD~5%
* Prentice, 1989
![Page 16: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/16.jpg)
Risk of new vertebral fractures by Risk of new vertebral fractures by quartile of BMDquartile of BMD
Hip BMDHip BMD
00
22
44
66
88
1010
Quartile of Quartile of BMDBMD
11 22 33 44
Spine BMDSpine BMD
00
22
44
66
88
1010
Quartile of Quartile of BMDBMD
11 22 33 44
9.99.9
1.81.8
4.24.25.25.2
9.59.5
2.72.7
3.93.94.64.6
% o
f w
om
en w
ith
fra
ctu
re%
of
wo
men
wit
h f
ract
ure
![Page 17: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/17.jpg)
Treatment improves BMDTreatment improves BMD
RxRx BMDBMD
![Page 18: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/18.jpg)
BMD predicts fractureBMD predicts fracture
FxFxBMDBMD
![Page 19: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/19.jpg)
Bone densityBone density
• Do changes in the surrogate (bone Do changes in the surrogate (bone density) density) account foraccount for changes in changes in reduction in the outcome (fractures)?reduction in the outcome (fractures)?
* Prentice, 1989
![Page 20: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/20.jpg)
FlourideFlouride
• Increased BMD ~10%Increased BMD ~10%
• IncreasedIncreased the risk of fractures the risk of fractures
* Prentice, 1989
![Page 21: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/21.jpg)
Decreased Vertebral Fracture Risk: Decreased Vertebral Fracture Risk: Predicted from BMD vs. ObservedPredicted from BMD vs. Observed
80806060404020200 0
EstradiolEstradiol
EtidronateEtidronate
EtidronateEtidronate
AlendronateAlendronate
CalcitoninCalcitonin
6161
5656
5858
5050
6262
8 8
55
1313
2020
3 3
ObservedObservedPredictedPredicted
Cummings, ASBMR 1997Cummings, ASBMR 1997
![Page 22: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/22.jpg)
““Bone turnover”Bone turnover”
• Bone resorption: osteoclasts dig ‘pits’ in boneBone resorption: osteoclasts dig ‘pits’ in bone
• Bone formation: osteoclasts make new bone Bone formation: osteoclasts make new bone in the pitsin the pits
• More resorption -> faster lossMore resorption -> faster loss
• More pits -> weaker boneMore pits -> weaker bone
• Proteins produced by the process can be Proteins produced by the process can be measured in blood: “Bone turnover markers”measured in blood: “Bone turnover markers”
![Page 23: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/23.jpg)
The perfect surrogate is the causal pathway The perfect surrogate is the causal pathway by which tx affects the diseaseby which tx affects the disease
RxRx FxFxBMDBMD
![Page 24: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/24.jpg)
But treatments may have other effects that But treatments may have other effects that could also influence the diseasecould also influence the disease
RxRx FxFxBMDBMD
??????
TurnTurnoverover
Change in one marker will account forChange in one marker will account foronly part of the effect.only part of the effect.Some changes might also be harmful.Some changes might also be harmful.
![Page 25: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/25.jpg)
Proving that a change in measurement Proving that a change in measurement predicts effect of treatment on fracture riskpredicts effect of treatment on fracture risk
Two approachesTwo approaches
• Individual level Individual level – How well does How well does changechange in the marker account for in the marker account for
the effect in people? the effect in people?
• Trial levelTrial level– How well does the How well does the changechange in measurement predict in measurement predict
the clinical results from trials? the clinical results from trials?
![Page 26: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/26.jpg)
Validating that a marker is a Validating that a marker is a good surrogategood surrogate
#1#1
• Individual level Individual level –How well does change in the measurement How well does change in the measurement
account for the decrease in fracture risk in account for the decrease in fracture risk in people? people?
–The test: What percent of effect of The test: What percent of effect of decrease in fracture risk ‘explained’ by decrease in fracture risk ‘explained’ by change in the measurementchange in the measurement
![Page 27: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/27.jpg)
Does BMD “Explain” the Reduction in Does BMD “Explain” the Reduction in Fracture Risk? Fracture Risk?
Main methodsMain methods
• Freeman Freeman –For individual data from a trialFor individual data from a trial–Estimates p = proportion of treatment effect Estimates p = proportion of treatment effect
“explained” by “explained” by change change in the markerin the marker–ß = coefficient for treatmentß = coefficient for treatment–ß* = “adjusted for change in the markerß* = “adjusted for change in the marker– (1 - ß* / ß)(1 - ß* / ß)
![Page 28: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/28.jpg)
Does BMD “Explain” the Reduction in Does BMD “Explain” the Reduction in Fracture Risk? Fracture Risk?
• • This method applied to studies This method applied to studies –FIT trial (alendronate): p = 0.16FIT trial (alendronate): p = 0.16–MORE trial (raloxifene): p = 0.05MORE trial (raloxifene): p = 0.05
• Very little of the treatment effects are Very little of the treatment effects are due to individual improvements in spine due to individual improvements in spine BMD, as measured by DXA.BMD, as measured by DXA.
![Page 29: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/29.jpg)
Proving that a change in measurement Proving that a change in measurement predicts effect of treatment on fracture riskpredicts effect of treatment on fracture risk
2nd approach2nd approach
• Individual level Individual level
• Trial levelTrial level–How well does the change in measurement How well does the change in measurement
predict the fracture results from trials? predict the fracture results from trials? – ‘‘Meta-analysis’ of many trialsMeta-analysis’ of many trials
![Page 30: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/30.jpg)
““Meta-analysis” of trials of antiresorptivesMeta-analysis” of trials of antiresorptives
Each 1% improvement in spine BMD predicts Each 1% improvement in spine BMD predicts .03 (.02 to .05) reduction in risk of vertebral fracture.03 (.02 to .05) reduction in risk of vertebral fracture
ExpectedExpected
.25.25
![Page 31: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/31.jpg)
ImplicationsImplications
• You cant trust changes in BMD in your You cant trust changes in BMD in your patients as an index of whether patients as an index of whether treatment is working.treatment is working.
• You can’t trust that a drug that improves You can’t trust that a drug that improves BMD will reduce the risk of fracture.BMD will reduce the risk of fracture.
• FDA still requires fractures as the FDA still requires fractures as the endpoint of trials for registering drugs.endpoint of trials for registering drugs.
![Page 32: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/32.jpg)
Surrogate markers that failedSurrogate markers that failed
• Anti-arrhythmic drugs decreased the Anti-arrhythmic drugs decreased the frequency of ventricular arrythmias - and frequency of ventricular arrythmias - and increased the risk of death (CAST Trial) increased the risk of death (CAST Trial)
• Inotropic agents for CHF - improved cardiac Inotropic agents for CHF - improved cardiac function - but increased mortalityfunction - but increased mortality
• Torcetrapib + lipitor (Pfizer) improved HDL Torcetrapib + lipitor (Pfizer) improved HDL cholesterol vs. lipitor alone but increased cholesterol vs. lipitor alone but increased overall mortalityoverall mortality
![Page 33: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/33.jpg)
Surrogates and safetySurrogates and safety
• Trials with surrogate endpoints are small and Trials with surrogate endpoints are small and shortshort
• Generally too small to detect some important Generally too small to detect some important adverse effectsadverse effects
• Usually too short to determine whether long-Usually too short to determine whether long-term treatment continues to be effective (or term treatment continues to be effective (or safe)safe)
![Page 34: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/34.jpg)
Limitations of surrogate markers is Limitations of surrogate markers is the main reason for relying on trials the main reason for relying on trials with clinical outcomeswith clinical outcomes
![Page 35: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/35.jpg)
Which Primary Outcome?Which Primary Outcome?Sample sizeSample size
AlternativesAlternatives
• Improvement in Improvement in BMDBMD
• Vertebral fracturesVertebral fractures
• Nonvertebral Nonvertebral fracturefracture
• Hip fracturesHip fractures
Sample size/duration Sample size/duration
• 200 / 1 year200 / 1 year
• 2,500 / 3 yrs2,500 / 3 yrs
• 5,000 / 3 yrs5,000 / 3 yrs
• 8,000 / 4 yrs8,000 / 4 yrs
![Page 36: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/36.jpg)
Wait a minute…Wait a minute…
a bright idea…a bright idea…
![Page 37: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/37.jpg)
Lets combine the endpoints!Lets combine the endpoints!
Rate per 3 yrsRate per 3 yrs
• Nonvertebral fracturesNonvertebral fractures 12%12%
• Vertebral ‘fractures’Vertebral ‘fractures’ 4% 4%
• CombinationCombination 16%16%
![Page 38: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/38.jpg)
Pros and Cons of Composite EndpointsPros and Cons of Composite Endpoints
ProPro
-
-
ConCon
-
-
![Page 39: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/39.jpg)
Lets combine the endpoints!Lets combine the endpoints!
Rate per 3 yrsRate per 3 yrs
• Nonvertebral fracturesNonvertebral fractures 12%12%
• Vertebral ‘fractures’Vertebral ‘fractures’ 4% 4%
• CombinationCombination 16%16%
![Page 40: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/40.jpg)
Which Primary Outcome?Which Primary Outcome?Sample sizeSample size
AlternativesAlternatives
• Vertebral ‘fractures’Vertebral ‘fractures’• Nonvertebral Nonvertebral
fracturefracture
• CombinedCombined
Sample size/duration Sample size/duration
• 2,500 / 3 yrs2,500 / 3 yrs
• 5,000 / 3 yrs5,000 / 3 yrs
• ______________________
![Page 41: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/41.jpg)
The trump cardThe trump card
FDAFDA
![Page 42: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/42.jpg)
Which Primary Outcome?Which Primary Outcome?Sample sizeSample size
AlternativesAlternatives
• Improvement in Improvement in BMDBMD
• Vertebral ‘fractures’Vertebral ‘fractures’
• Nonvertebral Nonvertebral fracturefracture
• Hip fracturesHip fractures
Sample size/duration Sample size/duration
• 200 / 1 year200 / 1 year
• 2,500 / 3 yrs2,500 / 3 yrs
• 5,000 / 3 yrs5,000 / 3 yrs
• 8,000 / 4 yrs8,000 / 4 yrs
![Page 43: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/43.jpg)
AEsAEs
• Hugely expensive & time-consumingHugely expensive & time-consuming–May account for 1/4 of the expense of drug May account for 1/4 of the expense of drug
trialstrials
• Poorly donePoorly done
• Poorly studiedPoorly studied
![Page 44: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/44.jpg)
Issues re: Adverse EventsIssues re: Adverse Events
• Elicited vs. volunteeredElicited vs. volunteered
• Nuisance AEsNuisance AEs
• Attribution of causeAttribution of cause
![Page 45: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/45.jpg)
Open-ended interviewOpen-ended interview
• Record any symptoms or conditions the Record any symptoms or conditions the subject has experienced:subject has experienced:
________________________________________________________________
__________________________________________________________________
• What’s wrong with this approach?What’s wrong with this approach?
![Page 46: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/46.jpg)
Check list approachCheck list approach
““Since your last visit, has a doctor told Since your last visit, has a doctor told you you had (check all that apply)”you you had (check all that apply)”
__A blood clot in the leg or lung (venous __A blood clot in the leg or lung (venous thrombosis)thrombosis)
__ An ulcer __ An ulcer
……for all possible diseasesfor all possible diseases
What’s wrong with this approach?What’s wrong with this approach?
![Page 47: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/47.jpg)
Approaches to AEsApproaches to AEsVolunteered vs. elicitedVolunteered vs. elicited
Pro Pro elicited/check listelicited/check list
•
•
Con:Con:
•
Pro Pro volunteeredvolunteered
•
•
Con:Con:
•
•
![Page 48: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/48.jpg)
STEP Trial STEP Trial
• Randomized comparison of open-ended Randomized comparison of open-ended vs. open-ended (at least 1 day limited vs. open-ended (at least 1 day limited activity) vs. check list for adverse eventsactivity) vs. check list for adverse events
• 70 men in each group70 men in each group
• Treatment had no effect on AEsTreatment had no effect on AEs
![Page 49: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/49.jpg)
STEP Trial STEP Trial
# of AE reports# of AE reports
• Open-endedOpen-ended 1111
• Open-endedOpen-ended 1414
((limited activity)limited activity)
• Check listCheck list 214214
![Page 50: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/50.jpg)
An approach? An approach?
• Standard questions to elicit uncommon Standard questions to elicit uncommon AEs suspected to be related to drug.AEs suspected to be related to drug.
• Open ended questions to capture other Open ended questions to capture other AEs.AEs.
![Page 51: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/51.jpg)
FDA AE classificationsFDA AE classifications
• Serious AEsSerious AEs–DeathsDeaths–HospitalizedHospitalized–Cancer (except skin cancer)Cancer (except skin cancer)–Birth defectsBirth defects
• Reported within 24 hoursReported within 24 hours
• Collect extensive documentationCollect extensive documentation
![Page 52: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/52.jpg)
FDA AE classificationsFDA AE classifications
• Non-serious AEsNon-serious AEs–Anything symptom or clinical eventAnything symptom or clinical event–Regardless of importance or potential Regardless of importance or potential
relevancerelevance
![Page 53: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/53.jpg)
The Bunion Problem in Large TrialsThe Bunion Problem in Large Trials
• FIT Trial of alendronate in 6,400 women FIT Trial of alendronate in 6,400 women for 4 yearsfor 4 years
• Recorded over 20,000 episodes of URRecorded over 20,000 episodes of URIs Is (and thousands of reports of bunions!)(and thousands of reports of bunions!)
• Enormous data management effort and Enormous data management effort and costcost
• How could this be avoided?How could this be avoided?
![Page 54: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/54.jpg)
An approach to classifying AEsAn approach to classifying AEs
• Serious AEsSerious AEs
• Important AEsImportant AEs–Limit activityLimit activity– Initiate a prescription or procedureInitiate a prescription or procedure–E.R. visitE.R. visit
• Minor AEsMinor AEs
![Page 55: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/55.jpg)
An approach to ‘nuisance’ AEsAn approach to ‘nuisance’ AEs
• Limit collection of non-serious AEs to Limit collection of non-serious AEs to samples of subjectssamples of subjects–1st 300, then stop collecting1st 300, then stop collecting
• Collect all other AEs (and SAEs)Collect all other AEs (and SAEs)
![Page 56: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/56.jpg)
AttributionAttribution
• SAEs must be classified asSAEs must be classified as–DefinitelyDefinitely–ProbablyProbably–Possibly, orPossibly, or–Not... Not...
...related to the study drug...related to the study drug
![Page 57: Assessing Outcomes and Safety Steven R. Cummings, MD Director, SF Coordinating Center](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649f575503460f94c7c5f0/html5/thumbnails/57.jpg)
AttributionAttribution
• Attributions to the drug are usually Attributions to the drug are usually wrongwrong–(Unless the treatment is known to cause (Unless the treatment is known to cause
the effect)the effect)