sample size re-estimation: controlling the type-1 error regulatory-industry presentation - y...

23
Yannis Jemiai, Ph.D. 26 September 2017 ASA Biopharmaceutical Section Regulatory-Industry Statistics Workshop Sample Size Re-Estimation: Controlling the Type-1 Error

Upload: others

Post on 08-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

YannisJemiai,Ph.D.26September2017

ASABiopharmaceuticalSectionRegulatory-IndustryStatisticsWorkshop

SampleSizeRe-Estimation:ControllingtheType-1Error

Page 2: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

2

unblinded samplesizere-estimationisanessentialdesigntool

YJemiai– 26Sep2017

Addressesuncertaintyintrialdesignassumptions

Oneofthemostpopularadaptations,especiallywhenusingaPromisingZoneapproach

21st CenturyCuresAct,PDUFAVI,encouragetheuseofadaptivedesigns

RegulatoryguidancedocumentsexistfromEMA(2007),FDACDER/CBER(2010),andCDRH(2016)

Increasinglymanyexamplesofregulatoryacceptance

Regulatory-IndustryStatistics

Page 3: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

3

SowhataresomeoftheissuesconcerninguSSR designs?

YJemiai– 26Sep2017

Cantype-1errorbecontrolled?

Cansoundadaptivedecisionrulesbedeveloped?

Howdowegetapointestimateandconfidenceintervalsforthetreatmenteffect?

Howdoweavoidoperationalbiasduringtrialconduct?

Wefocushereontype-1errorcontrol

Regulatory-IndustryStatistics

Page 4: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

4

Whydoestype-1errorgetinflated?

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Consideratwo-stagedesignwithoutsamplesizeincrease

SupposenowthatweincreasethesamplesizeinstageIIfromn(2) ton*(2),butwedonotchangethecriticalvalue

Thiswillleadtotype-1errorinflation

Page 5: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

5

Howcanwecontroltype-1errorthen?

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 6: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

6

Chronologyofdevelopment(partiallist)

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 7: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

7

1.Useaweightedstatisticwithpre-specifiedweights

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 8: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

8

Alsocalledthep-valuecombinationapproach

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 9: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

9

2.UsetheConventionalWaldStatistic

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 10: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

10

ExtendedCDLMethod

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 11: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

11

Whydoesitwork?

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 12: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

12

… andwhataretheconcerns?

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 13: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

13

3.PreserveConditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 14: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

14

Preservingtheoveralltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 15: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

15

Conditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 16: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

16

Conditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 17: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

17

Conditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 18: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

18

Conditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 19: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

19

Conditionaltype-1errorrate

YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 20: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

20

Pointstoconsider

YJemiai– 26Sep2017

Handlingsurvivalendpoints

Usableinformationatinterimanalysis

Non-inferiority&equivalencesettings

Independentincrements

Smallsamples

Regulatory-IndustryStatistics

Page 21: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

21

Recap:challengesinunblinded SSRtrials

YJemiai– 26Sep2017

Type-1errorcontrolisnotanobstacle.Methodsexisttoensurestrongcontrol

Inferenceremainsachallenge,butmakingsomeprogress

Decision-makingalgorithmcanbeoptimizedusingsimulationsandlatestresearch

Operationalbiascanbeaddressed/minimizedbyusingiDMCs,puttinginplaceproperprocesses,andmakinguseoftechnology

Regulatory-IndustryStatistics

Page 22: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

22

“Byfailingtoprepare,youarepreparingtofail.”

- BenjaminFranklin

22YJemiai– 26Sep2017 Regulatory-IndustryStatistics

Page 23: Sample Size Re-Estimation: Controlling the Type-1 Error Regulatory-Industry Presentation - Y Jemiai.pdf1. Use a weighted statistic with pre-specified weights Y Jemiai –26 Sep 2017

23

Thankyou

YJemiai– 26Sep2017 Regulatory-IndustryStatistics