sjs sdi_71 design of statistical investigations stephen senn 7. orthogonal designs two (plus)...
TRANSCRIPT
![Page 1: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/1.jpg)
SJS SDI_7 1
Design of Statistical Investigations
Stephen Senn
7. Orthogonal Designs
Two (plus) Blocking Factors
![Page 2: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/2.jpg)
SJS SDI_7 2
Exp_5 (Again)
• This experiments was run in two sequences– Formoterol followed by salbutamol– Salbutamol followed by formoterol
• Suppose that values in second period tend to be higher or lower than those in first
• Differences formoterol -salbutamol will be affected one way or other depending on sequence
![Page 3: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/3.jpg)
SJS SDI_7 3
Exp_5A Further Factor
• For each PEF reading we have accounted for– the patient it was measured under– the treatment the patient was on
• We have not accounted for the period
• We now look at an analysis that does
![Page 4: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/4.jpg)
SJS SDI_7 4
Exp_5Fitting period
#ANOVA fitting treat and patient# Code factor for period period<-factor(c(rep(1:2,n)))#Perform ANOVAfit3<-aov(pef~patient+period+treat)summary(fit3)multicomp(fit3,focus="treat",error.type="cwe",method="lsd")
![Page 5: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/5.jpg)
SJS SDI_7 5
Exp_5Comparison of 3 Models
> summary(fit1) Df Sum of Sq Mean Sq F Value Pr(F) treat 1 13388.5 13388.46 2.56853 0.1220902Residuals 24 125100.0 5212.50 > summary(fit2) Df Sum of Sq Mean Sq F Value Pr(F) patient 12 115213.5 9601.12 11.65357 0.000079348 treat 1 13388.5 13388.46 16.25053 0.001665618Residuals 12 9886.5 823.88 > summary(fit3) Df Sum of Sq Mean Sq F Value Pr(F) patient 12 115213.5 9601.12 12.79457 0.0000890 period 1 984.6 984.62 1.31211 0.2763229 treat 1 14035.9 14035.92 18.70444 0.0012048
Residuals 11 8254.5 750.41
![Page 6: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/6.jpg)
SJS SDI_7 6
Exp_5: Three Fits95 % non-simultaneous confidence intervals for specified linear combinations, by the Fisher LSD method
critical point: 2.0639 intervals excluding 0 are flagged by '****' Estimate Std.Error Lower Bound Upper Bound salbutamol-formoterol -45.4 28.3 -104 13.1
critical point: 2.1788 Estimate Std.Error Lower Bound Upper Bound salbutamol-formoterol -45.4 11.3 -69.9 -20.9 ****
critical point: 2.201
Estimate Std.Error Lower Bound Upper Bound salbutamol-formoterol -46.6 10.8 -70.3 -22.9 ****
![Page 7: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/7.jpg)
SJS SDI_7 7
Why the Different Estimate?
• Mean difference Salbutamol-Formoterol for 7 patients in seq 1 is -30.71
• Mean difference Formoterol-Salbutamol for 6 patients in seq 1 is -62.50
• The weighted average of these is -45.4
• The un-weighted average is -46.6
![Page 8: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/8.jpg)
SJS SDI_7 8
Weighted
• The weighted average weights the mean difference in a sequence by the number of patients
• Thus the difference from each patient is weighted equally
• This makes sense if there is no period effect.• Why make a distinction between sequences if this
is the case?
![Page 9: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/9.jpg)
SJS SDI_7 9
Un-weighted
• The un-weighted average weights means equally• Since there are more patients in the first sequence
their individual influence is down-weighted.• This makes no sense unless we regard the results
as not exchangeable by sequence• However, if there is a period effect then they are
not exchangeable
![Page 10: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/10.jpg)
SJS SDI_7 10
How the Un-weighted Approach Adjust for Bias
• Suppose there is a difference between period one and two and this difference is additive and equal to .
• Every patient will have their treatment difference affected by
• Those in one sequence will have added.
• Those in other sequence will have subtracted.
• Averaged over the sequences this cancels out
![Page 11: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/11.jpg)
SJS SDI_7 11
How the Variances are Affected
1 2
1 2
2 2
1 2
1 2
2 2 221 2
1 2 1 2
22 1 2
1 2 1 21 2
var , var
ˆ ,2
1ˆvar
4 4
1, ,
2 4 4
d dseq seq
seq seq
d d dd
d
d dn n
d dn n n
n n
n n n n n
n n n niff n n n n
n n n
![Page 12: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/12.jpg)
SJS SDI_7 12
The Effect of Modelling In general the variance of a treatment contrast may be expressed as the product of two factors: q and 2.
For example, for the common two-sample t case
q = (1/n1 + 1/n2) and 2 is the variance of the original observations within treatment groups.
If further terms are added to the model the value of q will at best remain the same but in general will increase.
If these terms are explanatory, however, they will reduce the value of 2 .
![Page 13: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/13.jpg)
SJS SDI_7 13
Variances in the Linear Model 12
1,1 1,2 1, 1
2,1 2,2, ,
1,1 1, 1
2,
ˆvar( ) ,
,
ˆvar( ) ,
k
i j j i
k k k
h h h
a a a
a aa a
a a
q q a
A A X X
A
![Page 14: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/14.jpg)
SJS SDI_7 14
Efficient Experimentation and Modelling
• Two go hand in hand
• Choose explanatory factors for model– Will reduce variance, 2.
• Design experiment taking account of model– Minimise adverse effect on q.
• Randomise– Subject to constraints above
![Page 15: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/15.jpg)
SJS SDI_7 15
Exp_5 and Efficiency
• In this case there were 14 patients initially• Split 7 and 7 by sequence• But one (patient 8) dropped out• Hence the design is unbalanced• Note that balance is not the be all and end all• 7 and 6 is better than 6 and 6, although 6 and 6 is
balanced
![Page 16: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/16.jpg)
SJS SDI_7 16
Efficiency in General
• Balance in some sense produces efficiency
• Equal numbers per treatment etc– Provided all contrasts are of equal interest
• Treatments orthogonal to blocks
• Construct treatment plan if possible so that this happens
![Page 17: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/17.jpg)
SJS SDI_7 17
Latin Squares
• Suppose that we have two blocking factors each at r levels.
• We also have r treatments and we wish to allocate these efficiently.
• How should we do this?
• One solution is to use a so-called Latin Square
![Page 18: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/18.jpg)
SJS SDI_7 18
More Than one Blocking Factor- Examples
• Agricultural field trials– Rows and columns of a field
• Cross-over trials– Patients and periods
• Lab experiments– Technicians and days
• Fuel efficiency– Drivers and cars
![Page 19: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/19.jpg)
SJS SDI_7 19
Latin Squares Examples
2 23 3
4 4
5 5
A B C DA B C
A B B D A CB C A
B A C A D BC A B
D C B A
A B C D E
B C E A D
C A D E B
D E B C A
E D A B C
![Page 20: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/20.jpg)
SJS SDI_7 20
Latin Square5 x 5
Latin Square: 5 levels. B A C D E A E B C D C B D E A D C E A B E D A B C
Produced by SYSTAT
Each treatment given once to each row and once to each column
Completely orthogonal
No adverse effect on q
![Page 21: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/21.jpg)
SJS SDI_7 21
Design Matrices and Orthogonality
• Such orthogonality in design is reflected in the “design matrices” used for coding for the linear model.
• This is illustrated on the next few slides for the case of a 4 x 4 Latin square.
• Four subjects are treated in four periods with four treatment.
• The coding of the design matrix in Mathcad is illustrated.
![Page 22: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/22.jpg)
SJS SDI_7 22
Exp_7
• A four period cross-over in four subjects
• The four sequences chosen form a Latin square.
Treatment sequences for designSeq
1
4
3
2
2
3
1
4
3
2
4
1
4
1
2
3
![Page 23: SJS SDI_71 Design of Statistical Investigations Stephen Senn 7. Orthogonal Designs Two (plus) Blocking Factors](https://reader035.vdocuments.site/reader035/viewer/2022062404/5515ca5e550346c6278b478a/html5/thumbnails/23.jpg)
SJS SDI_7 23
Acrobat Document