1 practical statistics for particle physicists cern academic lectures october 2006 louis lyons...

35
1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford [email protected]. uk

Post on 20-Jan-2016

223 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

1

Practical Statistics for Particle Physicists

CERN Academic Lectures

October 2006

Louis Lyons

Oxford

[email protected]

Page 2: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

2

Topics

1) Introduction

Learning to love the Error Matrix

2) Do’s and Dont’s with Likelihoods

3) χ2 and Goodness of Fit

4) Bayes, Frequentism and Limits

5) Discovery and p-values

Page 3: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

3

Books

Statistics for Nuclear and Particle Physicists Cambridge University Press, 1986

Available from CUP

Errata in these lectures

Page 4: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

4

Other Books

Page 5: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

5

Page 6: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

6

Page 7: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

7

Page 8: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

8

Page 9: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

9

Page 10: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

10

Page 11: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

11

Page 12: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

12

Relevant for Goodness of Fit

Page 13: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

13

Page 14: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

14

Page 15: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

15

Page 16: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

16

Gaussian = N(r, 0, 1)

Breit Wigner = 1/{π * (r2 + 1)}

Page 17: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

17

Learning to love the Error Matrix

• Introduction via 2-D Gaussian

• Understanding covariance

• Using the error matrix

Combining correlated measurements

• Estimating the error matrix

Page 18: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

18

Element Eij - <(xi – xi) (xj – xj)>

Diagonal Eij = variances

Off-diagonal Eij = covariances

Page 19: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

19

Page 20: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

20

Page 21: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

21

Page 22: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

22

Page 23: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

23

Page 24: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

24

Page 25: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

25

Page 26: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

26

Page 27: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

27

Page 28: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

28

Page 29: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

29

Page 30: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

30

Small error

Example: Lecture 3

xbest outside x1 x2

ybest outside y1 y2

Page 31: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

31

Page 32: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

32

Page 33: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

33

Page 34: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

34

Conclusion

Error matrix formalism makes life easy when correlations are relevant

Page 35: 1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford l.lyons@physics.ox.ac.uk

35

Next time: Likelihoods

• What it is

• How it works: Resonance

• Error estimates

• Detailed example: Lifetime

• Several Parameters

• Extended maximum L

• Do’s and Dont’s with L