introducing statistical inference using randomization methods
DESCRIPTION
Introducing Statistical Inference using Randomization Methods. Todd Swanson & Jill VanderStoep Hope College Holland, Michigan. What is the Randomization Approach?. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/1.jpg)
INTRODUCING STATISTICAL INFERENCE USING RANDOMIZATION METHODS
Todd Swanson & Jill VanderStoepHope College Holland, Michigan
![Page 2: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/2.jpg)
WHAT IS THE RANDOMIZATION APPROACH?
In traditional tests, a theoretical distribution is used to determine how unlikely it would be for an observed statistic to occur under a true null hypothesis.
In randomization tests, we don’t use a theoretical distribution, but use simulation to develop a distribution. We simulate the study under a true null hypothesis. After the simulation, we calculate the statistic of interest. We repeat this many times to develop a distribution that
models the null.
![Page 3: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/3.jpg)
HISTORY
Spring of 2009We began writing a curriculum for
introductory statistics in which inference was introduced through randomization methods.
Fall of 2009The new curriculum was first used in all
introductory statistics sections at Hope College.
Spring 2010 and each semester sinceRevision of curriculum
![Page 4: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/4.jpg)
CHANGES IN PEDAGOGY
Topics are introduced through a brief lecture Students work on activities to learn and
reinforce the topics. Tactile learning (shuffling cards and
flipping coins) to estimate p-valuesComputer based simulations (applets)Collecting data and running experiments
![Page 5: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/5.jpg)
All our classes meet in a computer classroom.
![Page 6: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/6.jpg)
CHANGES IN DATA --- REAL RESEARCH
We try to avoid cute, but impractical illustrations of statistics. We include real data and real research that matters.
Homework problems and case studies also involve real statistical data and research.
Each chapter contains a research paper that students read and respond to questions.
![Page 7: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/7.jpg)
EXAMPLES WE CURRENTLY USE
Can dogs sniff out cancer? Is there an advantage to wearing a certain
color of uniform in Olympic combat sports? Does swimming with dolphins ease
depression symptoms? Can babies tell the difference between
naughty and nice? Does the perceived price of a drug influence
its perceived effect? Can students study better when listening to
music with lyrics or without lyrics?
![Page 8: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/8.jpg)
STUDENT PROJECTS
Students complete two in-depth projects Mid-semester they analyze a large data set
that is provided and give a short presentation in class on their findings.
At the end of the semester the students design a study, do a literature review, collect data, and present their results in class. They also write their results up as a research paper.
![Page 9: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/9.jpg)
SEVEN STEP METHOD
Logic ofInference
Scope ofInference
- Significance- Estimation
- Generalize- Cause/Effect
7. Communicate findings
1. Ask a research question
Research Conjecture
2. Design a study
3. Collect data
4. Explore the data
5. Draw inferences beyond the data
6. Formulate conclusions
![Page 10: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/10.jpg)
EXAMPLE: DAY ONE
Can dolphins communicate abstract ideas? In an experiment done in the 1960s, Doris was
instructed which of two buttons to push. She then had to communicate this to Buzz (who could not see Doris). If both he and Doris picked the correct buttons, both dolphins would get a reward.
In one set of trials, Buzz chose the correct button 15 out of 16 times.
Based on these results, do you think Buzz knew which button to push or was he just guessing?
How might we justify an answer? How might we model this situation?
![Page 11: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/11.jpg)
EXAMPLE: DAY ONE
The students, with a little prompting, will quickly come up with the idea of flipping a coin 16 times, count the number of times heads, and repeat this process many times.
The students flip coins and pool their results. We then use a computer applet to quickly
simulate many repetitions of coin flips.
![Page 12: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/12.jpg)
ORIGINAL CONTENT
For the first two years we divided the course into two parts.
The first half of course was based on randomization methods and second half was based on traditional methods.
![Page 13: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/13.jpg)
ORIGINAL CONTENTUNIT 1: RANDOMIZATION METHODS
Chapter 1: Introduction to Statistical Inference: One proportion Coin flips and applets are used to model
null Chapter 2: Comparing Two Proportions
Permutation tests are introduced using playing cards and Fathom
Chapter 3: Comparing Two MeansContinued use of permutation tests with
cards and Fathom. Chapter 4: Correlation and Regression
![Page 14: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/14.jpg)
ORIGINAL CONTENTUNIT 2: TRADITIONAL METHODS
Chapter 5: Correlation and RegressionConfidence Intervals IntroducedPower (strength of evidence) as it relates
to sample size, significance level, and population correlation
Chapter 6: Comparing MeansTwo-sample t-test and ANOVA
Chapter 7: Comparing ProportionsUsing normal distribution and chi-square
Chapter 8: Tests of a Single Mean and ProportionAlso included chi-square goodness of fit
![Page 15: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/15.jpg)
THINGS WE LIKED ABOUT OUR CURRICULUM
Students gained a deeper understanding of inference. Results from CAOS tests were compared to those
done with our traditional course. We were able to put more real research into
our curriculum Case studies, research articles, homework,
examples. A mid-semester project could focus on
inference instead of focusing on descriptive statistics. By mid-semester we were in some ways in a similar
place as we used to be at the end of the semester.
![Page 16: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/16.jpg)
THINGS THAT NEEDED IMPROVEMENT
We had a little trouble getting through all the material.We used a lot more activities and less
lecture. Understanding confidence intervals
needed improvement.Confidence intervals were not introduced
until the second half of the course. In the end, some ideas behind the
randomization methods were forgotten.
For technology we used applets, Fathom, and SPSS.
![Page 17: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/17.jpg)
UPDATED CONTENT
Chapter 1: Introduction to the Statistical Investigative Process One proportion test using randomization
methods focusing on process probabilities. Chapter 2: Random Samples and Variability
Still focusing on a single proportion. Sampling from populations, Normal-based
method, Confidence Intervals Chapter 3: Comparing Two Proportions
Permutation tests and traditional tests and confidence intervals.
Experiments introduced.
![Page 18: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/18.jpg)
UPDATED CONTENT
Chapter 4: Correlation and Regression Scatterplots, Correlation, and Regression Permutation and traditional test for correlation.
Chapter 5: Comparing Means Two-sample tests, paired data, single mean. Permutation tests and traditional methods Confidence intervals
Chapter 6: Comparing Multiple Group Means and Proportions Permutation Test for multiple means and ANOVA Chi-square test for association and goodness-of-
fit
![Page 19: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/19.jpg)
THINGS THAT WENT WELL
Students easily used randomization methods for their final project when conditions weren’t met to perform traditional tests
Better understanding of confidence intervals and how they related to tests of significance
![Page 20: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/20.jpg)
THINGS THAT NEED IMPROVEMENT
Interpretation of confidence intervals. We still have a lot of examples that use data
collected from Hope College students. Led to some non-creative student projects that
used surveys of Hope students about college things: GPA, Greek life, GPA, caffeine consumption, etc.
We want students to think more broadly.
![Page 21: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/21.jpg)
ANOTHER MAJOR UPDATE
We are in the midst of another major update in which we basically follow the same order as we did this past fall.
We are spending more time at the beginning laying out the ground work.
More emphasis on scope of conclusions. More examples from real research. More use of applets for randomization as well
as traditional tests.
![Page 22: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/22.jpg)
A WORK IN PROGRESS
We will continue to revise our materials this year.
Besides the two of us working on this project, we also have:Nathan Tintle, Dordt CollegeBeth Chance, CalPolyAllan Rossman, CalPolySoma Roy, CalPolyGeorge Cobb, Mt Holyoke
![Page 23: Introducing Statistical Inference using Randomization Methods](https://reader035.vdocuments.site/reader035/viewer/2022062801/56814325550346895daf8c19/html5/thumbnails/23.jpg)
THANKS!
More information can be found at www.math.hope.edu/isi
Email Todd: [email protected] Jill: [email protected]