bayesian hypothesis testing using jasp · 2015-03-14 · spss goal 1, alternative to spss spss is...

24
JASP Bayesian Hypothesis Testing Using JASP Jonathon Love Ravi Selker Josine Verhagen Eric-Jan Wagenmakers Sacha Epskamp Richard Morey Marten Marsman Quentin Gronau Jeff Rouder Tahira Jamil Dora Matzke Alexander Ly

Upload: others

Post on 06-Apr-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Bayesian Hypothesis Testing Using JASP

Jonathon Love Ravi Selker

JosineVerhagen

Eric-JanWagenmakers

SachaEpskamp Richard Morey

MartenMarsman

QuentinGronau

Jeff Rouder

Tahira Jamil

Dora Matzke

Alexander Ly

Page 2: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Software for performing statistical analysis

3 Goals

– To be a free and open alternative to SPSS

– To provide the latest Bayesian analyses in an accessible way

– To provide a general statistical platform for publishing analyses with rich UIs

Page 3: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Workshop program:● 1100 – 1115: Jonathon Love

– A general introduction to JASP

● 1115 – 1145: EJ Wagenmakers– An introduction to Bayes factors

– T-Tests

● 1145 – 1215: Richard D. Morey– ANOVA

● 1215 – 1220: Jonathon Love– Future development of JASP

Page 4: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per
Page 5: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

SPSS

Goal 1, alternative to SPSS

● SPSS is expensive– Costs the University and Scientific Communities $50-100 million per year

● SPSS does not implement the latest analyses

– such as Bayesian analyses

● SPSS is a tool used in science, for which the scientific community has very little say in the direction it is developed– We have a body of professionals who cannot move forward with science

● SPSS is not open source, no peer review● SPSS is unpleasant to use

Page 6: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

In contrast

● Free

● Open source

● Designed to be familiar to users of SPSS

Page 7: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Demo

● Big 5 Questionnaire(Dolan, Oort, Stoel, Wicherts, 2009)

● Scores for

– Openness

– Contentiousness

– Extraversion

– Agreeableness

– Neuroticism

Page 8: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Demo

Innovations here:

● Interactivity and immediate feedback● Copy and paste APA formatted tables

● Can return to an earlier analysis, and see exactly what options were used (think peer review)

Goal 1● A compelling alternative to SPSS

Page 9: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Goal 2

● Provide the latest Bayesian analyses in an accessible way

– Bayesian T-Tests

– Bayesian ANOVAs

– Bayesian Linear regression● Morey & Rouder's BayesFactor package

– Bayesian Correlation● Alexander Ly

– Bayesian Contingency tables● Tahira Jamil

Page 10: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

T-Test

● Topolinski and Sparenberg (2012) hypothesized that “clockwise movements induce psychological states of temporal progression and an orientation toward the future and novelty”

● Participants rotated paper towels one of two directions, while answering a Big 5 questionnaire

Page 11: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Demo

Page 12: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Demo

● Individuals rotating clockwise scored more highly on the Openness dimension than those rotating them counter clockwise (p < .05)

● This attracted some criticism

● Eric-Jan Wagenmakers, sought to answer this pressing and highly important debate with a replication study

● We will too!

Page 13: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Goal 2

● JASP provides Bayesian equivalents of many standard statistical tests

Page 14: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

Goal 3● To provide a general statistical platform for publishing

analyses with rich UIs– Alternative platform to R

– R is an empowering platform for developing analyses

– But for users of analyses:● R has a steep learning curve● R can be very time consuming to use● R is difficult to read and peer review● R is error prone

Page 15: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

● JASP solves these issues by facilitating rich UIs

● JASP aims to be a platform which bridges users and developers

● Provide a plugin framework for incorporating analyses into JASP

– API

– UI definition / mapping

– App store

● Still in development (6 months away)

Page 16: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

● SEM by Mijke and Sacha

● Political Democracy Example from Bollen's 1989 book

# latent variable definitions ind60 =~ x1 + x2 + x3 dem60 =~ y1 + y2 + y3 + y4 dem65 =~ y5 + y6 + y7 + y8 # regressions dem60 ~ ind60 dem65 ~ ind60 + dem60 # residual covariances y1 ~~ y5 y2 ~~ y4 + y6 y3 ~~ y7 y4 ~~ y8 y6 ~~ y8

Page 17: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

To sum up

– A free and open alternative to SPSS

– Provides the latest Bayesian analyses in an accessible way

– On its way to becoming a general statistical platform for publishing analyses with rich UIs

Page 18: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

JASP 0.6 available for

Windows, Mac OS X, Linux

jasp-stats.org

JASP 0.6.5 available within a week

Source code available on GitHub

github.com/jasp-stats

Page 19: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

JASP

● General questions?

● Over to EJ

Page 20: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Future Ambitions

JASP's development is on-going

● Add the remaining common analyses

– Logistic regression, etc.

● Add the Bayesian equivalents

● Add a good help system, examples

● Add data entering, editing, cleaning and restructuring facilities

Page 21: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Future Ambitions

JASP's development is on-going

● Add facilities for the development of 3rd party analyses

● Add support for processing in “the cloud”, supercomputer resources

– Using a supercomputer should be as simple as clicking a checkbox

● Empower methodologists to publish analyses in an accessible way

● All open source

Page 22: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Future Ambitions

Educational resources

● EJ's 3 volume work

– Introduction to Bayes

– Bayes in JASP

– Bayes in depth

● Development of resources for educators

● MOOC

Page 23: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Future Ambitions

● If you fulfil a teaching role at your institution, consider using JASP, or at least begin the discussion

● Even if your institution hates Bayesianism, and will only use the frequentist stuff

– Using free and open source software is still good for science

– A Bayesian trojan horse

● Invite Jonathon to give a talk at your institution about JASP (he likes to talk)

Page 24: Bayesian Hypothesis Testing Using JASP · 2015-03-14 · SPSS Goal 1, alternative to SPSS SPSS is expensive – Costs the University and Scientific Communities $50-100 million per

Upcoming events

JASP Workshops

● May - APS, New York

● June - SARMAC, Victoria Canada

● August – Two day JASP workshop, Amsterdam

– Registration is open

See website for details: jasp-stats.org