reproducibility initiative strata rx - ignite

20
Elizabeth Iorns, Ph.D. CEO, Science Exchange CREATING A REPRODUCIBILITY CULTURE

Upload: william-gunn

Post on 26-Jun-2015

111 views

Category:

Science


2 download

DESCRIPTION

Mendeley Talk on Reproducibility

TRANSCRIPT

Page 1: Reproducibility Initiative Strata RX - Ignite

Elizabeth Iorns, Ph.D.

CEO, Science Exchange

CREATING A

REPRODUCIBILITY

CULTURE

Page 2: Reproducibility Initiative Strata RX - Ignite

To survive professionally, scientists feel the need to publish as many papers as

possible, and to get them into high-profile journals. And sometimes they cut

corners or even commit misconduct to get there.

Too many sloppy mistakes are creeping into scientific papers. Lab heads must

look more rigorously at the data — and at themselves.

This is one of medicine's dirty secrets: Most results, including those that

appear in top-flight peer-reviewed journals, can't be reproduced.

Page 3: Reproducibility Initiative Strata RX - Ignite

Separate the wheat from the chaff

Page 4: Reproducibility Initiative Strata RX - Ignite

Robust Research

Less Robust Research

Page 5: Reproducibility Initiative Strata RX - Ignite

We didn’t see that a target is

more likely to be validated if it

was reported in ten publications

or in two publications NATURE REVIEWS DRUG DISCOVERY 10, 712 (SEPTEMBER 2011)

Page 6: Reproducibility Initiative Strata RX - Ignite

Either the results were reproducible

and showed transferability in other

models, or even a 1:1 reproduction of

published experimental procedures

revealed inconsistencies between

published and in-house data NATURE REVIEWS DRUG DISCOVERY 10, 712 (SEPTEMBER 2011)

Page 7: Reproducibility Initiative Strata RX - Ignite
Page 8: Reproducibility Initiative Strata RX - Ignite
Page 9: Reproducibility Initiative Strata RX - Ignite

HOW IT WORKS

1. Researchers submit studies for independent validation

2. Scientific Advisory Board reviews studies

3. Experiments are matched to qualified scientific service

providers in a blind manner

4. Scientific Advisory Board assesses the reproducibility of

the result

Page 10: Reproducibility Initiative Strata RX - Ignite

RESEARCHERS Core

Facilities

ADVISORY

BOARD

INCENTIVES Public

Support

Page 11: Reproducibility Initiative Strata RX - Ignite
Page 12: Reproducibility Initiative Strata RX - Ignite

RESEARCHERS Core

Facilities

ADVISORY

BOARD

INCENTIVES Public

Support

Page 13: Reproducibility Initiative Strata RX - Ignite

Scientific Advisory Board

George Robertson

Dalhouise University

Elizabeth Iorns

Science Exchange

John Ioannidis

Stanford University

Bernard Munos

InnoThink

Brian Nosek

University of Virginia

Heather Piwowar

Duke University

Sitta Sittampalam

NIH NCATS

Victoria Stodden

Columbia University

Bruce Booth

Atlas Ventures

Lee Ellis

MD Anderson

Page 14: Reproducibility Initiative Strata RX - Ignite

RESEARCHERS Core

Facilities

ADVISORY

BOARD

INCENTIVES Public

Support

Page 15: Reproducibility Initiative Strata RX - Ignite
Page 16: Reproducibility Initiative Strata RX - Ignite

RESEARCHERS Core

Facilities

ADVISORY

BOARD

INCENTIVES Public

Support

Page 17: Reproducibility Initiative Strata RX - Ignite

INCENTIVES

Guaranteed publication in PLOS

ONE Reproducibility Collection

Acknowledgement of reproduction

in journals and online repositories

Certificate of Reproducibility to help

with commercialization of research

Page 18: Reproducibility Initiative Strata RX - Ignite

RESEARCHERS Core

Facilities

ADVISORY

BOARD

INCENTIVES Public

Support

Page 19: Reproducibility Initiative Strata RX - Ignite
Page 20: Reproducibility Initiative Strata RX - Ignite

CREATING A REPRODUCIBILITY CULTURE

[email protected]