share & flourish workshop, leiden, august 2014

HOW CAN JOURNALS HELP ENCOURAGE DATA SHARING?

Varsha KhodiyarData Publishing Manager, F1000Research

Share and Flourish workshopLeiden, August 2014

BIG DATA

BIG DATA

SMALL DATASETS (THE LONG-TAIL OF SCIENCE)

http://robertanagourney.wordpress.com/2014/07/09/with-cancer-dont-ask-the-experts/

• Number of samples/patients?

• Statistical power?

• Supports prevailing hypothesis?

RESEARCH BECOMES HARDER TO ACCESS WITH AGE

“• We examined the availability of data from 516 studies between 2 and 22 years old

• The odds of a data set being reported as extant fell by 17% per year

• Broken e-mails and obsolete storage devices were the main obstacles to data sharing

• Policies mandating data archiving at publication are clearly needed”

Vines TH. et al. The availability of research data declines rapidly with article age. Curr Biol 24, 94–7 (2014)

OPEN AND POST-PUBLICATION PEER REVIEW@vkf1000 | @f1000research

• Approved

• Approved with reservations

• Not approved

REFEREE REPORTS ARE PUBLIC

All referee names are visible.

Referee reports and other comments are visible to everyone.

Articles with sufficient positive evaluations indexed in PubMed, Scopus and Embase.

or

PUBLICATION OF ALL GOOD SCIENCE

DATA PAPERS

As a field we have the opportunity to compete or collaborate. I hope that these data facilitate

cross-laboratory collaboration where two groups are reticent to share their own data…I applaud the authors for this unprecedented act of scientific altruism. I hope this will be a

platform that accelerates our understanding of the entorhinal-hippocampal circuitry through

collaboration.

YOU'RE JUST SALAMI SLICING TO CREATE MORE PAPERS...

WHERE’S THE SPACE FOR DATA, METHODS AND AUTHORS?

DATA AND METHODS ARE REQUIRED TO ALLOW REPLICATION

“[W]e evaluated the replication of data analyses in 18 articles on microarray-based gene expression profiling published in Nature Genetics in 2005–2006...We reproduced two analyses in principle and six partially or with some discrepancies; ten could not be reproduced. The main reason for failure to reproduce was data unavailability.”

Ioannidis JPA. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149–55 (2009)

DO DATA PRODUCERS NEED ADDITIONAL CREDIT?

Traditional research paper byISS, MSD and JWH

Author contributionsISS and JWH designed the experiments. ISS with help from MSD carried out the experiments. ISS and JWH prepared the manuscript. All authors approved the final content of the manuscript.

DATA FULLY INTEGRATED WITH RESEARCH PAPERS

DATA PLOTTING TOOL

DYNAMIC FIGURES

SOFTWARE IS IMPORTANT TOO

Archive published source code with a DOI

Update article after it has passed peer review e.g. with release of version of software

Data and Software availability section

Request the inclusion of source code for software developed for the project and required to analyse/view the data or replicate the work

SOFTWARE AVAILABILITY SECTION

HOW CAN JOURNALS HELP ENCOURAGE DATA SHARING?

Email: varsha.khodiyar@f1000.com

Twitter: @vkf1000 / @f1000research