how to easily organize and share neuroimaging data materials/reproducibility - 3...how to easily...

31
How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince Stanford University

Upload: others

Post on 02-Jun-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

How to easily organize and

share neuroimaging dataChris GorgolewskiCenter for Reproducible Neuroscince

Stanford University

Page 2: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Neuroimaging data sharing hierarchy

Poldrack and Gorgolewski, 2014

Page 3: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Just coordinates?

• Databases such as Neurosynth or BrainMap rely on peak coordinates reported in papers (only strong effects)

Page 4: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Are we throwing money away?

Page 5: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince
Page 6: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

NeuroVault.orgsimple data sharing

•Minimize the cost!

•We just want your statistical maps with minimum description (DOI)

• If you want you can put more metadata, but you don’t have to

•We streamline login process (Google, Facebook)

Page 7: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

NeuroVault.org

Gorgolewski, et al., submitted

Page 8: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Benefits - visualisation

Page 9: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Benefits - decoding

Page 10: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Benefits - other

•Private collections

•Multiple contributors to one collection

•Sharable persistent URLs

•Viewer embeddable on your labs website or your private blog

• Improved exposure of your research

• Improved reusability of your results

Page 11: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Validation and gains in sensitivity

Page 12: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

NeuroVault for developers

•RESTful API (field tested by Neurosynth)

•Source code available on GitHub

Page 13: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

What is NIDM-Results?

Page 14: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

MAKING DATASHARING countCredit where credit’s due

Page 15: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Quality control

•Share your stat maps!

Complex datasets require

elaborate descriptions

Page 16: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

•Share your stat maps!

How can we appropriately

reward extra effort and risk

related with sharing data?

Page 17: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Solution – data papers

•Authors get recognizable credit for their work.

•Even smaller contributors such as RAs can be included.

•Acquisition methods are described in detail.

•Quality of metadata is being controlled by peer review.

Page 18: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Gorgolewski, Milham, and Margulies, 2013

Page 19: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Where to publish data papers?

•Neuroinformatics (Springer)

•GigaScience (BGI, BioMed Central)

•Scientific Data (Nature Publising Group)

•F1000Research (Faculty of 1000)

•Data in Brief (Elsevier)

•Journal of Open Psychology Data (Ubiquity press)

Page 20: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince
Page 21: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince
Page 22: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince
Page 23: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

What makes a good data paper?

•Clear and accurate description of the acquisition protocol.

•Good data organization.

•Ease of access to data.

•Data quality description.

•Fair credit attribution.

Page 24: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

How to improve the impact of your dataset?

•Provide preprocessed data.

•Reach out to your peers…

•…and people outside of your field (ML)

•Build a community around the data.

Page 25: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

StudyForrest.org

Page 26: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Repositories

•Field specific

•OpenfMRI.org

•FCP/INDI (must include resting state fMRI)

•COINS

•Field agnostic

•DataVerse (Harvard)

•Figshare (only small datasets)

•DataDryad (fees may apply)

Page 27: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

OpenfMRI

•Will host any dataset that has a task based fMRI component

•No fees

•Curated and uncurated datasets

•Recommended by many journals (including Scientific Data)

Page 28: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Prepare in advance

•Make sure your consent form includes data sharing

•Decide which database you want to send your data to in advance

•Organize your data according to their requirements

•Work on anonymized data as much as you can

Page 29: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Brain Imaging Data Structure

bids.neuroimaging.io

Page 30: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Ultimate consent form

• Inform participants about your intention to share data

•Explain the benefits

•Discuss the risks

open-brain-consent.readthedocs.org

Page 31: How to easily organize and share neuroimaging data Materials/Reproducibility - 3...How to easily organize and share neuroimaging data Chris Gorgolewski Center for Reproducible Neuroscince

Acknowledgements

Russell A. Poldrack

Jean-Baptiste Poline

Yannick Schwarz

Tal Yarkoni

Michael Milham

Daniel Margulies

Yannick Schwartz

Gael Varoquox

Joseph Wexler

Gabriel Rivera

Camile Maumet

Vanessa Sochat

Thomas Nichols

MPI CBS Resting state group

Poldrack Lab

INCF Data Sharing Task Force