mni open science symposium john wilbanks · mni open science symposium john wilbanks. accessibility...

65
MNI Open Science Symposium John Wilbanks

Upload: others

Post on 03-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

MNI Open Science Symposium

John Wilbanks

Page 2: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 3: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 4: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 5: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 6: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 7: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

“massive incrementalism”

Page 8: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

heather piwowar

@researchremix

Between 0.6 and 5

published papers per

$100k funding

8

researchremix.wordpress.com/2011/02/23/rough-estimate-of-papers-per-dollar/

Page 9: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 10: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

propagation of uncertainty

Page 11: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

within a statistical experiment…

Page 12: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

at the “claim” level…

Page 13: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 14: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 15: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 16: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 17: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 18: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 19: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 20: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 21: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 22: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 23: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 24: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

crc subtyping consortium

Page 25: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

A

B

C

D

E

F

1

2

3

4

5

6

expert team data subtype

crc subtyping consortium

Page 26: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

A

B

C

D

E

F

1

2

3

4

5

6

...

expert team data subtype

crc subtyping consortium

Page 27: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

doi:10.1038/nm.3967

crc subtyping consortium

Page 28: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

openconsensus model

Page 29: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

public / private partnership between NIH, 10 biopharmaceutical companies

and several non-profit organizations

accelerating medicines partnership

Page 30: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

coordinate sharing of early-phasetarget identification insights

accelerating medicines partnership

Page 31: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accelerating medicines partnership

Page 32: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 33: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

opendrug targets +

evidence

Page 34: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

epistemically diverse findings

Page 35: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

triangulate to better bets

Page 36: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

triangulate to better bets

Page 37: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 38: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

openprivacy

preserving

Page 39: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

field without built-in inertia

Page 40: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

first 6 months

16,585 participants consented

14,684 participants enrolled

9,520 agreed to ‘share broadly’

1,087 self reported PD diagnosis

mPower

Page 41: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

dimensionality of lived experience

Page 42: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

62 y old Man 67 y old Woman

invisible impacts made visible

Page 43: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

the reality of personal health

Page 44: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

benchmark as peer review

Page 45: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 46: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 47: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 48: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 49: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

accessibility

degrees of freedom

closed + restricted

model to data

sandbox

collaboration

closed

open

Page 50: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 51: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

Digital Mammography Dream challenge Multiple Myeloma Dream Challenge

model-to-data for necessarily closed data

Page 52: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

Guinney and Saez-Rodriguez Nature Biotechnology volume 36, pages 391–392 (2018)

Traditional Data to Modeler Model to Data

- Read-only access to directories

- No network access

- Time quota limits

- Size limit to log files

Page 53: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 54: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

a. more massive incrementalism.

Page 55: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 56: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 57: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

b. the stacks.

Page 58: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 59: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 60: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

c.institutional change

Page 61: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 62: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 63: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed
Page 64: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

better science, together

Page 65: MNI Open Science Symposium John Wilbanks · MNI Open Science Symposium John Wilbanks. accessibility degrees of freedom closed + restricted model to data sandbox collaboration closed

thank you

@[email protected]