evolution or revolution? the changing data landscape · eduserv mimas other public clouds amazon...

47
A centre of expertise in digital information management www.ukoln.ac.uk UKOLN is supported by: Evolution or revolution? The changing data landscape Dr Liz Lyon, Associate Director, UK Digital Curation Centre Director, UKOLN, University of Bath, UK 2nd DCC Regional Roadshow, Sheffield, March 2011 . This work is licensed under a Creative Commons Licence Attribution-ShareAlike 2.0

Upload: others

Post on 11-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

A centre of expertise in digital information management

www.ukoln.ac.uk

UKOLN is supported by:

Evolution or revolution? The changing data landscape

Dr Liz Lyon, Associate Director, UK Digital Curation Centre Director, UKOLN, University of Bath, UK

2nd DCC Regional Roadshow, Sheffield, March 2011

.

This work is licensed under a Creative Commons Licence Attribution-ShareAlike 2.0

Page 2: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

“Data sets are becoming the new instruments of science”

Dan Atkins, Univ Michigan

Page 3: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Digital data as the new special collections?

Sayeed Choudhury, Johns Hopkins

Page 4: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Research data : institutional

crown jewels?

http://www.flickr.com/photos/lifes__too_short__to__drink__cheap__wine/4754234186/

Page 5: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Perspectives •! Environmental scan

–! Scale and complexity –! Infrastructure –! Open science

•! Policy –! Funders –! Institutions –! Ethics & IP

•! Practice Challenges –! Storage –! Incentives –! Costs & Sustainability

http://www.flickr.com/photos/thegreenalbum/3997609142/

Page 6: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

“Surfing the Tsunami” Science: 11 February 2011

Page 7: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

““II wwoorrrryy tthheerree wwoonn’’tt bbee eennoouugghh ppeeooppllee aarroouunndd ttoo ddoo tthhee aannaallyyssiiss..”” CChhrriiss PPoonnttiinngg,, UUnniivveerrssiittyy ooff OOxxffoorrdd

“The costs of sequencing DNA has taken a nosedive...and is now dropping by 50% every 5 months”.

“A single sequencer can now generate in a day what it took 10 years to collect for the Human Genome Project”.

“The 1000 Genomes Project generated more DNA sequence data in its first 6 months than GenBank had accumulated in its entire 21 year existence”.

Page 8: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

“the amount of data generated worldwide...is growing by 58% per year; in 2010 the world generated 1250 billion gigabytes of data”

The Digital Universe Decade – Are You Ready? IDCC White Paper, May 2010

Page 9: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

PDB GenBank

UniProt Pfam

Spreadsheets, Notebooks Local, Lost

High throughput experimental methods Industrial scale Commons based production Publicly data sets Cherry picked results Preserved

CATH, SCOP (Protein Structure Classification)

ChemSpider

Data collections

Slide: Carole Goble

Page 10: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Complex data pipelines

•! Multiple datasets •! Visualise: Cytoscape •! Workflow: Taverna

Page 11: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

•! Distributed gene expression & clinical traits data

•! Taverna workflows capture the complex model construction process

•! Derive large-scale predictive network models of disease

•! Integrative genomics

Page 12: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

A centre of expertise in digital information management

www.ukoln.ac.uk

Structural Sciences Infrastructure

Page 13: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Infrastructure Roadmap

Cross Organisations

Page 14: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Infrastructure Roadmap

Cross Disciplines

Page 15: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Infrastructure Roadmap

Open Science

Page 16: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact
Page 17: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact
Page 18: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Citizen as

scientist

Page 19: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Validate results data

Page 20: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Patients Participate! Project

Sage Congress San Francisco April 2010

Citizen-patients producing crowd-sourced lay summaries of UK PubMed papers

Page 21: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Policy

Page 22: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Policy

Page 23: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Policy

Page 24: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

!"#$%&'(!"#$%&'()*(+,%%-./.%.,0%1234.526./2+,%7%(89+:/%;+<2,=%3++,>?

Page 25: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

International collaboration around the DCC DMPOnline tool

Page 26: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

INCREMENTAL Project Institutional perspective

•! Creating & organising data •! Storage and access •! Back-up •! Preservation •! Sharing and re-use

The majority of people felt that some form of policy or guidance was needed....

Page 27: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Jeff Haywood, RDMF V October 2010 http://www.dcc.ac.uk/sites/default/files/documents/RDMF/RDMF5/Haywood.pdf

Page 28: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

“While many researchers are positive about sharing data in principle, they are almost universally reluctant in practice. ..... using these data to publish results before anyone else is the primary way of gaining prestige in nearly all disciplines.” INCREMENTAL Project

“Data sharing was more readily discussed by early career researchers.”

Page 29: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Alzheimer’s Disease Neuroimaging Initiative: a unique (open) $60M partnership between

NIH, FDA, universities and drug companies.

“It was unbelievable. Its not science the way most of us have practiced in our careers. But we all realised that we would never get biomarkers unless all of us parked our egos and intellectual property noses outside the door and agreed that all of our data would be public immediately.”

Dr John Trojanowski, University of Pennsylvania

Page 30: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Data is headline news

JISC FoI FAQ

Page 31: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

P4 medicine: Predictive,

Personalised, Preventive,

Participatory. Leroy Hood –

Institute for Systems Biology Your genome is basis for

your medical record

Page 32: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Open data and ethics

Buy a DIY kit? Share your data?

Page 33: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Open data and ethics •! Bring your genes to CAL •! UC Berkeley personalised medicine initiative •! >700 new students have submitted a genetic sample and a consent form •! Aggregate analyses for three genes related to nutrition •! Implications for UK HE students & staff?

Page 34: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Policy Gaps... •! Is Policy disconnected

from Practice? –! Data Sharing –! Data Licensing –! Ethics and Privacy –! Citizen Science &

Public Engagement –! Data Storage,

Selection & Appraisal –! Data Citation and

Attribution

Page 35: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

“Departments don’t have guidelines or norms for personal back-up and researcher procedure, knowledge and diligence varies

tremendously. Many have experienced moderate to catastrophic data loss”

Incremental Project Report, June 2010

http://www.flickr.com/photos/mattimattila/3003324844/

Page 36: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Data storage...

The case for cloud computing in genome informatics. Lincoln D Stein, May 2010

–!Scaleable –!Cost-effective (rent on-demand) –!Secure (privacy and IPR) –!Robust and resilient –!Low entry barrier / ease-of-use –!Has data-handling / transfer /

analysis capability

•! Cloud services?

Page 37: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Your data in the cloud

Page 38: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Janet Brokerage

& Connectivity

Services

Common Cloud Service Bus (CSB)

JISC Community CloudConsortium

Eduserv MIMAS Other

Public Clouds Amazon

AWS Microsoft

Azure

Private Clouds University

A University

B University

C University

D University

E University

F University

G

Community Services

EduBox Disaster Recovery

!"#$%&'()#*%+#

DCC Services

,((-..#/0'120$#

3#

HEFCE UMF cloud infrastructure model : new DCC role

Page 39: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Incentivising data

management

Page 40: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Beyond the PDF Workshop, January 2011

•! Concept of “reproducibility” •! Executable papers •! Data papers •! Links to data, workflows, analyses (GenePattern) within a document •! Post-publication peer review •! Alternative impact metrics : downloads, slide reuse, data citation, YouTube views etc. •! La Jolla Manifesto : guiding principles for digital scholarship

Jodi Schneider, Ariadne, Issue 66, January 2011

Page 41: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact
Page 42: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

4%1%/51-# .%6-(51-+-702-*0.51028#

4%1%#

"5'1#

4%1%/51-#,9:# ;006$-#,9:#

<-.0$=-#10#$%'+5'6#*%6-#

>%=-2'%#?02@A0?#

>)-#2-$%B0'.)5*.#C-1?--'#+%1%#=5%#4%1%/51-#4D:.#?51)#100$.#%2-#(%*1&2-+#C8#1)-#*20=-'%'(-#ED9"F#*20+&(-+#C8#>%=-2'%#

G#

H#

I# J#

K#

L#

M02@A0?#7-1%+%1%#

N02#2-O-225'6#10#+%1%#2-*021-+#5'#1)-#*20=%'%'(-P#

Slide : Peter Li

Page 43: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Sustainability: Who owns? Who benefits? Who selects? Who preserves? Who pays?

Page 44: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

KRDS

Page 45: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Research Outputs

Citations, References

User registration data; Instrument allocation data etc.

Comments, annotations, ratings etc.

Risk assessment data; other sample data

Process & Analyse

Derived Data

Research Concept and/or

Experiment Design

Start Project

Peer-review Proposal

Conduct Experiment Generate, Create,

& Collect Raw Data

Check & Clean Raw Data

Interpret & Analyse

Results Data

Archive, Preservation & Curation (OAIS conformant; Representation Information etc.)

IPR, Embargo & Access Control

Discover, Access, Validate, Reuse

& Repurpose Data

Publish Research

Results Data Derived Data Processed Data Raw Data

Documentation, Metadata & Storage (Reference, Provenance, Context, Calibration etc.)

Acquire Sample

Write Proposal

(include DMP)

Scholarly Knowledge

Write Usage Report

Research Activity Administrative Activity

Curation Activity

Information Flow

KEY:

Peer Review

Prepare Manuscript

Prepare Supplementary

Data

Publications Database

Publication Activity

An Idealised Scientific Research Activity Lifecycle Model

Appraisal & Quality Control

Programs (generate customised software)

Papers, articles, presentations, reports

An Idealised Scientific Research Data Lifecycle Model

Page 46: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Activity e.g. Write proposal, conduct experiment, analyse raw data Key resources to measure e.g. Time spent, staff salary Metrics e.g. Time savings for researcher, times savings for facility, increased output, % data available for re-use Qualitative impacts e.g. Research quality, knowledge transfer to industry

KRDS Activity Model Benefits & Metrics Use Case 1 : National Crystallography Service Use Case 2 : Researcher in the lab

Page 47: Evolution or revolution? The changing data landscape · Eduserv MIMAS Other Public Clouds Amazon AWS Microsoft Azure Private Clouds University A University B ... Alternative impact

Thank you… Research Data Management Forum 6

Planning for Research Data Management: “Meeting funder imperatives” 5-6 May 2011, University of Leicester