the data flood: implications for data stewardship and the ... · the data flood: implications for...
TRANSCRIPT
![Page 1: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/1.jpg)
Margaret LeinenVice Chancellor for Marine Science, UC San Diego Director, Scripps Institution of Oceanography
The data flood: Implications for data stewardship and the culture of discovery
DataONE WebinarSeptember 8, 2015
![Page 2: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/2.jpg)
observation (data) is the first step toward understanding
![Page 3: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/3.jpg)
Five exabytes of content were created between the birth of the world and 2003. In 2013, five exabytes of content were created each day.
- ACI Information Group
![Page 4: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/4.jpg)
Data growth is poised to exceed Moore’s Law growth:average growth = 64%, with many areas growing faster
Ion Stoica, AmpLab Blog, 2013
![Page 5: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/5.jpg)
CONSEQUENCES OF THE FLOOD
![Page 6: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/6.jpg)
We’ve gotten used to not thinking about storage as a problem, but…
![Page 7: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/7.jpg)
![Page 8: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/8.jpg)
![Page 9: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/9.jpg)
We’ve also gotten in the habit of thinking of data as the flood of automatically collected digital data, but…
![Page 10: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/10.jpg)
What do we need to preserve and for how long?
![Page 11: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/11.jpg)
What do we need to preserve and for how long?
![Page 12: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/12.jpg)
Susan Solomon’s ‘The Coldest March’
• Combined – meteorological data – Logbooks and journals of Scott’s expedition – Current modeling and understanding
• Insights about the climatic forces influencing history
• We need to keep making this possible
![Page 13: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/13.jpg)
THE IMPACT ON CULTURE OF SCIENCE
![Page 14: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/14.jpg)
But we deal with irreproducible events and observations
“The ultimate measure of success is the replicability of science” - Coalition for Publishing Data in the Earth and Space Sciences (COPDESS)
![Page 15: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/15.jpg)
![Page 16: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/16.jpg)
What does reproduceability mean in the geosciences with respect to data?
![Page 17: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/17.jpg)
• Online community directory of appropriate community repositories • Promulgate metadata information and domain standards • Promote education of researchers in data management • A working committee to update and curate this directory • Reference data sets using the Joint Declaration of Data Citation Principles • Include in research papers concise statements indicating where data reside • Promote and implement links to data sets in publications and
corresponding links to journals in data facilities• Promote use of other relevant community permanent identifiers for
samples (IGSN), researchers (ORCID), and funders and grants (FundRef).• Develop workflows within the repositories that support the peer review
process
COPDESS Statement of Commitment
![Page 18: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/18.jpg)
Signatories• American Astronomical Society• American Geophysical Union• American Meteorological Society • Woods Hole Oceanographic Institution (BCO-DMO)• Center for Open Science• CLIVAR and Carbon Hydrographic Data Office) • COOPEUS• Community Inventory of EarthCube Resources• CUAHSI• Continental Scientific Drilling Coordination Office• Council of Data Facilities • Dryad• Elsevier• European Geophysical Union• Scripps Institution of Oceanography• Springer • ICSU World Data System • Geological Society of London
•Geochemical Society • Geological Society of America• Incorporated Research Institutions for Seismology•Integrated Earth Data Applications (IEDA)• John Wiley and Sons• LacCore: National Lacustrine Core Facility• Magnetics Information Consortium (MagIC)• Mineralogical Society of America• Neotoma Paleoecology Database• National Snow and Ice Data Center• Nature Publishing Group• OpenTopography• Paleonotological Society• Proceedings of the National Academy of Sciences• Rolling Deck to Repository (R2R) Program• Science • UNAVCO
• UNAVCO
![Page 19: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/19.jpg)
Reproduceability in the field sciences
A May 2015 workshop sponsored by the Laura and John Arnold Foundation, AAAS/Science, American Geophysical Union, Ecological Society of America
![Page 20: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/20.jpg)
Annotation and data
![Page 21: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/21.jpg)
Annotation UniversitiesWhat to Preserve Scientific Societies
discussiontaggingbookmarking note taking
• Not interoperable • Not open source • Not standards based
• Not able to be used everywhere
• Not federated
![Page 22: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/22.jpg)
targetaddress message
![Page 23: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/23.jpg)
http://domain/path
![Page 24: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/24.jpg)
Annotations are like the web
InteroperableDecentralizedCharacterized by open source implementations
![Page 25: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/25.jpg)
Other kinds of data
![Page 26: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/26.jpg)
New trends merging ideas about data with those about samples
Challenges for universities and others who have sample collections
![Page 27: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/27.jpg)
![Page 28: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/28.jpg)
![Page 29: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/29.jpg)
![Page 30: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/30.jpg)
Whose responsibility is it to maintain archives?
Challenges for universities and others who have dataarchives and sample collections
Does the responsibility last forever?
Many universities are losing the ability to steward these collections/archives appropriately
![Page 31: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/31.jpg)
Whose responsibility is it to maintain archives?
Government data archives
Already seeing cracks in the ability of government archivesto morph to new technology, accommodate innovation in systems and structures
![Page 32: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/32.jpg)
Data and scholarship
![Page 33: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/33.jpg)
The emergence of doi’s making data sets referenceable
Peer reviewed publications emphasizing data sets
Challenges for scholarly advancement Little consensus on when data sets constitute scholarship
![Page 34: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/34.jpg)
![Page 35: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/35.jpg)
Annotation UniversitiesWhat to Preserve Scientific Societies
![Page 36: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/36.jpg)
Annotation UniversitiesWhat to Preserve Scientific Societies
NOAA Atlas NESDIS 72 WORLD OCEAN DATABASE 2013
Timothy P. Boyer, John I. Antonov, Olga K. Baranova, Carla Coleman, Hernan E. Garcia, Alexandra Grodsky, Daphne R. Johnson, Ricardo A. Locarnini, Alexey V. Mishonov, Todd D. O'Brien, Christopher R. Paver, James R. Reagan, Dan Seidov, Igor V. Smolyar, Melissa M. Zweng
Editor: Sydney Levitus Technical Editor: Alexey Mishonov
National Oceanographic Data Center Ocean Climate Laboratory
Silver Spring, MD September 2013
U.S. DEPARTMENT OF COMMERCE Penny S. Pritzker, Secretary
National Oceanic and Atmospheric Administration Kathryn D. Sullivan, Acting Under Secretary of Commerce for Oceans and Atmosphere
National Environmental Satellite, Data, and Information Service Mary E. Kicza, Assistant Administrator
![Page 37: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/37.jpg)
THINKING OF THE FUTURE
![Page 38: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/38.jpg)
Brooks Hanson (AGU Director of Publications):
The publication of the future: “I think the next big step, which the community is really trying to work on with some good initial steps but a long way to go is to really change what a publication is—to make data, code, etc. interoperable and seamlessly part of a publication so that a reader can move back and forth, rerun code; manipulate presentations of data sets.”
![Page 39: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/39.jpg)
![Page 40: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/40.jpg)
![Page 41: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/41.jpg)
![Page 42: The data flood: Implications for data stewardship and the ... · The data flood: Implications for data stewardship and the culture of discovery DataONE Webinar September 8, 2015](https://reader034.vdocuments.site/reader034/viewer/2022042207/5ea9c86b14706c46ef382b6b/html5/thumbnails/42.jpg)