managing data throughout the research lifecycle
DESCRIPTION
Presentation given at University of Northampton, 20th February 2013TRANSCRIPT
Funded by:
This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 2.5 UK: Scotland License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/2.5/scotland/ ; or, (b) send a letter to Creative Commons, 543 Howard Street, 5th Floor, San Francisco, California, 94105, USA.
Managing data throughout the research lifecycle
considerations and pointers to support
University of Northampton, 20th February 2013
Marieke GuyDCC, University of Bath
Today’s Talk…
Managing data throughout the research lifecycle
• What is the research lifecycle?• How do you manage data?• What questions does managing data raise?
What is the research lifecycle?
• Research activity often takes place in stages which form a ‘lifecycle’
• Data is created at points during this lifecycle• The data created has its own lifespan
“Data often have a longer lifespan than the research project that creates them. Researchers may continue to work on data after funding has ceased, follow-up projects may analyse or add to the data, and data may be re-used by other researchers.” UKDA
CREATE DATA
ADD DOCUMENTATION
PLAN
DATA CENTRE
IT
RESEARCHERS
CREATE DATA
ADD DOCUMENTATION
PLANA model to show the activities and people involved in managing data.
Example 1: DCC lifecycle model
Research Process
Example 2: Research360 lifecycle
Example 3: UK Data Archive
Example 4: UK Data Archive
Key ideas from the research lifecycle
• Different research lifecycles suit different researchers• Research is a circular process• Certain stages are likely to be familiar to many
researchers – conceptualisation/planning, creation, active use/documentation, publication etc…
• Certain stages are likely to be familiar to less researchers – sharing, re-use etc…
• Data may be created at many stages during the process (intervention points)
• Data is likely to need management at many stages during the process
4.Publication& Deposit
5.Preservation
& Re-Use
1.Create
2.Active Use
3.Documentation
1. What data will you produce?
2. How will you organise the data?
3. Can you/others understand the data
4. What data will be deposited and where?
5. Who will be interested in re-using the data?
Key Qs from the research lifecycle
“the active management and appraisal of data over the lifecycle of scholarly and
scientific interest”
Data management is part of good research practice
What is data curation?
Manage
Share
Good data management is about making informed decisions
•http://xkcd.com/949
How do you manage data?
Key questions to consider when:- Creating data - Documenting data- Storing data- Sharing data- Preserving data- Planning data management
Examples and pointers to support
Creating data: questions
What formats will you use?- determined by the instruments / software you have to use- common, widespread formats to enable reuse
How will you create your data? - What methodologies and standards will you use?- How will you address ethical concerns and protect participants?- Will you control variations to provide quality assurance?- What external data sets will you use? (See the BL Social Science Collection guide to Management and
Business studies datasets)
Different formats are good for different things- open, lossless formats are more sustainable e.g. rtf, xml, tif, wav - proprietary and/or compressed formats are less preservable but
are often in widespread use e.g. doc, jpg, mp3
May choose one format for analysis then convert
to a standard format for preservation / sharing
Excellent guidance on creating data & managing ethics in:www.data-archive.ac.uk/media/2894/managingsharing.pdf
Creating data: advice
• Unencrypted• Uncompressed• Non-proprietary/patent-encumbered• Open, documented standard• Standard representation (ASCII, Unicode)
Type Recommended Avoid for data sharing
Tabular data CSV, TSV, SPSS portable Excel
Text Plain text, HTML, RTFPDF/A only if layout matters
Word
Media Container: MP4, OggCodec: Theora, Dirac, FLAC
QuicktimeH264
Images TIFF, JPEG2000, PNG GIF, JPG
Structured data XML, RDF RDBMS
Further examples: http://www.data-archive.ac.uk/create-manage/format/formats-table
File formats for long-term access
Documenting data: questions
What information do users need to understand the data?- descriptions of all variables / fields and their values - code labels, classification schema, abbreviations list- information about the project and data creators- tips on usage e.g. exceptions, quirks, questionable results
How will you capture this?
Are there standards you can use?
Dublin Core metadata exampleCreator:Donald Cooper
Role=PhotographerSubject: Shakespeare, William, 1564-1616,
Antony and Cleopatra [LC]Description:Vanessa Redgrave as CleopatraDate: 1973-08-09Type:ImageFormat:JPEGIdentifier:4150 [catalogue no]Source: negative no 235Relation: Antony and Cleopatra: Thompson/73-8
IsPartOfCoverage:Bankside Globe
Role=SpatialRights:Donald Cooper
•http://www.ahds.ac.uk/performingarts
Storing data: questions
What is available to you?
What facilities do you need?- remote access- file sharing with colleagues- high-levels of security
How will the data be backed up?
Storing data: advice
Speak to the Northampton IT Team for advice – TUNDRA2
Remember that all storage is fallible – need to back-up- keep 2+ copies on different types of media in different locations- manage back-ups (migrate media, test integrity)
Choose appropriate methods to transfer / share data- email, dropbox, ftp, encrypted media, filestore, VREs...
Sharing data: questions
Does your funder expect you to share data?
Which data can be shared?
How will you share your data?
What do you get from sharing?- citations, recognition...
Sharing data: advice
Where possible, make your data available via repositories, data centres
and structured databases
•http://datacite.org/repolist •http://databib.org/
•Northampton Electronic Collection of Theses and Research (NECTAR)http://nectar.northampton.ac.uk/
Preserving data: questions
Are you required to preserve (or destroy) your data?
How will you select what to keep?
Is there somewhere you can archive your data?
How can you support the reuse of your data?
Preserving data: advice
How to select and appraise research data:www.dcc.ac.uk/resources/how-guides/appraise-select-research-
data
How to licence research datawww.dcc.ac.uk/resources/how-guides/license-research-data
How to cite datasets and link to publicationswww.dcc.ac.uk/resources/how-guides/cite-datasets
Planning data management
What do you (and others) want to do with the data? your decisions should bear this in mind and make it feasible
Remember:
Data management is about making informed decisionsTalk to colleagues and support staff to see which option works best
Data Management and Sharing Plans
Funders typically want a short statement covering:- What data will be created (format, types) and how?
- How will the data be documented and described?
- How will you manage ethics and Intellectual Property?
- What are the plans for data sharing and access?
- What is the strategy for long-term preservation?
DMP tool: https://dmponline.dcc.ac.uk/
How to write a DMP: www.dcc.ac.uk/resources/how-guides/develop-data-plan
Thanks - any questions?
Acknowledgements: Thanks to DCC staff, UK Data Archive and Research360 for slides