digital preservation landscape
TRANSCRIPT
-
7/26/2019 Digital Preservation Landscape
1/60
+
Digital PreservationLandscape
N D
S R
-
7/26/2019 Digital Preservation Landscape
2/60
+What we will talk about
Underlying principles
Tools for digital preservationWorkflow systems
Digital preservation leadership
Engaging with the community
-
7/26/2019 Digital Preservation Landscape
3/60
+
Stages of Automation
Basic tool: improvement, but only a step away frommanual process
Tool refinement: take advantage of automation benefitsto develop basic tool
Production tool : develop stable tool with managedphases of development
Basic workflow: defines basic sequence of toolapplication and actions
Workflow refinement: string tools together
Production workflow : full integration of process
-
7/26/2019 Digital Preservation Landscape
4/60
+OAIS
Open Archival Information System
-
7/26/2019 Digital Preservation Landscape
5/60
+OAIS
Open Archival Information System
-
7/26/2019 Digital Preservation Landscape
6/60
+
PlanningWhere do you start?
-
7/26/2019 Digital Preservation Landscape
7/60
+Preservation planning tools
Can help with planning before
repository development
Can be used to assess current efforts
Can be used to identify gaps
-
7/26/2019 Digital Preservation Landscape
8/60
Plato PreservationPlanning Tool
http://www.ifs.tuwien.ac.at/dp/plato/intro.html
http://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.html -
7/26/2019 Digital Preservation Landscape
9/60
+Preservation Planning - plato
-
7/26/2019 Digital Preservation Landscape
10/60
+plato case study
http://youtu.be/K6NnFcSpAh8
http://youtu.be/K6NnFcSpAh8http://youtu.be/K6NnFcSpAh8http://youtu.be/K6NnFcSpAh8 -
7/26/2019 Digital Preservation Landscape
11/60
+SCAPEScalable Preservation
Environments http://www.scape-project.eu
http://www.scape-project.eu/http://www.scape-project.eu/http://www.scape-project.eu/http://www.scape-project.eu/ -
7/26/2019 Digital Preservation Landscape
12/60
+DRAMBORA
Digital Repository Audit Method Based on
Risk Assessment
Online toolkit
Process
Self-Assessment
Identifying and Assessing Risks
Mitigating Risks and Re-assessment
http://www.repositoryaudit.eu
http://www.repositoryaudit.eu/http://www.repositoryaudit.eu/http://www.repositoryaudit.eu/ -
7/26/2019 Digital Preservation Landscape
13/60
-
7/26/2019 Digital Preservation Landscape
14/60
+Trusted Repository Audit Checklist
(TRAC)
Auditing tool
AssessReliability
Commitment
Readiness
Currently under the Center for
Research Libraries (CRL)
-
7/26/2019 Digital Preservation Landscape
15/60
+NDSA Levels of Preservation (LC)
http://www.digitalpreservation.g
ov/ndsa/activities/levels.html
tiered set of recommendations
for how organizations shouldbegin to build or enhance their
digital preservation activities
http://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.html -
7/26/2019 Digital Preservation Landscape
16/60
+ Considerations
What decisions has your organizationmade about repository-levelmanagement?
Has your organization explored cloudcomputing options?
How will you anticipate change?
What is your technical capacity?
-
7/26/2019 Digital Preservation Landscape
17/60
+ Administration
Follow key developments
Balance planning and doing
Know yourself
Adjust for your organizational context
Manage human side of technology, too
No on/off switchincremental progress
Anticipate change
Manage technology over time
-
7/26/2019 Digital Preservation Landscape
18/60
+
Tools
What will help you get thejob done?
-
7/26/2019 Digital Preservation Landscape
19/60
+Tools Overview
Often initiated to solve a specific problem
Tools plug into workflows and repositories
Developments began with Ingest Increasing numbers of open source tools
Generic tools suffice in some cases
Projects for most OAIS functions now
Status: emerging and evolving rapidly
-
7/26/2019 Digital Preservation Landscape
20/60
+Ingest Tools (producer)
Prompt/assist producer with:
descriptive data
provenance data
technical data (e.g. creator software)
initial fixity determination
-
7/26/2019 Digital Preservation Landscape
21/60
+Ingest Tools (repository)
Virus checking
File type identification/verification
File validation
Metadata extraction (technical metadata)
File normalization
Fixity verification
Persistent identifiers (assign and manage)
-
7/26/2019 Digital Preservation Landscape
22/60
+BagIt
Protocol for packaging and exchanging
digital content in a generic way
Defined by California Digital Libraryand Library of Congress
Software independent
-
7/26/2019 Digital Preservation Landscape
23/60
+DROID
DROIDDigital Record and Object Identification
Identifies the precise format of all stored digital
objects
links that identification to a central registry
http://www.nationalarchives.gov.uk/information-
management/projects-and-work/droid.htm
http://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htm -
7/26/2019 Digital Preservation Landscape
24/60
+JHOVE2
JHOVE - JSTOR/Harvard Object Validation
Environment
Format aware characterization of digital objects
Functions: What is it? What about it? What is it,
really? So what?
https://bitbucket.org/jhove2/main/wiki/About
https://bitbucket.org/jhove2/main/wiki/Abouthttps://bitbucket.org/jhove2/main/wiki/About -
7/26/2019 Digital Preservation Landscape
25/60
+Metadata Extraction Tool
Automatically extracts preservation metadata
from files
Outputs that metadata in a standard format
(XML) for use in preservation activities.
http://meta-extractor.sourceforge.net/
http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/ -
7/26/2019 Digital Preservation Landscape
26/60
+
Tools for Digital Forensics
http://www.bitcurator.net/
Information and Quick Start on the wiki
http://www.bitcurator.net/http://www.bitcurator.net/ -
7/26/2019 Digital Preservation Landscape
27/60
+PRONOM
File format registry
Online information system about data file
formats and supporting productshttp://www.nationalarchives.gov.uk/PRONO
M/Default.aspx
http://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspx -
7/26/2019 Digital Preservation Landscape
28/60
+
Registries
GDFRGlobal Digital Format Registry
http://gdfr.info/
UDFRUnified Digital Format Registry
http://udfr.cdlib.org/
http://gdfr.info/http://udfr.cdlib.org/http://udfr.cdlib.org/http://gdfr.info/ -
7/26/2019 Digital Preservation Landscape
29/60
+
FITS Tool Set
FITSFile Information Tool Set
https://code.google.com/p/fits/
Uses a variety of tools
https://code.google.com/p/fits/https://code.google.com/p/fits/ -
7/26/2019 Digital Preservation Landscape
30/60
-
7/26/2019 Digital Preservation Landscape
31/60
+Common Tool Problems
Installation glitches and other bugs
Delays and stoppages
Insufficient documentation / support
Task and data redundancyTool Incompatibility
Learning curve / training requirements
Data independence from toolOrganizational / IT support
-
7/26/2019 Digital Preservation Landscape
32/60
+
Digital Preservation Workflows:
Tools all grown up!
-
7/26/2019 Digital Preservation Landscape
33/60
+
Digital Preservation Systems
Holistic view
Integrated tools
Automated workflow management
-
7/26/2019 Digital Preservation Landscape
34/60
+
Status of DP Workflows
Systems are maturing
Combined - building on one or more tools
Informed by e-science developments
May be:Integrated into repositoriesDefined as a sequence of human/tool steps
Factor in managing at repository levelEncouraged by focus on re-use
-
7/26/2019 Digital Preservation Landscape
35/60
-
7/26/2019 Digital Preservation Landscape
36/60
+
-
7/26/2019 Digital Preservation Landscape
37/60
-
7/26/2019 Digital Preservation Landscape
38/60
-
7/26/2019 Digital Preservation Landscape
39/60
-
7/26/2019 Digital Preservation Landscape
40/60
CDL Micro-Services
Micro-services launched 2010
-
7/26/2019 Digital Preservation Landscape
41/60
-
7/26/2019 Digital Preservation Landscape
42/60
Archivematica
http://www.ifs.tuwien.ac.at/
dp/ipres2010/papers/vanG
arderen28.pdf
-
7/26/2019 Digital Preservation Landscape
43/60
-
7/26/2019 Digital Preservation Landscape
44/60
+ Collaborative Efforts
MetaArchive
Chronopolis
Academic Preservation Trust
(APTrust)
Digital Preservation Network (DPN)
-
7/26/2019 Digital Preservation Landscape
45/60
+ POWRRhttp://digitalpowrr.niu.edu
-
7/26/2019 Digital Preservation Landscape
46/60
-
7/26/2019 Digital Preservation Landscape
47/60
+
Leadership and Training
-
7/26/2019 Digital Preservation Landscape
48/60
+Digital Preservation Management
Follow key developments
Balance planning and doing
Know yourself
Adjust for your organizational context
Manage human side of technology, too
No on/off switchincremental progress
Anticipate change
Manage technology over time
+
-
7/26/2019 Digital Preservation Landscape
49/60
+
Technology Investments
Prioritize: meet essential requirements
Sequence: identify stages to accomplish
Assess: determine when to respond
Fund: decide when to own/share
Anticipate: understand past, look aheadEvaluate: establish ongoing review
+
-
7/26/2019 Digital Preservation Landscape
50/60
+
Considerations
How does technology investment work atyour organization? (understand the system)
What level of support is there for technology
(e.g., direct or indirect, skills, development)?
Are there development plans for humans and
systems in place? (if not, add to to-dos)
How willing is your organization to lead, test,
anticipate, fail?
+
-
7/26/2019 Digital Preservation Landscape
51/60
+Judging Solutions
written in a well-documented languageusable on a wide variety of platformslongevitycommitment, duration of supportmodular in design
support for batch processing and workflowsdesigned for workflow integrationdevelopment by quality stafflicensing options and good access to code
+
-
7/26/2019 Digital Preservation Landscape
52/60
+Digital Preservation Training
DPOEhttp://www.digitalpreservation.gov/educatio
n/
DigCurvhttp://www.digcur-education.org
DigCCurrhttp://www.ils.unc.edu/digccurr/
Digital Preservation Mgt Workshophttp://www.dpworkshop.org/dpm-
eng/eng_index.html
http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digcur-education.org/http://www.ils.unc.edu/digccurr/http://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.ils.unc.edu/digccurr/http://www.ils.unc.edu/digccurr/http://www.ils.unc.edu/digccurr/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/ -
7/26/2019 Digital Preservation Landscape
53/60
+Engaging with the
Community
+
-
7/26/2019 Digital Preservation Landscape
54/60
+
Resources
Organizations
Listservs
Conferences and meetings
Web resources
Webinars
+
-
7/26/2019 Digital Preservation Landscape
55/60
+Organizations
Preservation and Archiving Special Interest Group (PASIG)
ALAALCTSPARSDigital Preservation Interest Group
Association for Information Science and Technology (ASIS&T)
Society for Imaging Science and Technology (IS&T)Archiving
Digital Preservation Coalition
Natl Digital Stewardship Alliance (NDSA)
Society of American Archivists (SAA)
+
-
7/26/2019 Digital Preservation Landscape
56/60
+
National Digital Stewardship
Alliance (NDSA)Mission: establish, maintain, and advance
the capacity to preserve our nation's digital
resources for the benefit of present and
future generations.
Working Groups: Content, Standards,
Infrastructure, Innovation, Outreach
http://www.digitalpreservation.gov/ndsa/
+
http://www.digitalpreservation.gov/ndsa/http://www.digitalpreservation.gov/ndsa/ -
7/26/2019 Digital Preservation Landscape
57/60
+
Conferences
International Digital Curation Conference (IDCC)
PASIG
Open Repositories
iPres
Joint Conference on Digital Libraries (JCDL)
NDSA
+ W b
-
7/26/2019 Digital Preservation Landscape
58/60
+ Web resources
Digital Preservation Outreach & Education (DPOE)http://www.digitalpreservation.gov/education/index.html
Digital Curation Centre (DCC) http://www.dcc.ac.uk/
Digital Preservation Coalition http://www.dpconline.org/
Digital Curation Exchange
http://digitalcurationexchange.org
+
http://www.digitalpreservation.gov/education/index.htmlhttp://www.dcc.ac.uk/http://www.dpconline.org/http://digitalcurationexchange.org/http://digitalcurationexchange.org/http://www.dpconline.org/http://www.dcc.ac.uk/http://www.digitalpreservation.gov/education/index.html -
7/26/2019 Digital Preservation Landscape
59/60
+
Listservs
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected] -
7/26/2019 Digital Preservation Landscape
60/60
+
Questions and Discussion