digital preservation preservation planning revisited … and...
TRANSCRIPT
![Page 1: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/1.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Digital Preservation
Preservation Planning revisitedd Q lit A… and Quality Assurance
Christoph BeckerChristoph Becker
http://www.ifs.tuwien.ac.at/~becker
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 2: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/2.jpg)
Agenda. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
P ti Pl i i it dPreservation Planning revisited– What is a preservation plan?– How to create a preservation plan– How to create a preservation plan– Evaluation and plan definition– PP Case Studies
Quality Assurance– What to measure– How to measure it
Presentation of the DP-UE tasks
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 3: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/3.jpg)
Preservation Planning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
A number of solutions existA number of solutions existAll have specific strengths and weaknessesIndividual requirements obligations and constraints inIndividual requirements, obligations and constraints in every institutionDecision between tools is complexDecision between tools is complexDocumentation and accountability is essential in decision-makingmaking
Preservation Planning assists in decision makingPreservation Planning assists in decision makingEvaluating preservation strategies on representative samples according to specific requirements and criteria
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
p g p q
![Page 4: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/4.jpg)
What is a preservation plan?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
‘A ti l d fi i f ti‘A preservation plan defines a series of preservation actions to be taken by a responsible institution to address an identified risk for a given set of digital objects or recordsan identified risk for a given set of digital objects or records (called collection).‘
The Preservation Plan takes into account the preservation policies, legal obligations, organisational and technicalp , g g , gconstraints, user requirements and preservation goals. It also describes the preservation context, the evaluated alternative preservation strategies and the resulting decision for one strategy, including the rationale of the decision
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
decision.
![Page 5: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/5.jpg)
What is in a preservation plan?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Definition of scopeWhat to preserve
Set of actionsSet o act o sHow to preserve it
E l ti f ti d ti fEvaluation of actions, recommendation for oneHow to do it and why do it this way
Documentation of actions and reasonsWhy did we decide thaty
Conditions for QA and monitoringWh t t l k t f
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
What to look out for
![Page 6: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/6.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 7: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/7.jpg)
Aspects collected last week.... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 8: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/8.jpg)
The planning tool PLATO. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Plato is a web application based on J2EE technologies(Jb S F l t Ri hf AJAX JPA )(Jboss Seam, Facelets, Richfaces, AJAX, JPA...)
It supports the complete planning workflowCharacterisation of sample objects− Characterisation of sample objects
− Requirements definition, mindmap integration, knowledge base− Action discovery y
and invocation− Automated experiments
Vi l l i f lt− Visual analysis of results− Plan specification− Traceable documentationTraceable documentation
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 9: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/9.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
A l i Pl tA real case in Plato
if t i t/d / l twww.ifs.tuwien.ac.at/dp/plato
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 10: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/10.jpg)
Scanned books requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 11: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/11.jpg)
Scanned books results. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 12: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/12.jpg)
Scanned books results WS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 13: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/13.jpg)
Four cases, three solutions: Scanned images. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Bavarian State Library, 72TB TIFF6: Leave and monitoryBritish Library, 80TB TIFF5: Migrate to JP2 (ImageMagick)Royal Library of Denmark, ~10.000 aerial photographs in TIFF6: Leave and monitor(State and University Library Denmark, scanned yearbooks in GIF: Migrate to TIFF 6)GIF: Migrate to TIFF 6)
Scenario Chosen action Main reasonsScenario Chosen action Main reasons
72 TB scanned book pages in TIFF6
Leave unchanged and monitor
Color profile complications, lack of JP2 browser support, Process costs
80 TB scanned newspapers in TIFF5
Migrate to JP2 Storage costs,Standardisation
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Aerial photographs in TIFF6
Leave unchanged and monitor
Lack of JP2 browser support, Process costs
![Page 14: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/14.jpg)
Console video games study. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 15: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/15.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Database study
Content branch
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 16: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/16.jpg)
Database study 2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 17: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/17.jpg)
Decision criteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Each criterion concerns either the action or its outcome
Outcome
Object (Authenticity, Fixity, editability)
F t (Li i St d di ti C l it )Format (Licensing, Standardisation, Complexity…)
Effect (Filesize, Costs)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 18: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/18.jpg)
Decision criteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Each criterion concerns either the action or its outcome
Action
Runtime properties (performance, stability, logging…)
St ti ( i li )Static (price, license…)
Judgement (configuration interface usability…)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 19: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/19.jpg)
How to measure?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 20: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/20.jpg)
Some file format requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Specifications available– Is an XML specification enough?– Is an XML specification enough?– Syntacs and semantics needed
Standardized (ISO, ANSI, ITEF, ...)Standardized (ISO, ANSI, ITEF, ...)Accepted and widely usedNot covered by patentNot covered by patentFree of compressionFree of any cryptographical techniquesFree of any cryptographical techniques
Flexible and extensible?Flexible and extensible?Anything else?
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 21: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/21.jpg)
Data sources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
PRONOMS d t– Sparse data
www.digitalpreservation.gov/formatsIncomplete– Incomplete
Wikipedia – reliable?reliable?
The web– unstructured
P2: Combination of PRONOM with dbpedia– Linked Data– ~45.000 statements– Still far from complete
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 22: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/22.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 23: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/23.jpg)
How to measure?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 24: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/24.jpg)
WS QoS measurement techniques. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Components generally behind web service...Co po e ts ge e a y be d eb se ceIntermediaries– Traffic routed through themg
Probing– Independent party invokes services and collects QoS attributes
Sniffing– Monitor traffic on client side
Provider-side instrumentation– Invasive vs. Non-invasive
A t d ?– Access to code?
Non-invasive provider-side service instrumentation
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 25: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/25.jpg)
Measurement techniques. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Measuring CPU time and memory usage:El d ti– Elapsed time
– Linux, Unix: TOP, time– Windows: PsListWindows: PsList– Java: JIP, HPROF
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 26: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/26.jpg)
Design for a controlled evaluation environment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Non-invasive provider-side service instrumentationEngines make components quality awareEngines make components quality-awareEnvironments have associated benchmark scoresRegistry accumulates experienceRegistry accumulates experience
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 27: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/27.jpg)
Profiling memory usage of Java tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 28: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/28.jpg)
Profiling timing of Java tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 29: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/29.jpg)
Comparing tool performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 30: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/30.jpg)
Decision criteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Distribution in four casestudies on scanned images
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 31: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/31.jpg)
Decision criteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Distribution in thirteen caseson various types ofcontent
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 32: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/32.jpg)
Core requirement: Keep object intact. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Essential object characteristicsC t tContentAppearanceStructureStructureBehaviourContext
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 33: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/33.jpg)
Validating a migrated image. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Yes, it’s in JPEG 2000 format
Yes, it’s well-formedYes, it’s validYes, it still has the same dimensions…. But is it still the same image?
Interpret (render)? Hello world.
Interpret (render)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 34: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/34.jpg)
Validating a migrated image. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Dimensions, metadata.... easy: extract and compareC t t N t lContent... Not always easyImageMagick compare: good for simple cases
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 35: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/35.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 36: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/36.jpg)
Distance metrics: How meaningful?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
AEPAERMSE...SSSSIM
Anything but “0” is a problematicproblematicresult
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 37: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/37.jpg)
Approaches to analysing content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 38: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/38.jpg)
Exercise. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Download set of documents from:– www.ifs.tuwien.ac.at/~becker/teaching/dp/ss11/qa-exercise.zip– In the zip file you find:
• Folder collection-selection• Folder collection selection• Requirements tree electronic-documents.mm (+.png)
Collection-selection contains original and migrated filesg g– E.g. FinalE5.doc, FinalE5.pdf
Take requirements tree electronic-documentsand evaluate object characteristics– 20 minutes evaluation
N t b ti– Note observations– Discussion
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 39: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/39.jpg)
Is manual evaluation feasible?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
10 second per object, 1 million objectsp j , j
~2800 hours ~ 350 full working days ~ 70 weeks of work
5 minutes per object:~53.000 full working days…
We need evaluation
At decision time
In operation (QoS)In operation (QoS)
Manual SLA checks?
The answer is: NO
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .(Diagram by Natasa Milic-Frayling, MSRC)
![Page 40: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/40.jpg)
How to measure?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 41: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/41.jpg)
In-depth characterisation approaches. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
XCL…
eXtensible Characterisation Languages
XCDL, the description language
XCEL, the extraction languageg g
Bit t S t G h (BSG)Bitstream Segment Graphs (BSG)
New approach based on reasoning and rules
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 42: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/42.jpg)
XCL: Structural analysis. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 43: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/43.jpg)
Automating the evaluation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 44: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/44.jpg)
Bitstream Segment Graphs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Use a graph to describe the structure of a fileUse a graph to describe the structure of a file
Define sets of rules used by a reasoner to create such a graphgraph
General rule base, format-specific rules
Reasoner calculates BSG and “coverage” of a file
BSG editor allows construction and exploration of theBSG editor allows construction and exploration of the map
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 45: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/45.jpg)
Bitstream Segment Graphs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 46: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/46.jpg)
Bitstream Segment Graphs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
DEMO
http://wiki.dataformats.net/apeiron/launcher.jnlp
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
![Page 47: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/47.jpg)
Interpretation levels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
? Hello worldInterpret (render)
? Hello world.
h t i? Hello world.
characterise
? Hello world.migrate
Every characterisation is an interpretation
Every interpretation is a transformation
There is no ground truth (normally). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
There is no ground truth (normally)…
![Page 48: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/48.jpg)
... DP is communication. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
… But at the time of receptionthere is no message m any moreg ythere may be no sender (any more)there may be no encoder to check againstthere may be no decoder
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .the receiver may not be the one who was targeted
![Page 49: Digital Preservation Preservation Planning revisited … and ...becker/teaching/dp/ss11/20110411-dpvo-pp2 … · Preservation Planning. . . . . . . . . . . . . . . . . . . . .](https://reader033.vdocuments.site/reader033/viewer/2022051916/60082315c9b0f030430997e3/html5/thumbnails/49.jpg)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Questions?
[email protected]/~becker
DP UE T k t d. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
>>> DP UE Tasks are presented now