1 the caspar project key components - overview luigi briguglio engineering r&d laboratory –...
TRANSCRIPT
1
The CASPAR Project
Key Components - Overview
Luigi Briguglio Engineering R&D Laboratory – Roma
CASPAR FINAL WORKSHOP IN ROME
SCUOLA SUPERIORE PUBBLICA AMMINISTRAZIONE - September 15 2009
2CASPAR FINAL WORKSHOP IN ROME
Presentation Planning
• Key Concepts• Digital Preservation Issues• Rationale behind CASPAR Solutions • CASPAR Answers
3CASPAR FINAL WORKSHOP IN ROME
CA
SP
AR
BR
OC
HU
RE CASPAR MAIN QUESTION
4CASPAR FINAL WORKSHOP IN ROME
The CASPAR Project
• The CASPAR project is mainly based on standard ISO:14721:2003 OAIS
• In this perspective, its Architecture is defined for– Managing key concepts of the OAIS reference model– Supporting main functionality identified in the OAIS
functional model
• Moreover, the CASPAR project aims to define, and implement, interfaces and functionally independent components
5CASPAR FINAL WORKSHOP IN ROME
CASPAR & OAIS Info Model
Content Information
DataObject
interpreted using
interpretedusing
Designated CommunityKnowledge Base
InformationPackage
PreservationDescriptionInformation
Needed for long-term
preservation
DescriptiveInformation
Needed for discovery
Primary focus of archival
preservation
RepresentationInformation
6CASPAR FINAL WORKSHOP IN ROME
CASPAR & OAIS Func Model
Producer
Consumer
Manager
7CASPAR FINAL WORKSHOP IN ROME
OAIS Mandatory Responsability
1. Negotiation and Acceptance of submitted information
2. Provide Long-Term Preservation Information
3. Determine Designated Community
4. Information preserved is Independently Understandable to the Designated Community
5. Follow documented policies and procedures which ensure that the information is preserved against all reasonable contingencies
6. Make the preserved information available to the Designated Community.
8CASPAR FINAL WORKSHOP IN ROME
Presentation Planning
• Key Concepts• Digital Preservation Issues• Rationale behind CASPAR Solutions • CASPAR Answers
9CASPAR FINAL WORKSHOP IN ROME
Preservation Issues 1…
1. How To guarantee a digital information may be accessed and understoodaccessed and understood in the future
2. How To guarantee a proper information package information package managementmanagement within and OAIS Archive
3. How To guarantee long-time preservation long-time preservation maintenancemaintenance of any information package
4. How To guarantee retrievalretrieval of Archival Information
10CASPAR FINAL WORKSHOP IN ROME
Preservation Issues 2…
4. How To guarantee intellegibilityintellegibility within heterogeneous Designated Communities and their digital information
5. How To guarantee preservation actors are informed about change eventsinformed about change events
7. How To guarantee an adequate security accesssecurity access with the proper rightsrights to any resource and functionality within an OAIS Archive
8. How To guarantee an adequate integrity and integrity and identityidentity for any Archival Information
11CASPAR FINAL WORKSHOP IN ROME
Presentation Planning
• Key Concepts• Digital Preservation Issues• Rationale behind CASPAR Solutions • CASPAR Answers
12CASPAR FINAL WORKSHOP IN ROME
The Big Question
“What do I have to do for preserving my digital content object, and guarantee it could be used
and understood in the future?”
13CASPAR FINAL WORKSHOP IN ROME
Step 1
• First of all, preserving a digital content object means that – The digital content object has to be “prepared” and
“packed” in a proper way to be “ingested” in the digital archive system that will manage and maintain it for a long time.
– During the preparation, a package containing digital content object and all the necessary information is created.
– And then that package is stored.
14CASPAR FINAL WORKSHOP IN ROME
Ingestion
15CASPAR FINAL WORKSHOP IN ROME
Ingestion
16CASPAR FINAL WORKSHOP IN ROME
CASPAR Ingestion
InformationPackage
Management
InformationPackage
Management
1. Ingest Content Information2. Create Information Package
• Representation Info• Descriptive Info• Preservation Description Info
3. Check Information Package4. Store Information Package for long term
OAIS
IngestIngest
Data Management
Data Management
Archival Storage
Archival Storage
PreservationPlanning
PreservationPlanning
AdministrationAdministration
AccessAccess
17CASPAR FINAL WORKSHOP IN ROME
Step 2
• After the ingestion, the digital content information may be available for using and understanding it.
• In this case, the internal package of the digital archive system has to provide a “usable and understandable” information to the consumer which requests it.
• And so…
18CASPAR FINAL WORKSHOP IN ROME
Step 2
• And so…– The digital content object has to be “found” within
the digital archive, through its descriptive information and “checked” for any restricting access right policy.
– After that, processed information is “prepared” and “packed” in a proper way to be “accessed” from the digital archive system and made available for its intellegibilty at the consumer, taking into account the consumer knowledge profile.
19CASPAR FINAL WORKSHOP IN ROME
Access
20CASPAR FINAL WORKSHOP IN ROME
Access
21CASPAR FINAL WORKSHOP IN ROME
CASPAR Access
InformationAccess
InformationAccess 1. Search Content
Information2. Obtain Information
Packages and relative Contents and Descriptions
OAIS
IngestIngest
Data Management
Data Management
Archival Storage
Archival Storage
PreservationPlanning
PreservationPlanning
AdministrationAdministration
AccessAccess
22CASPAR FINAL WORKSHOP IN ROME
CASPAR Designated Community
Designated Community and
Knowledge Management
Designated Community and
Knowledge Management
1. Deal with Designated Community Profile and its own Knowledge Base
2. Identify and Provide Knowledge Gap for understanding a Content Information
OAIS
IngestIngest
Data Management
Data Management
Archival Storage
Archival Storage
PreservationPlanning
PreservationPlanning
AdministrationAdministration
AccessAccess
23CASPAR FINAL WORKSHOP IN ROME
Step 3
• Ingestion and Access represent the only two activities which involve producer and consumer of the digital content object and allow their interaction with the digital archive system. – Neither Ingestion and Access characterise the
digital archive system as a “long term preservation system”.
• What, instead, extends the usual digital archive systems and promotes them as “preservers” is the third activity
24CASPAR FINAL WORKSHOP IN ROME
Step 3
• The digital content object within the digital archive needs to be maintained in order to be accessed, used and understood for whatever changes during its long-term lifecycle.
• And that implies that any impacting change in the real world needs to be identified and notified to the responsible of preservation in order to take into account the proper corrective actions, according to defined preservation plans.
25CASPAR FINAL WORKSHOP IN ROME
Preservation
26CASPAR FINAL WORKSHOP IN ROME
Preservation
27CASPAR FINAL WORKSHOP IN ROME
CASPAR Preservation
CommunicationManagement
CommunicationManagement
1. Notify and Alert for Change Event impacting long term preservation
2. Trigger Preservation Process
OAIS
IngestIngest
Data Management
Data Management
Archival Storage
Archival Storage
PreservationPlanning
PreservationPlanning
AdministrationAdministration
AccessAccess
28CASPAR FINAL WORKSHOP IN ROME
CASPAR Security
SecurityManagement
SecurityManagement
1. Deal with User Account, Role and Profile
2. Deal with Content Access Permissions
3. Deal with Digital Rights4. Guarantee Authenticity
OAIS
IngestIngest
Data Management
Data Management
Archival Storage
Archival Storage
PreservationPlanning
PreservationPlanning
AdministrationAdministration
AccessAccess
29CASPAR FINAL WORKSHOP IN ROME
CASPAR Solution
Facade Layer Facade Layer
InformationPackage
Mngt
InformationPackage
MngtCommunication
Mngt
CommunicationMngt
SecurityMngt
SecurityMngt
InformationAccess
InformationAccess
Designated Community & Knowledge
Mngt
Designated Community & Knowledge
Mngt
The CASPAR FoundationThe CASPAR FoundationThe CASPAR FoundationThe CASPAR FoundationKeyComponentsKeyComponents FrameworkFramework PlatformPlatform
30CASPAR FINAL WORKSHOP IN ROME
CASPAR Foundation
Pla
tform
Pla
tform
Operating System: Linux, Unix, Windows, MacOperating System: Linux, Unix, Windows, Mac
Java PlatformJava Platform
DBMS: H2, PostgresDBMS: H2, Postgres
Fram
ew
ork
Fram
ew
ork
Development Framework: JAX-WS, GWT, AntDevelopment Framework: JAX-WS, GWT, Ant
Application Server: Tomcat, Glassfish, WASCEApplication Server: Tomcat, Glassfish, WASCE
KeyC
om
ponen
tsK
eyC
om
ponen
tsGapManagerGapManagerGapManagerGapManager
OrchestrationOrchestrationOrchestrationOrchestration
DataAccess&SecurityDataAccess&SecurityDataAccess&SecurityDataAccess&Security RepInfoToolboxRepInfoToolboxRepInfoToolboxRepInfoToolbox
RegistryRegistryRegistryRegistry
PackagingPackagingPackagingPackaging
DataStoresDataStoresDataStoresDataStores VirtualisationVirtualisationVirtualisationVirtualisation
CASPAR Service FactoryCASPAR Service Factory
AuthenticityAuthenticityAuthenticityAuthenticity
SemanticWebSemanticWebSemanticWebSemanticWeb
DigitalRightsDigitalRightsDigitalRightsDigitalRights FindingAidsFindingAidsFindingAidsFindingAids
Development Management: Hudson and JTracDevelopment Management: Hudson and JTrac
Th
e C
AS
PA
R F
ou
nd
atio
nT
he
CA
SP
AR
Fo
un
dat
ion
Th
e C
AS
PA
R F
ou
nd
atio
nT
he
CA
SP
AR
Fo
un
dat
ion
31CASPAR FINAL WORKSHOP IN ROME
Presentation Planning
• Key Concepts• Digital Preservation Issues• Rationale behind CASPAR Solutions • CASPAR Answers
32CASPAR FINAL WORKSHOP IN ROME
Answer - 1
• To guarantee a digital information may be accessed and understoodaccessed and understood in the future, you need an adequate OAIS Representation Information
REPINFORepInfo ToolBox VIRT
Virtualisation
REGRegistry
33CASPAR FINAL WORKSHOP IN ROME
Answer - 2
• To guarantee a proper information package information package managementmanagement within and OAIS Archive, you need to create an adequate OAIS Information Package
PACKPackaging
34CASPAR FINAL WORKSHOP IN ROME
Answer - 3
• To guarantee long-time preservation maintenancelong-time preservation maintenance of any information package, you need an implementation of OAIS Archival Storage
PDSPreservation DataStores
35CASPAR FINAL WORKSHOP IN ROME
Answer - 4
• To guarantee retrievalretrieval of Archival Information, you need an OAIS Finding Aids
FINDFinding
36CASPAR FINAL WORKSHOP IN ROME
Answer - 5
• To guarantee intellegibilityintellegibility within heterogeneous Designated Communities and their digital information, you need to manage Designated Community Profiles and their Knowledge Base
KMKnowledge
37CASPAR FINAL WORKSHOP IN ROME
Answer - 6
• To guarantee preservation actors are informed informed about change eventsabout change events, you need an adequate management of message exchange
POMOrchestration
38CASPAR FINAL WORKSHOP IN ROME
Answer - 7
• To guarantee an adequate security accesssecurity access with the proper rightsrights to any resource and functionality within an OAIS Archive, you need a Security and DRM Management
DAMSData Access Manager
& Security
DRMDigital Rights Manager
39CASPAR FINAL WORKSHOP IN ROME
Answer - 8
• To guarantee an adequate integrity and identityintegrity and identity for any Archival Information, you need an Authenticity Tool
AUTHAuthenticity
40CASPAR FINAL WORKSHOP IN ROME
The CASPAR Workflow
41CASPAR FINAL WORKSHOP IN ROME
…and Stay tuned onhttp://developers.casparpreserves.eu:8080
http://sourceforge.net/projects/digitalpreserve
42
BACKUP SLIDES
43CASPAR FINAL WORKSHOP IN ROME
The OAIS Functional Model - 1
INGESTINGEST
Receive SIP Receive SIP
Q-check on SIP Q-check on SIP
Generate AIP Generate AIP
Extract DescInfo Extract DescInfo
Coordinate updates Coordinate updates
ACCESSACCESS
Query ProcessingQuery Processing
RetrievalRetrieval
Delivery Delivery
Perform Transformation Perform Transformation
Security Security
Access Control Access Control
44CASPAR FINAL WORKSHOP IN ROME
The OAIS Functional Model - 2
STORAGESTORAGE
AIP StorageAIP Storage
AIP Maintenance AIP Maintenance
AIP Retrieval AIP Retrieval
DATA MANAGEMENTDATA MANAGEMENT
Populate Descriptive InfoPopulate Descriptive Info
Maintain Descriptive InfoMaintain Descriptive Info
Access Descriptive Info Access Descriptive Info
45CASPAR FINAL WORKSHOP IN ROME
The OAIS Functional Model - 3
PLANNINGPLANNING
Monitoring OAIS Environment Monitoring OAIS Environment
Detect Changes/Impacts in DCKBDetect Changes/Impacts in DCKB
Mapping out Preservation Strategy Mapping out Preservation Strategy
ADMINISTRATIONADMINISTRATION
Manage submission agreements Manage submission agreements
Audit submission Audit submission
Maintain configuration managementMaintain configuration management
Monitor archive operations Monitor archive operations
Inventory archive contentInventory archive content
Report on archive contentReport on archive content
Migrate/update archive contentMigrate/update archive content
Manage archive standards/policies Manage archive standards/policies
Provide Recommendations Provide Recommendations