exactly, owncloud, archivematica, arkivum
TRANSCRIPT
Exactly,ownCloud,Archivema7ca,Arkivum
Ma:hewAddisArkivum
ma:[email protected]/0000-0002-3837-2526
JISCResearchDataNetworkEvent
18May2016
Contents
• Preserva7onasaserviceaspartofRDM• Exactly,ownCloud,Archivema7ca,Arkivum• Objec7ves• Livedemo• Summary
44%oflinkstoAstronomydatabrokenaXer10years
h:ps://www.authorea.com/users/3/ar7cles/288/_show_ar7cle
h:p://www.beagrie.com/sta7c/resource/EBI-impact-summary.pdf
5
h:p://www.na7onalarchives.gov.uk/documents/informa7on-management/parsimonious-preserva7on.pdfh:p://www.na7onalarchives.gov.uk/documents/informa7on-management/parsimonious-preserva7on-in-prac7ce.pdf
Pu\ngParsimoniousPreserva7onintoPrac7ce,TimGollins,TheNa7onalArchive 6
Archivema7ca
• Opensourcedigitalpreserva7onpla_orm– Doingstuffwithfiles:iden7fica7on,valida7on,extrac7on,normalisa7on,checksums,packaging
• DevelopedandsupportedbyArtefactual• Interna7onaluserbaseandcommunity• UKArchivema7caUsersGroup
h:ps://www.archivema7ca.org/ h:ps://www.artefactual.com/
h:ps://dx.doi.org/10.6084/m9.figshare.2073220.v1h:ps://dx.doi.org/10.6084/m9.figshare.1481170.v1
Demoobjec7ves
• Uploadcontenttoapreserva7onservice– Chainofcustody
• Performbasicpreserva7onac7ons– Formatiden7fica7on– Metadataextrac7on– Formatnormalisa7on
• Storecontentinanarchiveservice– Keepthebitssafe
• Getcontentbackagain– Chainofcustody
Democomponents
• Exactly– GUItoolforcrea7ng/valida7ngBagitbags– Windows,Mac,Linux
• ownCloud– Buildyourownfilesharingservice– Webbrowseranddesktopclient
• Archivema7ca– Preserva7onPla_orm
• Arkivum– DataArchivingService
h:ps://www.avpreserve.com/tools/exactly/
h:ps://owncloud.org/
h:ps://www.archivema7ca.org/en/
h:p://arkivum.com/
vv
LocalStorage
SyncFolder
Transfer
Desktop Archivema1caServer
OriginalFiles
Exactly OwnCloudServer
Archivema7ca
AIPProcessing
TransferSource
OwnCloudServer
h:p CIFS
TransferringfilestoArchivema7ca
v v
v
LocalStorage
SyncFolder
Desktop
Archivema1caServer
OwnCloudServer
Archivema7ca
ArkivumArchive
TransferringfilesfromArchivema7ca
v Arkivum
DefaultAIPstore
ArkivumAIPstore
Exactly
ownCloudfoldersshowninthedemo
Loca1on Func1on
Archivema7caTransfer Archivema7caTransferSource
Archivema7caLocalAIPStore Archivema7cadefaultAIPstorageloca7on
Archivema7caArkivumAIPStore AIPstorageusingArkivum’sarchiveservice
ArkivumArchive1 DirectstorageinArkivumwithoutusingArchivema7ca
LIVEDEMO
Summary
• Archivema7caasahostedservice(astart)• Chainofcustodyto/fromservice• Simplesausagemachine• Donoharm• Increaselong-termusability• Knowwhatyouhave• Keepthebitssafe
MoreonArchivema7ca
• Googlegrouph:ps://groups.google.com/forum/#!forum/archivema7ca
• Archivema7cawikih:ps://wiki.archivema7ca.org/Main_Page
• JointheArchivema7caUKUsersgroup– ContactJenMitchamatYork
• WatchtheArchivema7cavideosonYouTubeh:ps://www.youtube.com/results?search_query=archivema7ca
SCREENSHOTS(PREVIOUSDEMOTOARCHIVEMATICAUKUSERGROUPSODOESN’TSHOWALLTHEFEATURESOFARCHIVEMATICA)
UPLOADTOARCHIVEMATICA
ownClouddesktopclient.Thisturnsremotestorageloca7onsintolocalfoldersonthedesktop.Noneed
tomountnetworkdrivesoruseXpservers.
SamesetoffoldersasseenusingtheownCloudwebbrowserinterface.AnythingaddedtothewebUIwill
showupinthedesktopfoldersandviceversa.
Alocalfile(thispresenta7on)readyforpreserva7on
Crea7ngabagcontainingthefilebyusingtheExactlytool.Inthisexample,thebagputstraightintotheownCloud
syncfolderonthedesktop.
Exactlyputsthebag(Bag1.zip)intotheownCloudsynchronisedfolder
SamefilevisiblethroughtheownCloudwebUI
ownCloudautoma7callycopiesthefiletotheArchivema7caTransferSource
Archivema7cachecksthebagbyverifyingthechecksumsmadebyExactly.
Archivema7cageneratesanAIP.TheAIPisstoredinArkivum’sservice.
ArkivumreceivestheAIP,verifiestheintegrity,thenstoresitsafely.
Summary• Exactlyprovidesaneasywaytocreatebagscontainingthe
filestobepreserved.• ownCloudautoma7callyuploadsthebagtoArchivema7ca
andputsitintheTransferSource• Archivema7cageneratesanAIPandputsitintoarchival
storage• Fixityischeckedatallstages
– ChecksumscreatedbyExactlyonthedesktopfortheoriginalfiles– Archivema7caverifiestheExactlybagatthestartoftheTransfer– Archivema7cageneratesfurtherchecksumsduringprocessing– ArkivumverifiestheArchivema7caAIPwhenitisstored
AIPDOWNLOAD
AIPsaredownloadablethroughtheownCloudwebUI
AIPscanbeautoma7callysync’edbacktothedesktop
Summary• ownCloudmakesiteasytodownloadAIPs
– Webinterface– Desktopclient– WorkswellforremoteorsharedArchivema7capipelines
• DifferentAIPstorageloca7onscanbepresentedtousersthroughasingleownCloudview– Noneedfortheusertoaccessmul7plefilesharesorinterfaces
– Longandcomplexstorageloca7onnamescanbesimplifiedfortheuserview
• AIPscanbeautoma7callydownloadedtoasynchronisedloca7onifyouwanttokeepalocalcopy
OTHERTHINGSYOUCANDO
Exactlybagscanbeuncompressed.Thisbag(Bag2)showsthebagitstructure.Allfilesareautoma7callyuploadedtothe
Archivema7caTransferSource
UncompressedbagintheownCloudwebUI.
UncompressedbagselectedintheArchivema7caTransfertab
Resul7ngAIPstoredintheArchivema7cadefaultstorageloca7on
FilescanbeuploadeddirectlythroughtheownCloudwebUI(draganddropintoawebbrowser)
Filesdon’thavetobeinbagsusingExactly.FilescanbeuploadedthroughownCloudandprocessedusingthestandardArchivema7catransfermethod
Archivema7cacancreateuncompressedAIPsandownCloudwillsynchroniseallthefilestothedesktopautoma7cally(ifyouwantitto).
ExactlycanbeusedtovalidateAIPsaXertheyhavebeendownloaded.
Summary• Exactlycanbeusedtocreatezippedoruncompressedbags
• Archivema7cacancreatecompressedoruncompressedAIPs
• ownCloudsynchronisesallfiles/foldersthatyouneeditto– Bagornormalfileupload– AIPdownload– YoucandecidewhethertosyncAIPsautoma7cally,orwhethertodownloadthemonlywhenyouneedtoaccessthem.
• ExactlycanbeusedtovalidatedownloadedAIPs– Valida7onatpointofuse– Protectsagainstanyundetectederrorsduringdownload
BenefitsofusingownCloud• Easyupload/dowloadoffile
– Webbrowser(draganddrop)– Desktopclient(Linux,Mac,Windows)
• GoodforArchivema7caifitisaremoteorsharedservice– WorksovertheInternet– Firewallfriendly– Goodsecurityfeatures– Easywaytopresent/managemul7plepipelinestodifferentusers
• Simplepresenta7onofmul7plestorageloca7ons– Oneuserinterfaceshowingallloca7ons‘inoneplace’– Overlayyourownnamingscheme– Hidesallthebehindthescenesstuff(networkshares,objectstores,Xpservers,localstorage)
PERPETUA
h:p://arkivum.com/arkivum-perpetua/
Perpetua
• Newdigitalpreserva7onsolu7onfromArkivum• Archivema7cadeliveredasamanagedservice• HostedinArkivumDCsordeployedonsite• SupportandtrainingfromArtefactual• RemotemonitoringandmanagementbyArkivum• IntegratedwithArkivumarchivalstorage• IncludesownCloudforeasyupload/download• CanbeextendedwithAtoMandotherservices
ArkivumPerpetuaService
Exactly ownCloud Archives Space Archivematica AtoM Arkivum
Package & transfer Discover & Access Preserve and Store
Perpetua:OpenPreserva7onPla_orm
• Makingthemostof‘open’preserva7on– Openstandardsandspecifica7ons– Opensource– Opencommunity
• Switchto/fromArkivummanagedservices– Startinthecloudandmovein-house– Startin-houseandscale-upinthecloud
• Everythinginescrow– Configura7on,databases,data,soXware,installprocesses
©Arkivum2016 48 h:p://arkivum.com/arkivum-perpetua/