introduction/resourcesync update - niso update, ala annual chicago 2013
TRANSCRIPT
![Page 1: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/1.jpg)
Interoperability and Its Role In Standardization
Peter MurrayAssistant Director, Technology Services Development, LYRASIS
NISO Update, American Library Association 2013
1
Tuesday, July 2, 13
![Page 2: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/2.jpg)
NISO Update, American Library Association, 30-Jun-2013 2
Tuesday, July 2, 13
![Page 3: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/3.jpg)
NISO Update, American Library Association, 30-Jun-2013Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr 2
Tuesday, July 2, 13
![Page 4: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/4.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones 2
Tuesday, July 2, 13
![Page 5: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/5.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr 2
Tuesday, July 2, 13
![Page 6: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/6.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr 2
Tuesday, July 2, 13
![Page 7: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/7.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr
Self checkout stations by San José Library on Flickr 2
Tuesday, July 2, 13
![Page 8: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/8.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr
Self checkout stations by San José Library on Flickr
The Discharge Area by Canton Public Library on Flickr 2
Tuesday, July 2, 13
![Page 9: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/9.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr
Self checkout stations by San José Library on Flickr
The Discharge Area by Canton Public Library on Flickr
2The future of books by Johan Larsson on Flickr
Tuesday, July 2, 13
![Page 10: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/10.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr
Self checkout stations by San José Library on Flickr
The Discharge Area by Canton Public Library on Flickr
2
The future of books by Johan Larsson on Flickr
eBook Readers Galore by Michael Porter on Flickr
Tuesday, July 2, 13
![Page 11: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/11.jpg)
NISO Update, American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr
DSC01522.JPG by jaysones
Masterton District Library by Keith Davenport on Flickr
The OCLC Mothership by Michael Porter on Flickr
Self checkout stations by San José Library on Flickr
The Discharge Area by Canton Public Library on Flickr
2
The future of books by Johan Larsson on Flickr
eBook Readers Galore by Michael Porter on Flickr
Tuesday, July 2, 13
![Page 12: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/12.jpg)
NISO Update, American Library Association, 30-Jun-2013 3The ghost of a systems admin by Mike Wallis on Flickr
Tuesday, July 2, 13
![Page 13: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/13.jpg)
NISO Update, American Library Association, 30-Jun-2013
• MARC
• ONIX
• Z39.50
• EPub
• SIP/NCIP
• EDI
• ISBN
• SUSHI
• OpenURL
• DOI
• SRU/SRW
• ERM
• METS
• HTML
• RDF
• OAI-PMH
• DAISY
Standards Making It Happen
4
Tuesday, July 2, 13
![Page 14: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/14.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 15: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/15.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical Interoperability
Syntactic Interoperability
Semantic Interoperability
Organizational Interoperability
Technically Secure Data
TransferSignals
Protocols of Data Transfer
Processing of Received Data Data
Standardized Data Exchange
(e.g. XML)Processing and Interpretation
of DataInformation
Common Directories, Data Keys, Ontologies
Automatic Linkage of Processes
Process (Workflow)
Standardized Process Elements
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 16: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/16.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical Interoperability
Syntactic Interoperability
Semantic Interoperability
Organizational Interoperability
Technically Secure Data
TransferSignals
Protocols of Data Transfer
Processing of Received Data Data
Standardized Data Exchange
(e.g. XML)Processing and Interpretation
of DataInformation
Common Directories, Data Keys, Ontologies
Automatic Linkage of Processes
Process (Workflow)
Standardized Process Elements
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 17: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/17.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical Interoperability
Syntactic Interoperability
Semantic Interoperability
Organizational Interoperability
Technically Secure Data
TransferSignals
Protocols of Data Transfer
Processing of Received Data Data
Standardized Data Exchange
(e.g. XML)Processing and Interpretation
of DataInformation
Common Directories, Data Keys, Ontologies
Automatic Linkage of Processes
Process (Workflow)
Standardized Process Elements
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 18: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/18.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical Interoperability
Syntactic Interoperability
Semantic Interoperability
Organizational Interoperability
Technically Secure Data
TransferSignals
Protocols of Data Transfer
Processing of Received Data Data
Standardized Data Exchange
(e.g. XML)Processing and Interpretation
of DataInformation
Common Directories, Data Keys, Ontologies
Automatic Linkage of Processes
Process (Workflow)
Standardized Process Elements
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 19: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/19.jpg)
NISO Update, American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical Interoperability
Syntactic Interoperability
Semantic Interoperability
Organizational Interoperability
Technically Secure Data
TransferSignals
Protocols of Data Transfer
Processing of Received Data Data
Standardized Data Exchange
(e.g. XML)Processing and Interpretation
of DataInformation
Common Directories, Data Keys, Ontologies
Automatic Linkage of Processes
Process (Workflow)
Standardized Process Elements
“Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X
Four Levels of Interoperability
Tuesday, July 2, 13
![Page 20: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/20.jpg)
NISO Update, American Library Association, 30-Jun-2013 6
Today...
• ResourceSyncPeter Murray, LYRASIS
• NCIPMike Dicus, Ex Libris
• SIPTed Koppel, Auto-Graphics
• IOTARafal Kasprowski, Rice University
• Other NISO InitiativesNettie Lagace, NISO
Tuesday, July 2, 13
![Page 21: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/21.jpg)
ResourceSync: Leveraging Sitemaps for Resource Synchronization
Slides adapted from talk by Bernhard Haslhofer, University of ViennaWWW 2013, Rio de Janeiro, May 17th
http://www.openarchives.org/rs/
7
Tuesday, July 2, 13
![Page 22: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/22.jpg)
NISO Update, American Library Association, 30-Jun-2013
What?
• A framework for synchronizing Web resources from a Source to a Destination
8
Web
sync
Tuesday, July 2, 13
![Page 23: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/23.jpg)
NISO Update, American Library Association, 30-Jun-2013
Why?
• rsync: filesystem sync, but not Web
• OAI-PMH: metadata, but not resources
• Web-DAV: extends HTTP, requires server installation at source
• ...
9
… because lots of projects and services are doing synchronization but rely on ad-hoc solutions!
Tuesday, July 2, 13
![Page 24: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/24.jpg)
NISO Update, American Library Association, 30-Jun-2013
arxiv.org mirroring
• 2.4M resources (PDF, metadata, Latex src)
• ~800/day created or updated
• uses homebrew mirroring since 1994 (!)
• look for more general solution to support independent destinations
10
Tuesday, July 2, 13
![Page 25: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/25.jpg)
NISO Update, American Library Association, 30-Jun-2013
Wikipedia
• 1.4 updates / sec
• many dependent services reusing Wikipedia content (e.g., DBPedia, Freebase, etc.)
• harvest articles via OAI-PMH, retrieve changes via IRC, download dumps
11
Tuesday, July 2, 13
![Page 26: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/26.jpg)
NISO Update, American Library Association, 30-Jun-2013
data.europeana.eu
• aggregates metadata from >200 data providers in Europe
• 10 largest providers contribute 80%
• >190 providers contribute 20%
12
Tuesday, July 2, 13
![Page 27: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/27.jpg)
NISO Update, American Library Association, 30-Jun-2013
Design Guidelines
• Sync small websites / repositories (few resources) but also large data collections (millions of resources)
• Support low change frequency (weeks / months) to high change frequency (seconds) sources
• Low adoption barrier!
13
Tuesday, July 2, 13
![Page 28: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/28.jpg)
NISO Update, American Library Association, 30-Jun-2013
Builds on ‘Sitemaps’ Specs
14
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url></urlset>
Tuesday, July 2, 13
![Page 29: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/29.jpg)
NISO Update, American Library Association, 30-Jun-2013
Builds on ‘Sitemaps’ Specs
14
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url></urlset>
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url></urlset>
Tuesday, July 2, 13
![Page 30: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/30.jpg)
NISO Update, American Library Association, 30-Jun-2013
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url></urlset>
Builds on ‘Sitemaps’ Specs
15
Tuesday, July 2, 13
![Page 31: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/31.jpg)
NISO Update, American Library Association, 30-Jun-2013
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url></urlset>
<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url></urlset>
Builds on ‘Sitemaps’ Specs
15
Tuesday, July 2, 13
![Page 32: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/32.jpg)
NISO Update, American Library Association, 30-Jun-2013 16
Tuesday, July 2, 13
![Page 33: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/33.jpg)
NISO Update, American Library Association, 30-Jun-2013
Status
• Beta spec (v. 0.9) for public commenthttp://www.openarchives.org/rs/toc
• Tool development started
• Separate documents for archiving and push deployments
17
Tuesday, July 2, 13
![Page 34: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/34.jpg)
NISO Update, American Library Association, 30-Jun-2013
Next Steps
• Continue tool development & deployment
• Collect
• public comments on [email protected]
• implementation issues onhttps://github.com/resync/resync/issues
• Version 1.0 in fall 2013 (NISO standard)
18
Tuesday, July 2, 13
![Page 35: Introduction/ResourceSync Update - NISO Update, ALA Annual Chicago 2013](https://reader030.vdocuments.site/reader030/viewer/2022032505/55c62baabb61ebe15e8b45c3/html5/thumbnails/35.jpg)
NISO Update, American Library Association, 30-Jun-2013
Thanks!
@DataGhttp://slideshare.net/DataGazetteer
http://openarchives.org/rs
19
Tuesday, July 2, 13