emory notre dame oregon state virginia tech the ockham / nsdl digital library services registry a...
TRANSCRIPT
![Page 1: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/1.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
The OCKHAM / NSDLDigital Library Services Registry
A Distributed Approach
To Enable End-to-End
Digital Service Resolution
![Page 2: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/2.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
![Page 3: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/3.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
•Funded by the National Science Foundation
•National Science Digital Library Program
•2 Year Project Funding
![Page 4: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/4.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Goals1. Create a Registry for all possible Digital Library Services2. Enable End-to-End Digital Library Service Resolving
Sub-Goals
1. Ensure DLSR is Scalable and Redundant2. Ensure Manageability of DLSR is Scalable 3. Use Existing Standards and Technologies
![Page 5: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/5.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Use of the DLSR
1. Library Portal Use Case2. Metasearch Use Case3. Personal Digital Library
3 Examples
![Page 6: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/6.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Distributed DLSR
•The OCKHAM/NSDL DLSR is Distributed•Many nodes over the network•Scalability•Redundancy
•Approach in part based on DNS model
![Page 7: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/7.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
A Brief History of DNS
•Hosts.txt file (later just hosts)•ARPAnet started with centralized management
•Inter-NIC•Eventually, a more manageable approach was needed•Current Distributed DNS System was created
•Allows De-centralized administration•Hierarchical design
•Simplifies management•Reduces bandwith, bottlenecks•Reduces duplicate name issue (i.e. .edu, .com, etc.)
![Page 8: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/8.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Distributed DLSR
•Reasoning much the same as DNS•Similarities and Differences
![Page 9: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/9.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
![Page 10: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/10.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
![Page 11: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/11.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Data LayerRelational Db & OJB• Synchronized• Database
Interchangeability• Ease of development
Lucene• Fast indexing• “on the fly” indexing• Flexible query engine
![Page 12: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/12.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Interface LayerCurrent Interfaces• Struts powered J2ee
interface • OAICat - OAI-PMH 2.0
Future Interfaces• SRU/W • Z39.50• OpenURL
Output Formats• Html• XML
![Page 13: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/13.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Clients• Web browser• OAI-PMH • Z39.50• Any web enabled
application.
![Page 14: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/14.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Network Layer• JXTA provides low level
network functionality– Peer identification and
discovery– Transport layer
• PeerManager provides modular application level functionality
– Load Management– Client/Server Modules
• Main Registry Modules– URL Server– Harvester Client
![Page 15: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/15.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Using OAI For Propagating Data
• A peer can query any other peer and receive an incremental update
• Queries are based on the latest record modification date for the peer’s local copy of the set
• Subsequent queries will use the new latest record modification date
![Page 16: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/16.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Hierarchal Network Topology
Topology Requirements• Data must propagate to all
peers• Compensation for inherent
instability of P2P networks• Scalable structure• Low overhead• DNS for Digital Library
Services
![Page 17: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/17.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Put the pieces together
![Page 18: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/18.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
OCKHAM Future
•Expand the DLSR Community and Use•Explore and build DLSR-aware tools and services•Prototype semi-automated creation of DL’s
![Page 19: Emory notre dame oregon state virginia tech The OCKHAM / NSDL Digital Library Services Registry A Distributed Approach To Enable End-to-End Digital Service](https://reader036.vdocuments.site/reader036/viewer/2022062417/55160a48550346d46f8b5f7f/html5/thumbnails/19.jpg)
emory ▪ notre dame ▪ oregon state ▪ virginia tech
Further Information
OCKHAM Website – http://ockham.org
Martin Halbert, Emory – [email protected]
Jeremy Frumkin, Oregon State University – [email protected]