extensible catalog - afternoon session - tilburg
DESCRIPTION
eXtensible Catalog (afternoon session) Integrated Search Towards Catalogue 2.0July 31, 2009Digital Libraries à la Carte 2009Tilburg University, the NetherlandsTRANSCRIPT
![Page 1: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/1.jpg)
eXtensible CatalogDavid Lindahl
University of Rochester
![Page 2: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/2.jpg)
Metadata Management and Connectivity
• XC OAI Toolkit– Make metadata available from a repository or ILS that does not
already have a standard interface– Once added, any OAI-PMH harvester can maintain a
synchronized copy of data in that repository• XC NCIP Toolkit
– Access to local authentication system (ILS, LDAP)– Access to circulation system in an ILS for status and placing
requests• XC Metadata Services Toolkit
– Metadata management tools– Pluggable services including aggregation, FRBR-ization and
record cleanup
![Page 3: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/3.jpg)
XC OAI Toolkit
• Moves metadata with OAI-PMH– OAI Toolkit + ILS– OAI Toolkit + repository– OAI-PMH works with any metadata schema– Performance
• All XC components can talk OAI-PMH
![Page 4: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/4.jpg)
XC NCIP Toolkit
• Integrates circulation with NCIP – NCIP Toolkit + ILS– XC discovery interface uses NCIP– Live circulation status– Authentication– Places circulation requests (hold, recall, etc)
![Page 5: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/5.jpg)
ILS RepositoryILS RepositorySources
XC Software Overview
XC Metadata Services Toolkit
Aggregation
Normalization
FRBRization
Authority Control
Metadata management
software
XC Drupal Toolkit
XC LMS Toolkit
Web application platforms
OAI NCIP OAI
Web ContentManagement
System
Next-GenerationCatalog Software
OAI Harvester OAI Harvester
XC OAI Toolkit
ConnectivitySoftware
XC NCIP Toolkit
XC OAI Toolkit
![Page 6: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/6.jpg)
XC Software Overview
ILS RepositoryILS RepositorySources
XC Metadata Services Toolkit
Aggregation
Normalization
FRBRization
Authority Control
Metadata management
software
XC Drupal Toolkit
XC LMS Toolkit
Web application platforms
OAI NCIP OAI
Web ContentManagement
System
Next-GenerationCatalog Software
OAI Harvester OAI Harvester
XC OAI Toolkit
ConnectivitySoftware
XC NCIP Toolkit
XC OAI Toolkit
![Page 7: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/7.jpg)
OAI Toolkit Software
Convertto XC-item
OAI-PMH Provider
Convert
Database(XML records)
Modify
OAI Toolkit Server Machine
Load
MARCXML records and XC-item records available for harvest via
OAI-PMH protocol
ILS software
MARC HoldingRecords
MARC AuthorityRecords
Item Data
MARC Bibliographic Records
ILS Server Machine
These records are stored in folders
setup by OAI Toolkit
MARCXML
MARCXML
Scheduleto run nightly
XC item
Convert, Modify and Load Script
RAW MARC
Raw item data export file
ILS Export Script
Scheduleto run nightly
ILS Item-data Export Script
ILSSources
XC OAI Toolkit
ConnectivitySoftware
![Page 8: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/8.jpg)
NCIP Toolkit
ILS (Voyager)
Aleph Interface
III Interface
Illiad Interface
Voyager Interface
Request Listener
Request Handler
ILS Interface
Configuration File
ILSSources
ConnectivitySoftware
XC NCIP Toolkit
![Page 9: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/9.jpg)
ILS RepositoryILS RepositorySources
XC Software Overview
XC Metadata Services Toolkit
Aggregation
Normalization
FRBRization
Authority Control
Metadata management
software
XC Drupal Toolkit
XC LMS Toolkit
Web application platforms
OAI NCIP OAI
Web ContentManagement
System
Next-GenerationCatalog Software
OAI Harvester OAI Harvester
XC OAI Toolkit
ConnectivitySoftware
XC NCIP Toolkit
XC OAI Toolkit
![Page 10: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/10.jpg)
XC Metadata Services Toolkit
• Enables libraries to aggregate metadata and run services on it
• User interface for library staff, not end users• NOT a metadata editor (but can eventually
incorporate one)• Services– Automated– Configurable– Pluggable
10
![Page 11: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/11.jpg)
How the XC MST works• OAI-PMH Harvester– Register remote OAI-PMH repositories to pull
metadata from, select subsets– Schedule harvests to pull incremental changes
• Local storage– Stores harvested metadata in any XML format– Stores results of processing by services
• OAI-PMH providers (repositories)– Makes all locally stored metadata available to other
harvesters– Make improved metadata available
11
![Page 12: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/12.jpg)
How the XC MST works• Services
– Downloadable, plug-in services that process metadata and make new versions of the metadata
– XC provides some services, or build your own• Orchestration
– Select metadata for processing and sequence it through services• Faceted browse interface
– Library staff can browse harvested and processed metadata– Works with any XML schema
• Logs– Debug issues with harvested or processed metadata
12
![Page 13: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/13.jpg)
XC advantages for metadata
• Enables automated handling of metadata changes:– New records, updates, deletes– Propagates changes throughout the system
• Web interfaces for trouble-shooting• Low risk of data corruption (easy to fix)• Ideal platform for experimentation
13
![Page 14: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/14.jpg)
New roles for catalogers
• Design and test metadata services• Manage flow of metadata • System/application design• User research
14
![Page 15: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/15.jpg)
XC metadata services
• Normalization– Transform metadata so that it can be displayed
• Schema transformation: – MARCXML to XC, DC to XC
• “FRBRization”• Authority control matching• Aggregation
15
![Page 16: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/16.jpg)
Normalization Services
• MARCXML, Dublin Core• Stays in same schema• Prepares metadata for use in web applications
(faceted browse interface) or back into an ILS• Examples of normalized coded data:– Location codes– Languages– Type of material
16
![Page 17: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/17.jpg)
Transformation Services
• MARCXML to XC Schema; DC to XC Schema• Parses data into FRBR Group 1 entity structure
(work, expression, manifestation, item, plus holdings)
• Creates additional works and expressions for MARC analytics (7XX fields)
17
![Page 18: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/18.jpg)
Authority Control Services
• MARCXML, Dublin Core• Match headings against MARCXML authority
resource file• Populate records with authority control
identifier• Tool for debugging probable, unlikely matches• Prototype developed by RIT students
18
![Page 19: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/19.jpg)
Aggregation Service
• Prepares metadata for use in XC user interfaces (Drupal and LMS Toolkits)
• Aggregates records that represent the same resource
• Manages relationships between records• Will give us experience managing FRBRized
records
19
![Page 21: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/21.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
21
![Page 22: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/22.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
22
![Page 23: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/23.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
23
![Page 24: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/24.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
24
![Page 25: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/25.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
25
![Page 26: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/26.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
26
![Page 27: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/27.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
27
![Page 28: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/28.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
28
![Page 29: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/29.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
29
![Page 30: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/30.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
Error Info
30
![Page 31: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/31.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
31
![Page 32: eXtensible Catalog - afternoon session - Tilburg](https://reader036.vdocuments.site/reader036/viewer/2022081400/55577a43d8b42ace7f8b56b1/html5/thumbnails/32.jpg)
Metadata Services Toolkit
• Add Repositories• Schedule Harvests• Orchestrate Services• Browse Records• Make improved metadata available
Metadata Services Toolkit
Record CleanupFRBRization
Authority ControlAggregation
• Metadata Tools:
32