13 June 2006 JCDL 2006

NCSU Libraries

NDIIPP Preservation Network: Progress, Problems, and Promise

Jim Tuttle, Geospatial Data Librarian

NCSU Libraries

NC Geospatial Data Archiving Project

• Partnership between NCSU Libraries and NC Center for Geographic Information & Analysis

• State and local geospatial content in North Carolina

• Tied to NC OneMap initiative, which provides seamless access to data, metadata, and inventories

• Engage existing state/federal geospatial data infrastructures in preservation

NCSU Libraries

Geospatial data types: Vector data

Time seriesParcel Boundary Changes 2001-2004

North Raleigh, NC

NCSU Libraries

Geospatial data types: Aerial imagery

NCSU Libraries

Geospatial data types: Aerial imagery

NCSU Libraries

Geospatial data types: Aerial imagery

85+ NC counties with orthophotos1-5 flights per county30-200 gb per flight

NCSU Libraries

Today’s geospatial data as tomorrow’s cultural heritage

Future uses of data are difficult to anticipate (as with Sanborn Maps).

NCSU Libraries

Geospatial Data: Risks

• Producer focus on current data• Future support of data formats in question• Shift to web services- and API-based

access• Inadequate or nonexistent metadata• Increasing use of spatial databases for data

management

NCSU Libraries

Different Ways to Approach Preservation

• Technical solutions: How do we archive acquired content over the long term?

• Cultural/Organizational solutions: How do we make the data more preservable—and more prone to be archived—from point of production?

NCSU Libraries

Technical Approach: Progress

• Ingest workflow– Receiving data as is – variety of distribution

methods– Migration of some at-risk formats– Metadata remediation, standardization, and

synchronization– Mechanism for distilling complex objects into

repository ingest items • Repository

– Using DSpace for demonstration purposes– In development: use METS record as dormant item

“brain” within the repository

NCSU Libraries

Organizational Approaches: Progress

• Engaging spatial data infrastructure– Feedback to metadata outreach program– Feedback on adherence to content standards– Involvement of state and local advisory bodies in

project– Viral approach to promoting digital preservation

• Engaging industry– Working with software vendors (e.g, ESRI) – Engaging standards community (Open Geospatial

Consortium)

NCSU Libraries

Changing Thinking

• Web 2.0, web mashups, and AJAX technologies create new opportunities (and challenges)– Looking at static, pre-cut image tiles from

geospatial web services as a preservation target• “Contact fatigue” among local agencies—need to

work with state agencies on coordinated flow of data– Participating in a collaborative multi-agency effort

to routinize content exchange

NCSU Libraries

Learning from the NDIIPP Network

• Maturing thinking about metadata transformations (inspiration from the UIUC/OCLC “hub and spoke” model)

• Leveraging outside expertise in preservation metadata (interactions with Stanford NDIIPP project)

• Discussions about mutual use of tools in ingest workflow (JHOVE, ClamAV, noid, MD5, etc.)

• NDIIPP network creates opportunities for interactions that might not otherwise happen

Jim Tuttle, NCSU Librariesjim_tuttle@ncsu.edu