beginning an imaging program: achieving success and avoiding the pitfalls – archivists edition

98
Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition Raymond K. Cunningham, Jr. CRM, CA, MIT Manager of Records Services University of Illinois Foundation http://www.staff.uiuc.edu/ ~rcunning/imaga.ppt

Upload: raymond-cunningham

Post on 07-Sep-2014

399 views

Category:

Business


3 download

DESCRIPTION

Document imaging presentation for archivists.

TRANSCRIPT

Page 1: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Raymond K. Cunningham, Jr. CRM, CA, MITManager of Records Services

University of Illinois Foundationhttp://www.staff.uiuc.edu/~rcunning/imaga.ppt

Page 2: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Parts of this Presentation

• I. Thinking about Document Imaging• II. Elements of Document Imaging• III. Internet Distribution • IV. Avoiding the Pitfalls• V. A Tour of a Document Imaging

Operation• VI. Imaging and Document Distribution

Projects

Page 3: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part I

Thinking about Document Imaging – Developing an Overview

Page 4: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging

• Success or Failure depends on factors that you can control

Page 5: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging

• Success or Failure depends on factors that you can control

• Do not think of Document Imaging in isolation - imaging is a part of an overall document management program that includes electronic records, microforms and paper

Page 6: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging is for Document Distribution

• Document imaging is not for long term archival storage

Page 7: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging is for Document Distribution

• Document imaging is not for long term archival storage

• Document imaging must enhance workflow, not impede it

Page 8: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging is for Document Distribution

• Document imaging is not for long term archival storage

• Document imaging must enhance workflow, not impede it

• Document imaging is not the electronic equivalent of microfilm

Page 9: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Implementation of a Document Imaging Program

• Begin by Defining your Audience

Page 10: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Define your Audience

• Who are you distributing images to???

Page 11: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Define your Audience

• Who are you distributing images to???• Genealogists, researchers, students,

alumni, perhaps internally to your organization

Page 12: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Define your Audience

• Who are you distributing images to???• Genealogists, researchers, students,

alumni, perhaps internally to your organization

• What are the technical limitations of that audience?

Page 13: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Define your Audience

• Who are you distributing images to???• Genealogists, researchers, students,

alumni, perhaps internally to your organization

• What are the technical limitations of that audience?

• Will your audience view the images via the Internet, within your archives or within the organization?

Page 14: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Define your Audience

• Who are you distributing images to???• Genealogists, researchers, students, alumni,

perhaps internally to your organization• What are the technical limitations of that

audience?• Will they view the images via the Internet,

within your archives or within the organization?

• How complex do you want your presentation

Page 15: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Implementation of a Document Imaging Program

• Start by Defining your Audience• Target a record and think small

Page 16: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Target a Record and Think Small

• Choose a record that will be used and impact your request load.

• Look for something that is simple• If you are distributing on the Internet, think

visibility• Consider photographs or significant small

manuscripts collections

Page 17: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Implementation of a Document Imaging Program

• Begin by Defining your Audience• Target a record and think small• Create a document imaging plan

Page 18: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Imaging Plan

• Create a document imaging plan for management

• Chart the process that you will use, including the disposition of the original documents or photographs

• Explain to management why you will image the records

Page 19: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Implementation of a Document Imaging Program

• Begin by Defining your Audience• Target a record and think small• Create a document imaging plan• Get support from upper management

and partner with your IT department

Page 20: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Support and Partnership

• Gain support for the project with your plan

• Meet with your IT department – make friends, gain web space and assistance

• Obtain the education you need on the technical side of document imaging

Page 21: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Implementation of a Document Imaging Program

• Begin by Defining your Audience• Target a record and think small• Create a document imaging plan• Get support from upper management

and partner with your IT department• Start a small pilot project

Page 22: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Start a Small Pilot Project

• Image a few documents and index them• Distribute them to your audience and view

them with your users. • Take criticism and use it to improve• Learn to distribute documents via the

Internet when called those documents are called upon

Page 23: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Build upon Success

• When your audience sees what you have done you will probably be called upon to do more

• Use the press as an outreach tool• Enhance your documents with imaging,

linking with other archives with related materials

Page 24: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part II

Elements of Document Imaging

Page 25: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging

• Scanning• Storage• Indexing• Retrieval• Access

Page 26: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging Scanning

• Scanner specifications – scanner speed and the pitfalls of vendor demos

• Faster is better – but the real speed depends on document prep

• Faster is better but you are only as fast as your indexing speed

Page 27: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Input

• High Resolution Scanner• Batch Processing Scanner• Camera Scanner• Microfilm to Image• Photocopier• Capture at Creation• Data Entry to Database

Page 28: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging Scanning

• Resolution DPI• Simplex, Duplex scanning• Bi-tonal, grayscale, color• Bit Depth

Page 29: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Resolution – Bit Depth

• 1 bit bitonal black or white• 8 bit – 256 color or grayscale• 24 bit – 16 million + color• 32 bit and 36 bit• With increase in bit depth, you increase the

size of the image • Viewing is only as good as your monitor

Page 30: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Resolution Horizontal dpi Vertical dpi Total Dots per

Square Inch

200 200 40,000

300 300 90,000

400 400 160,000

This is for bi-tonal scanning. For grayscale documents this increases. For color document scanning can increase as much as 16 or 32 times

Page 31: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging Resolution - Text

• OhioLINK Digital Media Center – 300 dpi for text• Colorado Digitization Program– 300 dpi for text • Library of Congress – 200 to 400 dpi depending

on document size• Indiana University Digital Library Program – 300

dpi for text• All of these are for MASTER file, not for the

ACCESS file

Page 32: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Digital Library FederationMonographs and Serials Standards

Black and WhiteFor text, line drawings and halftones

GrayscaleFor covers and illustrations printed in B&W

ColorFor covers, and meaningful text or illustrations printed

600 dpi bitonal Tiff imagesimages must be saved at 1:1 scale

300 dpi8 bit grayscale uncompressed Tiff images – images must be saved at 1:1 scale

300 dpi24 bit color Images must be saved at 1:1 scale

http://www.diglib.org/standards/bmarkfin.htm

Page 33: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging Resolution - Photographs

• Photographs are very different from documents and require high resolution scanning – above 300 dpi

• Photo standards vary depending on the original media – negative, print, slide

• Seek standards from your institution, NARA etc.

Page 34: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Imaging Photographs

• Master copy vs. Distributed copy

Page 35: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 36: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Imaging Photographs

• Master copy vs. Distributed copy• Monochrome and Color

Page 37: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Imaging Photographs• Master copy vs. Distributed copy• Monochrome and Color• Revenue potential

Page 38: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging Storage

• MO platters• CD-R & DVD• RAID – Redundant Array of

Inexpensive Disks• Tape Back up – Disaster Recovery

Page 39: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document ImagingIndexing

• Indexing can be the single most costly item in a document imaging program

• Indexing is usually the issue that will determine the success or failure of a program

• Indexing must include input from the end users

Page 40: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document Imaging - Indexing

• Do not over index• Be sure to budget the staffing required for

any imaging project – or outsource• QC - Quality Control• Scalability – the system works fine with

50,000 images but crashes when loaded with 1,000,000 images

Page 41: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document ImagingRetrieval

• Retrieval - documents should be retrieved fast

• Three Clicks Rule• Printing

Page 42: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Elements of Document ImagingAccess

• Authorization levels and security• Audience needs – office, on the road

etc.• Access to documents via a distribution

system

Page 43: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Document Distribution

• Photocopy/Printing

Page 44: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Document Distribution

• Photocopy/Printing• Fax

Page 45: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Document Distribution

• Photocopy/Printing• Fax• E-mail

Page 46: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Document Distribution

• Photocopy/Printing• Fax• E-mail• Microform

Page 47: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Methods of Document Distribution

• Photocopy/Printing• Fax• E-mail• Microform• Internet – various formats

Page 48: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part III

Internet DistributionThe Basics

Page 49: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Imaging – Software Profile

Operating System Windows 95/98/2000/NT Linux or MacOS Browser Internet Explorer Netscape,Opera Browser Plug-ins for image viewing Adobe Acrobat for PDF

Page 50: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Web Standards

• HTML 4.0• The use of Frames• JAVA• Plug-ins for document imaging

Page 51: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Browser Plug-ins

• Adobe Acrobat Reader – PDF• RealAudio – Audio and Video• TMSSequoia – TIFF• MrSid by LizardTech

Page 52: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

What is MrSid?

MrSID is an acronym for Multi-resolution Seamless Image Database, a powerful wavelet-based image compressor, viewer and file format for massive raster images that enables instantaneous viewing and manipulation of images locally and over networks while maintaining maximum image quality. Features include unprecedented compression ratios while maintaining highest image quality, true multiple resolutions, selective decompression, seamless mosaicking and browsing.

Page 53: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 54: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 55: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 56: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Browser Compliant Imaging

• GIF, JPEG and BMP are HTML compliant• TIFF, PDF are not HTML compliant• TXT files are browser compliant

Page 57: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image Formats

• TIFF - Tagged Image Format File• PDF – Portable Document Format• GIF or JPEG – should I convert??

Page 58: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Hardware Considerations

• Monitors – 17” minimum for input – consider dual monitor schemes

• Retrieval 15” is usable but not preferable• Flat screens• The workstation is not as important as the

servers and the network wiring• Retrieval times are important• Operating system upgrades

Page 59: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Software Configurations

• Standard Models for Imaging Systems – Database retrieval - search capabilities

• Simplified Model – HTML links – HTML search capabilities

Page 60: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part IV

Avoiding the Pitfalls

Page 61: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image what you want Retrieved

• Find out exactly what information is to be retrieved within the record series

Page 62: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image what you want Retrieved

• Find out exactly what information is to be retrieved within the record series

• Do not image documents that are not necessary

Page 63: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Signal To Noise Ratio

• Consider the Internet as a model• If you image “Everything” and your actual

retrieval rate is low, how efficient is your imaging system?

• Imaging large files - retrieval• Know what is being retrieved by your end

users

Page 64: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image what you want Retrieved

• Find out exactly what information is to be retrieved within the record series

• Do not image documents that are not necessary

• Remember – the idea is to avoid information overload

Page 65: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image what you want Retrieved

• Find out exactly what information is to be retrieved within the record series

• Do not image documents that are not necessary

• Remember – the idea is to avoid information overload

• Just because we have the technology to image everything does not mean we must

Page 66: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Avoiding the Pitfalls

• Develop a Strategy• Plan Ahead • Stick to the Basics• Questions for the Vendors

Page 67: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Strategies for Document Imaging• Day forward imaging• Scan on demand• Backfile conversion• Outsourcing as an option• Input centrally vs. Distributed input• Integrate Document imaging with your

photocopying• Web based distribution of images

Page 68: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Plan Ahead – Lifecycle Management

• Where do you see your imaging system in five years?

• What will your paper load be in five years?• How will you be integrating EDMS into

your overall document management system?

• Plan today to evolve away from imaging – think Native formats

Page 69: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Long Term Storage

• Data Migration issues• Retention Schedules• Microfilm – Dual Scanning/Filming

products Canon DR—5060-F• Output to Microform

Page 70: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Questions for the Vendors

• Is this software ODBC and SQL compatible?• What format will my images/documents be stored

in?• Can I export the indexes of my images?• Can I use web base distribution for my images? • Can I add or delete columns in the database?• Can I use any device for image input?• Can I migrate these images to another storage

media? (portability)

Page 71: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document Management

• Document Imaging is one part of the entire document management realm – paper, images, electronic records

• 98% of all information is created electronically

• Capture and store electronic documents in their native format

Page 72: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Moving to EDMS

• Capture at creation• Web based retrieval• Limit available formats• Migration issues• Have a Strategy for Long Term Storage

Page 73: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part V

A Tour of a Document Imaging Operation

Page 74: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

A Tour of a Document Imaging Shop

University of Illinois Foundation Document Imaging System

Page 75: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Who is our Audience?

• Three campus system – Champaign-Urbana, Chicago and Springfield

• Primary – University of Illinois Foundation, Alumni Association

• Secondary – University development officers

• Tertiary – Administration, Archives

Page 76: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 77: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 78: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 79: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 80: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 81: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 82: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 83: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Part VI

Imaging and Document Distribution Projects

Page 84: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Image a Book

Town of Hanover New Hampshire Project 1996

Page 85: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 86: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 87: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 88: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 89: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Document ImagingOn the Cheap

• Scanning from a photocopier or small scanner

• Using HTML, linking to the image• Distribute via the Internet or CDR

Page 90: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Distributing Photographs and Newspaper Articles

• 3000 photographs• News Articles continually

researched• Maps, manuscripts• Make the data searchable

Page 91: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 92: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 93: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 94: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 95: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 96: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 97: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition
Page 98: Beginning an Imaging Program: Achieving Success and Avoiding the Pitfalls – Archivists Edition

Thank You Any Questions?

[email protected]