2002 september -- ejk/uf research topics web-interface performance dtd extensibility imaging...

2002 September -- ejk/UF

RESEARCH TOPICS

Web-Interface Performance

DTD Extensibility

Imaging

Distillation

Other topics?


CONTEXT

Image Only Pilots

• Australian Periodical Publications, 1840-1845

• National Library of New Zealand. Papers Past

Image & Indexing/Tagging Pilot

• University of Florida. Caribbean Newspaper Imaging Project

• University of Florida. Florida Newspaper Project

Image & OCR Pilots

• Lambrakis Press Archives

• ProQuest. Historical Newspapers™

• TIDEN Project : a Nordic Digital Newspaper Library

Olive Software Pilot

• The British Library


WEB-INTERFACE PERFORMANACE

Primary Purpose:

• Characterize the bias of individuals conducting study

Products:

• How to use ActivePaperTM to Your Advantage

• Integration with CONTENTdm, XPAT 5.0, other

• Alternate deliverable images

• Centralized service – Distributed content – Variable platforms


DTD EXTENSIBILITY

Primary Purpose:

• Assess the XML against established newspaper uses

Products:

• How to use ActivePaperTM to Your Advantage

• Document the XML as a public DTD

• Establish a maintenance authority

• Provide for extension of the DTD

• Automation for extended tagging

• How to construct a style sheet

• Integration with CONTENTdm, XPAT 5.0, other

• Define issues per the Economic Model


IMAGING

• Directory Structure and File Naming

• Archival Formats

• Optimized Imaging


IMAGING: Directory Structure and File Naming

Primary Purpose:

• Recommended practices

Products:

• Methods for dealing with anomalies

• Automated name capture during imaging


IMAGING: Archival Formats

Primary Purpose:

• Description of file formats & their characteristicsfor archive, distillation, and distribution

Products:

• Preservation metadata

• Anticipate migration

• Schedule & fee structure for inspection & migration

• Strategy for format migrations & emulation


IMAGING: Optimized Imaging

Primary Purpose:

• Best practices for microfilming and digitizing(quantitative assessments)

• Film reduction ratio

• Evenness of illumination on film

• Film background density

• Quality Index & DPI/PPI

• Skew

• Color-space & Bit-depth

• Image density/black & white points

• Despeckling and Sharpening

• Image restoration methods


IMAGING: Optimized Imaging

Environments:

• Operating System

• Scanning Hardware

• Lighting and Light Filtration

• Post-processing

• Other?

Other Products:

• Control target for OCR assessment

• Revision: RLG Preservation Microfilming Guidelines


DISTILLATION

• Document Zoning

• Optical Character Recognition


DISTILLATION: Document Zoning

Primary Purpose:

• Confirm assumptions re: document zoning

• OCR has difficulty processing large letters

• Smaller zone yield more accurate text

Products:

• Establish reference to the . . .

• PDF (fully scaled)

• TIFF

• Other derivative file formats (fully scaled)


DISTILLATION: OCR

Primary Purpose:

• Provide quantitative OCR accuracy information

Areas of Investigation:

• Distillation Source Images

• Language and Fonts

• Column & Line Density

• Relative Density/Contrast

• Text Curvature and Other Defects


DISTILLATION: OCR

Primary Purpose:

• Predict accuracy contingent upon source document(printing technologies & filming standards)

Test-Set Characterization:

• Source type (newspaper or microfilm)

• Production date (technologies & standards used) Additional Products:

• Best practices

• Accuracy : Cost – Matrix

Distillation Source Images


DISTILLATION: OCR

Language and Fonts

Primary Purpose:

• Demonstrate ability to distill languages, character sets & fonts


• Language & character set groups

• Font face & font size groups

• Regional variant spellings Additional Products:

• Olive Software Speaks Your Language

• How Olive Software Learns Your Lingo

• Stylized text recognition & distillation guide


DISTILLATION: OCR

Column & Line Density

Primary Purpose:

• Demonstrate ability to distill compact text


• Pre-1900 newspapers

• Advertisement pages

• Pages predominantly 8 pt. type or less

• Pages with less than 1 mm space between lines

• Pages with characters spaced at or below ⅓ mm


DISTILLATION: OCR

Relative Density/Contrast

Primary Purpose:

• Investigate low and uneven contrast materials


• Low contrast pages

• Pages with low contrast zones

• Printing, Filming, & Age/Storage Defects Additional Products:

• Best practices

• Accuracy : Cost – Matrix

• Don’t forget to buy the Life Insurance


DISTILLATION: OCR

Text Curvature and Other Defects

Primary Purpose:

• Benchmark current capability to distill curved text & other defects of printing or filming


• Curved text zones

• Broken character zones

• Broken line zones

• Garbage elements (stains, etc.) Additional Products:

• (Additional automatic image correction processes)

2002 september -- ejk/uf research topics web-interface performance dtd extensibility imaging...

Documents

imaging imaging

ocrprimary purpose

fontsprimary purpose

file namingprimary purpose

document zoningprimary

source type newspaper

document zoning ocr

optimized imaging environments