visual pattern recognition

Visual Pattern Recognition

Taylor J. MeekOctober 22, 2009

Physiology

Features

Patterns

Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading by Taylor J. Meek is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.These original publications may be accessed electronically from: http://www.lingnik.com/visual-pattern-recognition

PHYSIOLOGICAL VISUAL SYSTEM

Difference Detectors and Visual AftereffectsFinding the Feature DetectorsBuilding Feature Detector Systems

Physiology

Features

Patterns

Difference Detectors

Input A

Input B

DifferenceDetector

+

-

A

B

No Activity

Basal Activity

+

-No Activity

Base Level

+

-No Activity

Base Level

Physiology

Features

Patterns

Difference Detectors

Red

Green

DifferenceDetector

+

-

Red

Green

No Activity

Neutral Color(Yellow)

Red

TiredNo Activity

Base Level

Green

TiredNo Activity

Base Level

Physiology

Features

Patterns

Difference Detectors

Red

Green

DifferenceDetector

+

-

Red

Green

No Activity

Neutral Color(Yellow)

Red

TiredNo Activity

Base Level

Green

TiredNo Activity

Base Level

Physiology

Features

Patterns

Difference Detectors

MovementUp

Movement Down

DifferenceDetector

+

-

Up

Down

No Activity

Basal Activity

+

-No Activity

Base Level

+

-No Activity

Base Level

Physiology

Features

Patterns

Aftereffects

Complementary Color PhotoreceptorsSomething More Abstract

“The McCollough Effect”

(Gibson & Harris 1968 in Lindsay & Norman 1977)

1

(Gibson & Harris 1968 in Lindsay & Norman 1977)

2

(Gibson & Harris 1968 in Lindsay & Norman 1977)

Difference Detectors

So what?Eye Transfer

Color DesensitizationMotion Detector DesensitizationOrientation-specific Line Detectors

Physiology

Features

Patterns

Feature Detectors

Edge

Slit/Line

Dimness

++-++-++-

--+--+--+

+-++-++-+

-+--+--+-

+++++++++

---------

Physiology

Features

Patterns

Physiological Feature Detectors

Edge ConvexEdge

MovingContrast(Edge)

Dimness

http://flickr.com/photos/thomashawk/90125879/Toad by Thomas Hawk, under CC License

Physiology

Features

Patterns

Feature Detectorsin Higher-Order Species

Ganglion & Bi-Polar Cells• On-Center, Off-Surround• Off-Center, On-Surround• Light Onset, Extinction• Peculiar Receptive Fields• Color Specificity, Contrast• Movement (Directional)

(Lindsay & Norman 1977, p.215) Physiology

Features

Patterns

Light

ReceptiveField

Ganglion Cell

Simple Feature Detector Cellsin Higher-Order Species

Slit and Line

Edge ++-++-++-

--+--+--+

+-++-++-+

-+--+--+-

Physiology

Features

Patterns

Selective to:LocationTypeOrientation/directionWidth

Complex Feature Detector Cellsin Higher-Order Species

Slit and Line

Edge ++-++-++-

+-++-++-+

-+--+--+-

Physiology

Features

Patterns

Selective to:LocationTypeOrientation/directionWidth

--+--+--+

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Movement (Axial Bidirectional)

Angle

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Movement (Bidirectional)

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Angle

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patternshttp://flickr.com/photos/crowolf/205180735/ The Monkey Paw by John “Jay” Glenn, under CC License

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

(Lindsay & Norman 1977, p.250)

Building UpComplex Feature Detectors

Ganglion & Bipolar Cells

Simple Feature Detectors

Complex Feature Detectors

Hyper-Complex Feature Detectors

Higher-Level Feature Detectors

http://flickr.com/photos/residae/386508456/ Father of the Eye by Desirae, under CC license

Physiology

Features

Patterns

COGNITIVE FEATURE DETECTION

Features and GroupingGeon Theory

Physiology

Features

Patterns

Features and Objects

Physiological NystagmusJiggly Eye Movements

Physiology

Features

Patternshttp://en.wikipedia.org/wiki/Image:Optokinetic_nystagmus.gif Available under GNU Free Documentation License,http://commons.wikimedia.org/wiki/Commons:GNU_Free_Documentation_License

(Verheijen 1961 in Lindsay & Norman 1977)

Physiological NystagmusJiggly Eye Movements

Physiology

Features

Patterns

(Dodwell 1970, p.188)

Physiological NystagmusJiggly Eye Movements

(Lindsay & Norman 1977, p.40-44)

Physiology

Features

Patterns

Segmental Image Loss

(From R.M. Pritchard, Scientific American, 1961 in Lindsay & Norman 1977)

Physiology

Features

Patterns

Object Segmentation into Features

Physiology

Features

Patterns

Feature Classes

Biederman (1995)

Physiology

Features

Patterns

Feature Relation

Physiology

Features

Patterns

Geons

Biederman (1995)

Physiology

Features

Patterns

Geons to Scenes

Biederman (1995)

Physiology

Features

Patterns

Features

Sensory InputPhysiological FeaturesSimpleComplexHypercomplexHigher-LevelFeature Classes + Feature RelationsObject SegmentsObjects

PATTERN RECOGNITIONPandemonium Revisited

Physiology

Features

Patterns

Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading by Taylor J. Meek is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.These original publications may be accessed electronically from: http://www.lingnik.com/visual-pattern-recognition