color, depth, and motion in visionrheingan/435/cdmvis.pdf · depth from motion •motion depth cues...
TRANSCRIPT
![Page 1: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/1.jpg)
Color, Depth, and Motionin Vision
CMSC 636
Penny RheingansUniversity of Maryland Baltimore County
Characteristics of Color Perception
• Fundamental, independent visual process– after-images– color deficient vision
• Relative, not absolute• Interactions between color and other visual
properties
![Page 2: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/2.jpg)
Color Pathway
• Red, green, and blue cones• Retinal ganglion cells• Parvocellular layers in LGN• Areas in visual cortex– V1: blobs– V2: thick stripes– V4: color
![Page 3: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/3.jpg)
Parvocellular Division
• Role in vision– discrimination of fine detail– color
• Characteristics– color: sensitive to wavelength variations– acuity: small RF centers– speed: relatively slow response
Perceptual Distortions
• Color-deficiency• Interactions between color components– saturation - brightness (Helmholtz-Kohlraush effect)– brightness - hue (Bezold-Brucke Phenomenon)
• Simultaneous contrast– brightness– hue
• Small field achrominance• Effects of color on perceived size
![Page 4: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/4.jpg)
Bezold-Brucke Phenomenon
• Hurvich ‘81, pg. 73.
Simultaneous Contrast
![Page 5: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/5.jpg)
Simultaneous Contrast
Small Field Achrominance
• Wandell ‘95, cp. 3.
![Page 6: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/6.jpg)
Color-size Illusion
• Cleveland and McGill ‘83.
Depth Perception
![Page 7: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/7.jpg)
Magnocellular Division
• Discriminates objects from one another• Characteristics (relative to parvocellular path)– color : insensitive to wavelength variations– acuity : larger RF centers– speed : faster and more transient response– contrast : more sensitive to low contrast stimuli
• Observed characteristics of motion perception– color-blind: impaired at equiluminance– quickness– high contrast sensitivity– low acuity : impaired at high spatial frequencies
Depth Pathway
• Red and green cones• Type A retinal ganglion cells• Magnocellular layers in LGN• Primary visual cortex– disparity tuned neurons (thick stripes in V2)
• Middle Temporal Lobe (MT)
![Page 8: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/8.jpg)
Motor Cues
• Vergence• Accomodation
Binocular Cues
• Depth cues resulting from two views (one fromeach eye)
• Include:– retinal disparity ( stronger for close objects)– neurons sensitive to particular disparities
![Page 9: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/9.jpg)
Monocular Cues
• Depth cues available in single eye image• Include:– Occlusion– Size– Perspective– Head-motion parallax– Kinetic depth effect (object-motion parallax)
Motion and Interaction
![Page 10: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/10.jpg)
Roles of Motion Processing
• Required for Pattern Vision• Driving Eye Movements• Time to Collision• Exproprioceptive Information• Perception of Moving Objects• Depth from Motion• Encoding 3D Shape• Image Segmentation
Characteristics of Motion Perception
• Fundamental, independent visual process– motion aftereffects– motion blindness
• Based primarily on brightness• Ability to interpret structure degrades in
periphery• Spatio-temporal interactions
![Page 11: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/11.jpg)
Motion Pathway
• Red and green cones• Type A retinal ganglion cells• Magnocellular layers in LGN• Area 4B in primary visual cortex– direction selectivity– velocity selectivity– expansion/contraction of visual field– global rotation
• Middle temporal lobe
Apparent Motion
• Def: perception of motion without stimuluscontinuity (stroboscopic and cine)
• Influences– spatial frequency characteristics– global field effects– number of frames– expectations from reality
• Limitations– maximum of 300 msec interstimulus interval– decreased size constancy (max ~8 Hz)– decreased sense of observer motion
![Page 12: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/12.jpg)
Depth from Motion
• Motion depth cues– head motion parallax– kinetic depth effect– magnitude of motion indicates relative depth
• Applications– indicating relative object positions– compensating for lack of other depth cues
• Limits– relative, not absolute depth– perceived size, perceived depth related
![Page 13: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/13.jpg)
Head Motion Parallax
• Bruce and Green ‘90, p. 231.
Kinetic Depth Effect
• Bruce and Green ‘90, pg. 162.
![Page 14: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/14.jpg)
3D Structure from Motion
• Relative motion conveys info about 3D shape• Rigidity assumption• Applications– understanding of irregular/unfamiliar shapes– disambiguation of 2D projections
• Limits– 2 frames (large number of structured points)– 2-3 points (many frames)– 15 arc min (maximum displacement)
![Page 15: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/15.jpg)
Structure from Motion
• Bruce and Green ‘90,pg. 328.
![Page 16: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/16.jpg)
Image Segmentation
• Discontinuities in optical velocity field indicateobject boundaries
• Boundaries can be detected on the basis ofmotion alone
• Applications– disambiguation of complex scenes– grouping of similar objects
At Equiliminance
• Motion perception of gratings degrades• Depth perception disappears• Depth from relative motion disappears• Shape from relative motion disappears
![Page 17: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/17.jpg)
Interaction vs. Animation
• Exploration vs. Presentation– efficiency– flexibility
• Active vs. Passive Participation– immediacy– control– development– understanding
Interactive Control
• Scene– viewpoint and direction– object position and orientation
• Content– variables– timestep
• Representation– techniques– parameters
![Page 18: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/18.jpg)
Experimental Findings
• Control necessary for development– Held and Hein ‘63
• Dynamic control improves shape identification– van Damme ‘94– Rheingans ‘92, ‘93
• Control inproves assembly performance– Smets and Overbeeke ‘95
• Differences between types of control– Ware and Francke ‘96– Pausch, Proffit, Williams ‘97– Usoh, et al. ‘99
Kitten Carousel
• Held and Hein ‘63.
![Page 19: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/19.jpg)
Experimental Findings
• Control necessary for development– Held and Hein ‘63
• Dynamic control improves shape identification– van Damme ‘94– Rheingans ‘92, ‘93
• Control inproves assembly performance– Smets and Overbeeke ‘95
• Differences between types of control– Ware and Francke ‘96– Pausch, Proffit, Williams ‘97– Usoh, et al. ‘99
Shape Identification
• van Damme ‘94, p. 18.
![Page 20: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/20.jpg)
Effects of Control
None CompletePace
Change
Jerky
Smooth
Control
Slide Show
Constant Loop
Interactive
Dynamic
Slide Projector
Multispeed Loop
• Rheingans ‘92, ‘93, ‘97.
Experimental Findings
• Control necessary for development– Held and Hein ‘63
• Dynamic control improves shape identification– van Damme ‘94– Rheingans ‘92, ‘93
• Control inproves assembly performance– Smets and Overbeeke ‘95
• Differences between types of control– Ware and Francke ‘96– Pausch, Proffit, Williams ‘97– Usoh, et al. ‘99
![Page 21: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/21.jpg)
Assembly Performance
• Smets and Overbeeke ‘95, p. 47.
Experimental Findings
• Control necessary for development– Held and Hein ‘63
• Dynamic control improves shape identification– van Damme ‘94– Rheingans ‘92, ‘93
• Control inproves assembly performance– Smets and Overbeeke ‘95
• Differences between types of control– Ware and Francke ‘96– Pausch, Proffit, Williams ‘97– Usoh, et al. ‘99
![Page 22: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/22.jpg)
Type of Control
• Ware and Francke ‘96, p. 122.
Pausch, Proffit, Williams ‘97
![Page 23: Color, Depth, and Motion in Visionrheingan/435/CDMvis.pdf · Depth from Motion •Motion depth cues –head motion parallax –kinetic depth effect –magnitude of motion indicates](https://reader033.vdocuments.site/reader033/viewer/2022042315/5f0317887e708231d4077ea6/html5/thumbnails/23.jpg)
Usoh, Arthur, Whitton, Bastos, Steed, Slater, Brooks ‘99