virtual reality ll - cornell program of computer · pdf filevirtual reality ll visual imaging...
TRANSCRIPT
![Page 1: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/1.jpg)
Virtual Reality ll
Visual Imaging in the Electronic Age
Donald P. GreenbergNovember 16, 2017
Lecture #22
![Page 2: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/2.jpg)
Fundamentals of Human Perception• Retina, Rods & Cones, Physiology
• Receptive Fields
• Field of View
• Visual Acuity of Resolution
• Opponent Color Theory
• Compression
• Bandwidth Limitations
• Saccades
![Page 3: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/3.jpg)
The Optomotor Cycle
![Page 4: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/4.jpg)
Extraocular Muscles
“Foundations of Sensation and Perception.” Mather, George. 2009.
![Page 5: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/5.jpg)
Saccade Control• Saccade control is the ability of the eye(s) to move quickly from one fixation
point to another (100-300 ms)
• To obtain a complete picture, normal adults perform 3-5 saccades (“snapshots”) per second
• Fixation “restops” are ≈ 50-100 ms
![Page 6: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/6.jpg)
The eye jumps, comes to rest momentarily (producing a small dot on the record), then jumps to a new locus of interest.
- David H. Hubel. EYE, BRAIN, AND VISION, 1988 Scientific American Books, Inc. p. 80.
Saccadic Motion
![Page 7: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/7.jpg)
Saccadic Masking• Visual saccadic suppression
• The brain selectively blocks visual processing during eye movements
• Neither the motion of the eye or subsequent motion blur of the image nor the time gap in visual perception is noticeable to the viewer
![Page 8: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/8.jpg)
Saccadic Masking• There are two major types of saccadic masking or suppression
• Flash suppression is the inability of the light to see a flash of light during a saccade
• Suppression of image displacement is characterized by the inability to perceive whether a target has moved during a saccade.
![Page 9: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/9.jpg)
Peak Angular Velocity
Wikipedia
![Page 10: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/10.jpg)
Human Depth Perception
Depth Perception
Oculomotor
Binocular
Convergence
Monocular
Accommodation
Visual
Binocular
Stereopsis
Monocular
Static Cues
PerspectiveFamiliarity,
Relative Size
Motion, Position Occlusion Texture
GradientShading, Shadows, Highlights
Atmospheric Blur
Motion Parallax
![Page 11: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/11.jpg)
Monocular Human Depth Perception
Depth Perception
Oculomotor
Binocular
Convergence
Monocular
Accommodation
Visual
Binocular
Stereopsis
Monocular
Static Cues
PerspectiveFamiliarity,
Relative Size
Motion, Position Occlusion Texture
GradientShading, Shadows, Highlights
Atmospheric Blur
Motion Parallax
![Page 12: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/12.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and Specular Highlights
• Atmospheric Blur
![Page 13: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/13.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and SpecularHighlights
• Atmospheric Blur
![Page 14: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/14.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and SpecularHighlights
• Atmospheric Blur
![Page 15: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/15.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and SpecularHighlights
• Atmospheric Blur
![Page 16: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/16.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shading, Shadows, and Specular Highlights
• Atmospheric Blur Viewpoint A Viewpoint B Viewpoint C
![Page 17: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/17.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shading, Shadows, and Specular Highlights
• Atmospheric Blur
![Page 18: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/18.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shading, Shadows, and Specular Highlights
• Atmospheric Blur
![Page 19: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/19.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and SpecularHighlights
• Atmospheric Blur
![Page 20: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/20.jpg)
Monoscopic Depth Cues• Perspective
• Depth from Motion, Relative Size, Position, Familiarity
• Occlusion
• Texture Gradient
• Parallax from Motion
• Shadows and SpecularHighlights
• Atmospheric Blur
• AccommodationNote change in lens shape
![Page 21: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/21.jpg)
Accommodation
• This is the process by which the vertebrate eye changes optical power to maintain a clear image or focus on an object as its distance varies.
![Page 22: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/22.jpg)
Accommodation
The reflex can be controlled but cannot be ‘felt’Accommodation amplitude declines with age
![Page 23: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/23.jpg)
Vergence
• The simultaneous movement of the pupils of the eyes toward or away from one another during focusing.
• This measure of the convergence or divergence of a pair of light rays is defined as vergence.
![Page 24: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/24.jpg)
Vergence Accommodation Conflict
![Page 25: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/25.jpg)
Human Depth Perception
Depth Perception
Oculomotor
Binocular
Convergence
Monocular
Accommodation
Visual
Binocular
Stereopsis
Monocular
Static Cues
PerspectiveFamiliarity,
Relative Size
Motion, Position Occlusion Texture
GradientShading, Shadows, Highlights
Atmospheric Blur
Motion Parallax
![Page 26: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/26.jpg)
Binocular Vision
• Binocular Vision, which is the basis for stereopsis is important for depth perception and covers 114 degrees(horizontally) of the human visual field.
• The remaining sixty to seventy degrees have no binocular vision (because only one eye can see those portions of thevisual field)
![Page 27: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/27.jpg)
Stereoscopic Depth Cues
• Stereopsis
– Horizontal Parallax– Occlusion Revelation
• Shape Change
• Convergence
![Page 28: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/28.jpg)
Stereoscopic Depth Cues
• Stereopsis
• Shape Change
– Standard Stereo– HypoStereo (Gigantism)– HyperStereo (Dwarfism)
• Convergence
Standard
HypoStereo
HyperStereo
![Page 29: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/29.jpg)
Stereoscopic Depth Cues
• Stereopsis
• Shape Change
• Convergence
– Maintain single binocular vision
– Fusion
“Vision and Visual Disabilities – An Introduction,” by Gerd Waloszek, SAP User Experience
![Page 30: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/30.jpg)
Moore’s Law
“Chip density doubles every 18 months.”
Processing Power (P) in 15 years:
![Page 31: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/31.jpg)
Exponential Laws of Computing Growth
![Page 32: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/32.jpg)
War for the Planet of the Apes
![Page 33: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/33.jpg)
Off-line/On-line 𝐑𝐑𝐑𝐑𝐑𝐑𝐑𝐑𝐑𝐑
10 ℎ𝑜𝑜𝑜𝑜𝑜𝑜𝑜𝑜10𝑚𝑚𝑚𝑚𝑚𝑚𝑚𝑚𝑚𝑚𝑜𝑜𝑚𝑚𝑚𝑚𝑜𝑜𝑚𝑚𝑚𝑚𝑜𝑜
= (10 ℎ𝑜𝑜𝑜𝑜.)(60𝑚𝑚𝑚𝑚𝑚𝑚
ℎ𝑟𝑟 )(60 𝑠𝑠𝑠𝑠𝑠𝑠𝑚𝑚𝑚𝑚𝑚𝑚)(1,000𝑚𝑚𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠)
10𝑚𝑚𝑜𝑜
= 3.6 × 106/eye
= 7.2 × 106
![Page 34: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/34.jpg)
Potential Improvements
• Eye tracking and foveal rendering
• Multi resolution displays
• Monoscopic vs. stereoscopic level of detail
• Asynchronous spacewarp
![Page 35: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/35.jpg)
Increasing Densities (ppi) of OLED Displays
![Page 36: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/36.jpg)
Field of View of the Human Eye
Wikipedia
![Page 37: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/37.jpg)
Foveal Eye Tracking Constraints 2016
• Speed- needs to be fast enough to meet update requirements (currently 11 milliseconds, 90 Hz)
• Accuracy- Gaze direction is < 0.5 degree• Foveal direction accuracy can be ~ 1.0 arc minutes (1/60 of a degree)
• Non-invasive measurements- still need to see entire visual field
![Page 38: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/38.jpg)
Eye Tracking
![Page 39: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/39.jpg)
Sensing Methods: Retinal Tracking
● Hard problem with current technologies○ Extremely difficult to illuminate
■ Must bounce light off of retina■ Light comes back through iris
○ Light must be extremely bright○ Too much exposure will damage retina
● Typically done in ophthalmological setting
● Presently can only detect faint images ofblood vessels, companies working on it
● Very high angular resolution, but would presently require occlusion of vision
![Page 40: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/40.jpg)
Purkinje Reflections
![Page 41: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/41.jpg)
Purkinje Reflections
Cornsweet and Crane 1973
![Page 42: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/42.jpg)
Purkinje Reflections
![Page 43: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/43.jpg)
1st and 4th Purkinje Reflections
![Page 44: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/44.jpg)
No Foveated Rendering
Roadtovr.com
![Page 45: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/45.jpg)
Roadtovr.com
Contemporary ‘blur’ foveated rendering
![Page 46: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/46.jpg)
Roadtovr.com
NVIDIA’s ‘contrast preserving’ rendering
![Page 47: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/47.jpg)
Research on Foveated Displays
![Page 48: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/48.jpg)
Alaskan Moose Diorama
![Page 49: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/49.jpg)
Dall Sheep Restoration
![Page 50: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/50.jpg)
Alaska Brown Bear Diorama
![Page 51: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/51.jpg)
Plan of Typical Diorama
![Page 52: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/52.jpg)
LOD Image Based Primitives
Layered Depth Images
![Page 53: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/53.jpg)
Space & Time Warping
• When frame rates are not met, there are several types of solutions, but all have their deficiencies
• Visual artifacts appear because of loss of accuracy– e.g. Imperfect extrapolation, Object Disocclusion trails
![Page 54: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/54.jpg)
Asynchronous Spacewarp
![Page 55: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/55.jpg)
Asynchronous Spacewarp
![Page 56: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/56.jpg)
Asynchronous Spacewarp
![Page 57: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/57.jpg)
Asynchronous Spacewarp
![Page 58: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/58.jpg)
Asynchronous Spacewarp
![Page 59: Virtual Reality ll - Cornell Program of Computer · PDF fileVirtual Reality ll Visual Imaging in ... • Eye tracking and foveal rendering ... Hard problem with current technologies](https://reader036.vdocuments.site/reader036/viewer/2022070607/5aa18a937f8b9a1f6d8c04c5/html5/thumbnails/59.jpg)
End