![Page 1: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/1.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
The Large Display DilemmaThe Large Display Dilemma
Ramesh RaskarMitsubishi Electric Research Labs,
Cambridge, MA USA
![Page 2: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/2.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
The The LargeLarge Display DilemmaDisplay Dilemma
Projector or Flat panel display ?
![Page 3: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/3.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Insight Media and McLaughin Consulting Group, Microdisplay Forecast Report, 2003
Projectors
FPDs
Flat panel displays are outselling Projectors
![Page 4: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/4.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
ProjFPD
ProjFPD
20072003
$6B$50B
$5B$3B
Revenue
6M20M
3M1M
Units
The NumbersThe NumbersShould we believe them ?Should we believe them ?
Insight Media and McLaughin Consulting Group, Microdisplay Forecast Report, 2003
![Page 5: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/5.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Growth ExpectationsGrowth Expectations
• Our reasons– Projectors are cheaper and easy to make– Portable, aim anywhere– Tile-able to expand
![Page 6: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/6.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Display ChoicesDisplay Choices
• Our reasons– Projectors are cheaper and easy to make– Portable, aim anywhere– Tile-able to expand
• ‘Their’ reasons– FDP Expensive but beats ambient light,
screen reflectance– No shadows, focus, FOV issues– Maybe large does not need portable
![Page 7: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/7.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OrganicLED
LightEmittingPolymer
E-Ink
Foldable DisplaysFoldable Displays
Emissive substrates
Reflective substrates
![Page 8: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/8.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Traditional Data Projector MarketsTraditional Data Projector Markets
Multi ProjectorSingle Projector
Main MarketsBiz Presentations, home theater, ImmWorkbench
Control rooms, Advertising, Visualization
TrendFPTV, RPTV → FPD
Bulky → ThinStill cumbersome
Tiling with substrates easy
Main Markets
Trend
Will FPD kill Projectors !
![Page 9: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/9.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Projector ResearchProjector Research
• But Plenty of Important Problems ! – Hardware design – Geometric Alignment [Hereld, Fuchs, Wallace]
– Photometric Correction [Majumder, Nayar, Ulichney]
– Interaction [Pinhanez]
– Stereo and 3D display – Super-resolution [Jaynes, Majumder]
– Shadow Removal [Summet, Cham, Sukhthankar, Jaynes]
A short window of opportunity !What is the Best App ?
![Page 10: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/10.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Advantages of Projector Advantages of Projector vsvs FPDFPD
– Decoupled Device
– Combination of images
– Shape of display surface
Image can be larger than device
Images can be superimposed and added
Displayed images may be non-planar
![Page 11: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/11.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew Opportunities: New Opportunities:
Exploit Exploit ProjProj--Cam AspectCam Aspect
![Page 12: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/12.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
![Page 13: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/13.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
• Image Overlay on Real Objects– Decoupled device– Non-planar surfaces
![Page 14: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/14.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
• Image Overlay on Real Objects– Decoupled device– Non-planar surfaces
• Projectors in Machine Vision– Projector as dual of a camera
![Page 15: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/15.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
![Page 16: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/16.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Handy PDA+Phone+ProjectorHandy PDA+Phone+Projector
Computing
Interface
Tilt sensor
Cam
era
Wire
less
Projector
Self-contained Device
![Page 17: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/17.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Future ProjectorsFuture Projectors
• What are possible applications ?
• What are geometric problems ?– Sense: Aware of surroundings– Respond: Display accordingly– Communicate: Support ad-hoc clusters
• What components are necessary ?
![Page 18: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/18.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Geometrically Geometrically Aware Aware ProjectorProjector
![Page 19: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/19.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Application of Handy ProjectorApplication of Handy Projector
Raskar, vanBaar, Beardsley et al, Siggraph 2003
![Page 20: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/20.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Conformal mapping of image
Illuminate developable surface
Least sqr conformal mapping for non-developable surfaces
Shape Adaptive ProjectionShape Adaptive Projection
Raskar et al, Siggraph 2003
![Page 21: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/21.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Handy ProjectorsHandy ProjectorsCanesta
Siemens Minibeamer
Symbol
• LED based lamps– Less heat, simpler
optics– Coherent colors– Long lamp life
• Laser projectors– Vector display– Large DOF
• Projected keyboards
![Page 22: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/22.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
• Image Overlay on Real Objects– Decoupled device– Non-planar surfaces
• Projectors in Machine Vision– Projector as dual of a camera
![Page 23: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/23.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
MotivationMotivation
View-dependent Appearance
![Page 24: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/24.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Changing AppearanceChanging Appearance
Projector Projector
Virtual light source
![Page 25: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/25.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Changing Virtual IlluminationChanging Virtual Illumination
Raskar, Welch, Low, Bandyopadhyay, “Shader Lamps” (2000)
![Page 26: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/26.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
![Page 27: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/27.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Apparent MotionApparent Motion
Raskar, Ziegler, Willwacher, “Cartoon Dioramas in Motion,” (NPAR 2002)
![Page 28: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/28.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
ProjectorProjector--based Augmentationbased Augmentation
www.ShaderLamps.com
Reflectance Illumination
InteractionMotion
![Page 29: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/29.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Training and MaintenanceTraining and Maintenance(Projector(Projector--based Augmented Reality)based Augmented Reality)
Raskar, Beardsley, Raskar, Beardsley, ForlinesForlines, 2002, 2002
• Training images and videos• Instruction manuals
Projector + Camera
Backpack with notebook computer
Control Panel
Dr. Shiotani, Mitsubishi Electric, Japan
Benefits vs–HMD: tracking issues–PDA: ‘Last foot’ problem
![Page 30: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/30.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Spatial Projection DisplaysSpatial Projection Displays
Pinhanez, C. The Everywhere Displays Projector, 2001
Steerable Mirrors
![Page 31: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/31.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Spatial Projection DisplaysSpatial Projection Displays
‘Being There‘Being There
Low, K., Welch, G., Lastra, A., and Fuchs, H. UNC Chapel Hill 2001.
![Page 32: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/32.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Image Overlay ApplicationsImage Overlay Applications
– Training and maintenance• Instructional text, images and procedures
– Entertainment• Live shows, exhibits, demonstrations
– Design and Prototype• Virtual material and lighting changes
– Scaled model visualization• Augment walk-around scaled model of buildings• Project and ‘paint’ surface colors, textures• Lighting, sunlight, seasons• Internal structure, pipes, wiring
– Advertising
![Page 33: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/33.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
OutlineOutlineNew OpportunitiesNew Opportunities
• Aware Handy Projectors– Decoupled display size– Ability to combine
• Image Overlay on Real Objects– Decoupled device– Non-planar surfaces
• Projectors in Machine Vision– Projector as dual of a camera
![Page 34: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/34.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Machine ‘Projection’Machine ‘Projection’
• Image Projection vs Machine Projection
• Machine Vision with projectors– Project images to assist machine computation
![Page 35: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/35.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
VitaPhoneVitaPhone(‘Don Juan’ 1926)(‘Don Juan’ 1926)
Soundtrack recorded on film
![Page 36: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/36.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Bulb modulatedBy microphone
Photosensor controlsthe volume
Recording
Reproduction
![Page 37: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/37.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
![Page 38: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/38.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
![Page 39: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/39.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Machine ‘Projection’Machine ‘Projection’
• Machine Vision with projectors– Project images to assist computation
• Projector - a 3D projection device– Projector is a dual of a camera– Modulation and direction control
![Page 40: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/40.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Structured Light for 3D ScanningStructured Light for 3D Scanning
Striped Projection
Need to be supported as a
feature with each projector
[Jaeggly, Chang]
![Page 41: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/41.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Portable Tracking SystemPortable Tracking SystemBeardsley, Raskar 2002
fixed camera observes pattern
projected pattern
Movingprojector Object being
tracked
![Page 42: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/42.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
MasklessMaskless LithographyLithography
DLP Micro-mirror arrayFast parallel operation on optical resists
OpticalResists
![Page 43: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/43.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Parallel Switching and Routing at ~100KHzFixed diffraction grating + Optical switches
Optical Networking Gear
![Page 44: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/44.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Optical Signal Processing
Multi-wavelength Operation (bandpass)Encoding/decoding/transcoding
![Page 45: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/45.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
‘‘Machine Projection’ ApplicationsMachine Projection’ Applications
• Structured light for 3D scanning• BRDF acquisition• Tracking• Etching, lithography• Optical signal processing• Optical networking gear
• How can we exploit image+machine projection ?
![Page 46: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/46.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
DiscussionDiscussionLarge Large ProjProj--Displays: Will they survive ? Displays: Will they survive ?
• Controlled environments– Movie Theaters, IMAX, Planetariums– Digital Cinema, large visualizations
• Screen Technology– Active materials, Holo-screens
• Ad-hoc Tiling– Smart projector units instead of systems
• Displays tied to interaction– Multiuser touch sensitive, e.g. DiamondTouch
• Super cheap proj (maybe $200)– Completely new markets, casual use
![Page 47: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/47.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
AcknowledgementsAcknowledgements
• MERL• Jeroen van Baar, Paul Beardsley, Remo Ziegler, Thomas
Willwacher, Srinivas Rao, Cliff Forlines, Paul Dietz, Darren Leigh, Bill Yerazunis
• Office of the Future group at UNC Chapel Hill• Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael
Brown, Ruigang Yang, Wei-chao Chen• Henry Fuchs, Herman Towles, Greg Welch
• Mitsubishi Electric, Japan• Yoshihiro Ashizaki, Masatoshi Kameyama,
Masato Ogata, Keiichi Shiotani
• Images• Oliver Bimber, Rahul Sukthankar, Claudio Pinhanez, Chris
Jaynes
![Page 48: The Large Display Dilemma - MIT Media Labweb.media.mit.edu/~raskar/Procams03/... · Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03 Image Overlay Applications –Training](https://reader034.vdocuments.site/reader034/viewer/2022042403/5f17eff491c17e32471be537/html5/thumbnails/48.jpg)
Mitsubishi Electric Research Labs Display Dilemma Raskar, Oct 03
Display DilemmaDisplay Dilemma
• Short opportunity to get back in the race• Many interesting problems remain• Lets exploit the ‘proj-cam’ aspect, new apps
• Decoupled imagery: Aware handy projector• Overlay: Augment real world• Camera dual: Machine ‘projection’
• ‘Every mm at every ms’ - Henry Fuchs