3d video services - unina stidueunina.stidue.net/elaborazione di segnali...3d television3d...
TRANSCRIPT
![Page 1: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/1.jpg)
3D Video services
Marco Cagnazzo
![Page 2: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/2.jpg)
Part III: Advanced servicesOverviewOverview
3D Vid t3D Video systems• History• Acquisition• Transmission (coding)• RenderingFuture services• Super Hi Vision systems• High speed cameras• High sensibility cameras
page 1 Marco Cagnazzo 27.05.2010 3D Video
![Page 3: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/3.jpg)
3D imaging a very old story!3D imaging… a very old story!
The weighing of the heart scene from
Masaccio, Trinità (1425-1427), S t M i N ll Fi
P. Picasso, Les Demoiselles d'Avignon, 1907, MOMA, NYC
The weighing of the heart scene from the Papyrus of Ani, ca. 1200 B.C.
Flat imagesPerspective and
distance fogSanta Maria Novella, Firenze
g
Perspective
gMultiple views
Piero della Francesca? Leon Battista Alberti? Città ideale (1470 1475 circa)
page 2 Marco Cagnazzo 27.05.2010 3D Video
Piero della Francesca?, Leon Battista Alberti?, Città ideale (1470-1475 circa), Galleria Nazionale delle Marche, Urbino.
![Page 4: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/4.jpg)
Depth perceptionDepth perception
Bi lBinocular cues• Stereoscopic imaging: stereopsis
Monocular cues• Perspective• Motion parallax• Depth from motion• Distance fog and texture degradation• Object sizes
page 3 Marco Cagnazzo 27.05.2010 3D Video
![Page 5: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/5.jpg)
Stereoscopic imagingStereoscopic imaging
As soon as photography was born, stereoscopic devices were createddevices were created
1844 St b D id B t d i th t1844: Stereoscope by David Brewster, a device that could take photographic pictures in 3D.
1851: Improvement by Louis Jules Duboscq (picture of Queen Victoria displayed at The Great Exhibition)of Queen Victoria displayed at The Great Exhibition)
page 4 Marco Cagnazzo 27.05.2010 3D Video
![Page 6: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/6.jpg)
ExampleExample
Stereoscopic view of Manhattan, 1909
page 5 Marco Cagnazzo 27.05.2010 3D Video
![Page 7: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/7.jpg)
3D Movies3D Movies
1855 th Ki t i t d i th St1855: the Kinematoscope was invented, i.e. the Stereo Animation Camera
1915: The first anaglyph movie was produced
1922: the first public 3D movie was displayed - The Power of LovePower of Love
1935: the first 3D color movie was produced1935: the first 3D color movie was produced
page 6 Marco Cagnazzo 27.05.2010 3D Video
![Page 8: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/8.jpg)
Anaglyph imageAnaglyph image
page 7 Marco Cagnazzo 27.05.2010 3D Video
![Page 9: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/9.jpg)
3D Television3D Television
1947: Soviet Union developed 3D films: Robinson CrusoeCrusoe
’50 3D i d d B D il’50: many 3D movies were produced: Bwana Devil, House of Wax, Alfred Hitchcock’s Dial M for Murder (the movie was released in 2D because not all(the movie was released in 2D because not all cinemas were able to display 3D films)
page 8 Marco Cagnazzo 27.05.2010 3D Video
![Page 10: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/10.jpg)
3D Television3D Television“Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color annoying glasses )(bad color, annoying glasses…)
90s-2000s: New technologies in acquisition, compression, and 90s 000s e tec o og es acqu s t o , co p ess o , a drendering
A f 2008 3D i i b d J bl h lAs of 2008, 3D programming is broadcast on Japanese cable channel BS 11 approximately four times per day.
Sky 3D channel in April 2010. The system will require a special "3D ready" television and Sky+HD DVR box
Starting on June 11th, 2010 ESPN will launch a new channel dedicated to 3D sports with up to 85 live events a year in 3Dp p y
page 9 Marco Cagnazzo 27.05.2010 3D Video
![Page 11: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/11.jpg)
3D TV Systems3D TV Systems
S
tion
g Decod
er
BR
Stereo camera
Multi user 3D TV
nt Produ
ct
eo Cod
ing
3D Video
D+D
IB
…
… …
Depthcamera
Single user 3D TV
3D Con
ten
3D Vide 3
er
Multi-camera setup
2D TV3
DVB
Decod
2D/3D conversion
2D TV
Video Depth Meta data
page 10 Marco Cagnazzo 27.05.2010 3D Video
Video Depth Meta data
![Page 12: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/12.jpg)
3D Video acquisition3D Video acquisition
StStereoscopy • 2 cameras mounted side by side, separated by the same distance as
between a person's pupils.
Multi-view capture uses arrays of many cameras to capture a 3D scene through multiple independent video streams.
Color+depth camera: capture normal video and a depth map estimatedColor+depth camera: capture normal video and a depth map, estimated with radar-like techniques (uses infrared)
M lti i d th N C l d thMultiview+depth: N Color+depth cameras
page 11 Marco Cagnazzo 27.05.2010 3D Video
![Page 13: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/13.jpg)
3D Video Acquisition: stereo camera3D Video Acquisition: stereo camera
page 12 Marco Cagnazzo 27.05.2010 3D Video
![Page 14: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/14.jpg)
3D Video Acquisition: color + depth3D Video Acquisition: color + depth
page 13 Marco Cagnazzo 27.05.2010 3D Video
![Page 15: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/15.jpg)
3D Video Acquisition: MVD3D Video Acquisition: MVD
page 14 Marco Cagnazzo 27.05.2010 3D Video
![Page 16: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/16.jpg)
Coding of 3D videoCoding of 3D videoEncode separately each view
Encode jointly view• Use other views to perform• Use other views to perform
prediction of current image
Encode a view and a depth map• Joint or separate coding of view
and depth• Scalable coding?Scalable coding?
page 15 Marco Cagnazzo 27.05.2010 3D Video
![Page 17: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/17.jpg)
3D Rendering:Anaglyph MethodAnaglyph Method
page 16 Marco Cagnazzo 27.05.2010 3D Video
![Page 18: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/18.jpg)
3D Rendering: Polarized MethodPolarized Method
page 17 Marco Cagnazzo 27.05.2010 3D Video
![Page 19: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/19.jpg)
3D Rendering:Alternate-frame sequencingAlternate-frame sequencing
E d f i f th l ft [ i ht] iEvery second frame is from the left [right] viewVideo is projected at twice the frame rateViewers wears glasses that shutter alternatively the left or the right eye
page 18 Marco Cagnazzo 27.05.2010 3D Video
![Page 20: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/20.jpg)
3D Rendering:Auto stereoscopic displayAuto stereoscopic display
page 19 Marco Cagnazzo 27.05.2010 3D Video
![Page 21: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/21.jpg)
Non-stereoscopic rendering methodsNon-stereoscopic rendering methodsMotion parallax Head tracking
No special screen nor glasses!No special screen nor glasses!
page 20 Marco Cagnazzo 27.05.2010 3D Video
![Page 22: 3D Video services - UniNa STiDuEunina.stidue.net/Elaborazione di Segnali...3D Television3D Television “Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color](https://reader034.vdocuments.site/reader034/viewer/2022042317/5f05d8dd7e708231d4150218/html5/thumbnails/22.jpg)
THANKS FOR YOUR ATTENTION!ATTENTION!
?? || \\ (1)?? || \\
______________ (1)Questions or comments
® Dario Rossi, Télécom-ParisTech
Contacts:Marco CAGNAZZO
Institut Télécom – Télécom ParisTech
Dép. Traitement Signal et Imagep g g
e‐mail: [email protected]