creating cinematic wide gamut hdr-video for the evaluation ...froehlichj/hdm-hdr-2014... · j....
TRANSCRIPT
![Page 1: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/1.jpg)
J. Froehlich, S. Grandinetti! Slide 1 of 35!Creating Wide Gamut High Dynamic Range Video!
Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays !
SPIE Electronic Imaging 2014!!
Jan Froehlich, Stefan Grandinetti, Bernd Eberhardt, Simon Walter, Andreas Schilling, Harald Brendel
!!
![Page 2: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/2.jpg)
J. Froehlich, S. Grandinetti! Slide 2 of 35!Creating Wide Gamut High Dynamic Range Video!
Outline of the Talk!
- Motivation!- Methods!
- Mirror Rig!
- Limitations!- Ghostings!- Flare and Straylight!
- Results!- Future Work!- Conclusion!
![Page 3: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/3.jpg)
J. Froehlich, S. Grandinetti! Slide 3 of 35!Creating Wide Gamut High Dynamic Range Video!
Motivation!
- Brightness and dynamic range of consumer displays will probably increase over the next years:!
h"p://variety.com/2014/digital/columns/when<it<comes<to<tvs<forget<4k<its<the<brightness<stupid<1201055191/B(receivedB19.01.2014)B
![Page 4: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/4.jpg)
J. Froehlich, S. Grandinetti! Slide 4 of 35!Creating Wide Gamut High Dynamic Range Video!
Motivation!
- Plenty of test image sets for still image manipulation!- No comprehensive data set for HDR-Video manipulation yet
established.!
Kodak,BKodimBImageBSequenceB ‘Lena’BImageB
![Page 5: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/5.jpg)
J. Froehlich, S. Grandinetti! Slide 5 of 35!Creating Wide Gamut High Dynamic Range Video!
Motivation!
- Existing HDR video data sets show non-staged everyday scenes without cinematic staging and lighting!
Krawczyk,BG.B,BHDRBVideoBSamplesB Ungers,BJ.,BLiUBHDRvBRepositoryB<BResourcesB
![Page 6: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/6.jpg)
J. Froehlich, S. Grandinetti! Slide 6 of 35!Creating Wide Gamut High Dynamic Range Video!
Motivation!
Image quality is not only determined by !- Signal quality of the image acquisition system!
But also by!- Lighting!- Make-up!- Staging!- Framing!- Acting!
‘Lena’BImageBStefanBinBhisBofficeB
![Page 7: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/7.jpg)
J. Froehlich, S. Grandinetti! Slide 7 of 35!Creating Wide Gamut High Dynamic Range Video!
Methods!
Use a mirror rig to enhance dynamic range!
Quelle: http://www.dlp.com!
![Page 8: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/8.jpg)
J. Froehlich, S. Grandinetti! Slide 8 of 35!Creating Wide Gamut High Dynamic Range Video!
Methods!
Image processing pipeline (In-camera processing)!
Quelle: http://www.dlp.com!
![Page 9: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/9.jpg)
J. Froehlich, S. Grandinetti! Slide 9 of 35!Creating Wide Gamut High Dynamic Range Video!
Methods!
Image processing pipeline (Postproduction)!!
Quelle: http://www.dlp.com!
![Page 10: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/10.jpg)
J. Froehlich, S. Grandinetti! Slide 10 of 35!Creating Wide Gamut High Dynamic Range Video!
Quelle: http://www.dlp.com!
LowlightBPreservingBImageB
![Page 11: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/11.jpg)
J. Froehlich, S. Grandinetti! Slide 11 of 35!Creating Wide Gamut High Dynamic Range Video!
Quelle: http://www.dlp.com!
HighlightBPreservingBImageB
![Page 12: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/12.jpg)
J. Froehlich, S. Grandinetti! Slide 12 of 35!Creating Wide Gamut High Dynamic Range Video!
Quelle: http://www.dlp.com!
RecWfiedBHighlightBPreservingBImageB
![Page 13: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/13.jpg)
J. Froehlich, S. Grandinetti! Slide 13 of 35!Creating Wide Gamut High Dynamic Range Video!
Quelle: http://www.dlp.com!
CombinaWonB
![Page 14: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/14.jpg)
J. Froehlich, S. Grandinetti! Slide 14 of 35!Creating Wide Gamut High Dynamic Range Video!
Limitations!
Double contours in long focal length shots!
Quelle: http://www.dlp.com!
HighlightBPreservingB(HLP)BBHLPBw.BDeConvoluWonBBBBBBHLPBCombinedBwithBLowlightBBB B B BBBBBPreservingBImageB
TheBreflecWonBatBtheBsideBofBtheBmirrorBtowardsBtheBLowBlightBpreservingBCameraB(94%)BcausesBdoubleBcontoursBinBtheBBHighlightBperservingBcamera.B(DashedBLine)B
![Page 15: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/15.jpg)
J. Froehlich, S. Grandinetti! Slide 15 of 35!Creating Wide Gamut High Dynamic Range Video!
Limitations!
Flares & Straylight!
![Page 16: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/16.jpg)
J. Froehlich, S. Grandinetti! Slide 16 of 35!Creating Wide Gamut High Dynamic Range Video!
Staging HDR challenges!
Quelle: http://www.dlp.com!
< BCinemaWcBlookBofBmoviesBorBcommercialsB< BCharacterfulBlighWngBdesignBinBstudio<scenesB<BDocumentaryBsceneriesBrepresentBdifficultBlighWngBsituaWonsB
![Page 17: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/17.jpg)
J. Froehlich, S. Grandinetti! Slide 17 of 35!Creating Wide Gamut High Dynamic Range Video!
Four categories!
1. Sunlight Scenes!!!2. Low Key Scenes!!!3. Wide Gamut and Moving Lights!!!4. High Contrast Skintones!
B BB
Quelle: http://www.dlp.com!
![Page 18: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/18.jpg)
J. Froehlich, S. Grandinetti! Slide 18 of 35!Creating Wide Gamut High Dynamic Range Video!
Presentation of the Material!
B BB
Quelle: http://www.dlp.com!
- Note:!
- The interactive presentation of the HDR-video test set is not included in this presentation.!
![Page 19: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/19.jpg)
J. Froehlich, S. Grandinetti! Slide 29 of 35!Creating Wide Gamut High Dynamic Range Video!
Results!
0BStopsB
B<5BStopsB
95%BQuanWleBBB50%BQuanWleB(Median)BBB5%BQuanWleBB
![Page 20: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/20.jpg)
J. Froehlich, S. Grandinetti! Slide 30 of 35!Creating Wide Gamut High Dynamic Range Video!
Results!
- High temporal contrasts present challenges for video tone mapping operators!
„Showgirl“B OffsetBbetweenBfirstBandBsecondBrowBbeforeBdelinearisaWonBtoBsRGB:B5BStopsB/B1:32B
![Page 21: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/21.jpg)
J. Froehlich, S. Grandinetti! Slide 31 of 35!Creating Wide Gamut High Dynamic Range Video!
Results!
- Different display technologies show different weaknesses!
Example:BDeficienciesBofBvariableBbacklightBmonitorsB
![Page 22: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/22.jpg)
J. Froehlich, S. Grandinetti! Slide 32 of 35!Creating Wide Gamut High Dynamic Range Video!
Results – Evaluation of HDR Displays:!
- Example: Deficiencies of variable backlight monitors !
- FOTOS DOLBY KERZEN!
![Page 23: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/23.jpg)
J. Froehlich, S. Grandinetti! Slide 33 of 35!Creating Wide Gamut High Dynamic Range Video!
Results – Evaluation of HDR Displays:!
- Example: Deficiencies of variable backlight monitors !
- FOTOS DOLBY KERZEN!
![Page 24: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/24.jpg)
J. Froehlich, S. Grandinetti! Slide 34 of 35!Creating Wide Gamut High Dynamic Range Video!
Future Work!
- Material appearance is improved through capturing a wider dynamic range e.g. specular highlights!
- Reproduction of bright light sources and saturated highlights closer to human perception!!!
- High contrast images provide new esthetics for image design!
- HDR is a new enrichment for cinematic storytelling !!
![Page 25: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/25.jpg)
J. Froehlich, S. Grandinetti! Slide 35 of 35!Creating Wide Gamut High Dynamic Range Video!
Conclusion!
- We created a new HDR-Video dataset.!
- Cinematically staged scenes facilitate image quality assessment.!
- High temporal and spatial contrasts provide a challenge for tone mapping operators and HDR-displays.!
- Freely available for academic use. Download at the project website: http://www.hdm-stuttgart.de/~froehlichj/hdm-hdr-2014/ !
![Page 26: Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J. Froehlich, S. Grandinetti! Creating Wide Gamut High Dynamic Range Video! Slide 1 of](https://reader031.vdocuments.site/reader031/viewer/2022011918/5ffbef85c658314ce27bca65/html5/thumbnails/26.jpg)
J. Froehlich, S. Grandinetti! Slide 36 of 35!Creating Wide Gamut High Dynamic Range Video!
Thank you for joining our talk!!