Temporal resolutionDepth resolution
8K
4K
SD
QVGA240p
120p60i
30p
OLED
LCD
HDRBT.2020
DCI
12bit6bit
Spatial resolution
Lumi Dy-Range Color Dy-Range
2K
60p
LCD w/ LDsRGB
8bit10bit
FY11
Beyond UHD
UHD and mor e
Lu
min
ance
Lev
els
Real World
[cd
/m2
]
109
108
106
104
102
100
10-2
10-4
10-6
Sun light
Sun Direct
Indoor light
Moon light
Star light
Human Vision
Nig
ht
Vis
ion
Da
y V
isio
n
Typ
ica
l Ra
nge
w/o
ad
just
me
nt ~1
05
Current LCD Future TV
Vi s i on Dynami c Range
~1
03
~10
14
Cur r e nt s t andar d vi de o t r ans mi s s i on
6
3 digits
signal(8bit)
5 digits
Camera
Production(16bit,linear)
limitation: 8bits, 100cd/m2max
3 digits
LCD
Lossycompression
100 100
Resemblanceexpansion
信信信信信信
信信信si
gnal
leve
l
Real world real world
信信信信信信信信
disp
lay
brig
htne
ss
Production Transmission Displying
5 digits
LCD(LD),OLED
Current standard• production 信 5 digits• transmission 信 3 digits• displaying LCD 信 3 digits OLED, LCD(LD): 5 digits
↓
transmission is a bottleneck and information lost
created image transmitted as it is
HDR vi de o t r ans mi s s i on
7
5 digits
signal(10~12 bit,
nonLinear)
datacompression
displaymapping
5 digits
Camera
Production(16bit, linear)
X000
信信信信信信
信信
sign
al le
vel
real world X000real world
disp
lay
brig
htn
ess
production transmission displaying
5 digits
HDRdisp.
HDR standard• production 信 5 digits• transmission 信 5 digits
more• displaying HDR disp. 信 5 digits
↓
by HDR, created image can be
reproduced as it is
HDRと と と と と と と Wha t i s HDR 信 I t ' s a dva nt a ge
8
Panelluminance
Signallevel
100
500cd/ 信
Original Sourcecd/ 信
n-bit
Panelluminance
Signallevel
100
3000cd/ 信
Original Sourcecd/ 信
8bit
Bit 信 (n) 信信信信信信信信Banding 信信信信信信信信
ToneCurve
HDR, High Brightness DisplayLDR (current)
Source example( ととととととと )
信信信信信信信信信信信信信信信信信信信信信信信信信信信信信
信信信信信信信信信信信信信信信信信信信信
信信信信信信信信信信信信信信信信信信信信信信信
LDR, High Brightness Display
Panelluminance
Signallevel
100
Original Sourcecd/ 信
信信信信信信信信信信信信信信信信信信信
3000cd/ 信
8bit
HDR 信信信信信信 Display 信信信信信信信信信Combination of HDR video and high brightness disp.
Col or Vol ume c ompar i z on <BT. 2020 v. s . BT. 709>
9
BT.2020(10,000cd/m2) & BT.709(100cd/m2); Yxy
Wider gamut and higher brightness brings much more number of the colors
と Reproducing the glitter of light and color
BT.2020
BT.709
from Dolby material (light blue area can not be expressed by BT.709)
14Tech. Strategy Dept.
Capturing/Editing video mastering Transmitting Decoding Displaying
NativeContents
RawData
HDR s ol ut i on c andi dat e
HDR Video
LDRVideo
HDR Video
LDRVideo
EOTFHDR
HDR
LDREOTFgamma
HDR master
GameGFX
LinearHDR
LinearLDR
Panelcorrection
Panelcorrection
OETFHDR
OETFgamma
Enc DecFilmscan
Stillimage
Edit
CGComp
BroadcastIP delivery
Physical media(BD, DVD, memory)
Capturing/Post-production Transmission Displaying
Transmission Technology
Optical Electrical Transfer Function
Display Mapping
Technology
High Contrast Display
Technology
HDR Shooting Technology, HDR editing environment
15Tech. Strategy Dept.
Capturing/Editing video mastering Transmitting Decoding Displaying
NativeContents
RawData
HDR s ol ut i on c andi dat e
HDR Video
LDRVideo
HDR Video
LDRVideo
EOTFHDR
HDR
LDREOTFgamma
HDR master
GameGFX
LinearHDR
LinearLDR
Panelcorrection
Panelcorrection
OETFHDR
OETFgamma
Enc DecFilmscan
Stillimage
Edit
CGComp
BroadcastIP delivery
Physical media(BD, DVD, memory)
Capturing/Post-production Transmission Displaying
It is important to keep the environment for• individual technology evolution for each stage among the
workflow• individual selection of the video format: HDR, WCG,
Quantization number, spatial resolution
Transmission Technology
Optical Electrical Transfer Function
Display Mapping
Technology
High Contrast Display
Technology
HDR Shooting Technology, HDR editing environment
17Tech. Strategy Dept.
Capturing/Editing video mastering Transmitting Decoding Displaying
NativeContents
RawData
HDR s ol ut i on c andi dat e <Dol by Vi s i on>
HDR Video
LDRVideo
HDR Video
LDRVideo
EOTFHDR
HDR
LDREOTFgamma
HDR master
GameGFX
LinearHDR
LinearLDR
Panelcorrection
Panelcorrection
OETFHDR
OETFgamma
Enc DecFilmscan
Stillimage
Edit
CGComp
BroadcastIP delivery
Physical media(BD, DVD, memory)
Capturing/Post-production Transmission Displaying
Capturing• HDR cameraEditing• Dolby plug-in tool• HDR monitor
OETF• Barten model Dolby PQ curve Philips EOTF• Gamma base BBC curve BT.2020/BT.709
Transmission• Separate stream HDR/LDR• Scalable codec Dolby Layered MPEG SHVC• Compatible stream BBC Philips Technicolor
Signal Processing• Linear space convert Dolby PQ EOTF• Display mapping HDR, WCG
HDR panel• High brightness High power LED XDR• Local dimming # of division LD algorithm XDR• Dolby Monitor
18Tech. Strategy Dept.
Capturing/Editing video mastering Transmitting Decoding Displaying
NativeContents
RawData
HDR s ol ut i on c andi dat e <c ol l abor at i ve s ugge s t i on>
HDR Video
LDRVideo
HDR Video
LDRVideo
EOTFHDR
HDR
LDREOTFgamma
HDR master
GameGFX
LinearHDR
LinearLDR
Panelcorrection
Panelcorrection
OETFHDR
OETFgamma
Enc DecFilmscan
Stillimage
Edit
CGComp
BroadcastIP delivery
Physical media(BD, DVD, memory)
Capturing/Post-production Transmission Displaying
Capturing• HDR camera (Sony)Editing• plug-in tool (Technicolor)• HDR monitor (SIM2, XDR)
OETF• Barten model Dolby PQ curve Philips EOTF• Gamma base BBC curve BT.2020/BT.709
Transmission• Separate stream (MPEG regular) HDR/LDR• Scalable codec Dolby Layered MPEG SHVC• Compatible stream BBC Philips Technicolor
Signal Processing• Linear space convert EOTF (according to OETF)• Display mapping HDR, WCG (disp. manufac.)
HDR panel• High brightness High power LED (Toshiba) XDR (Sony)• Local dimming # of division LD algorithm (Toshiba) XDR (Sony)
Sony s ugge s t i on: ope n s t andar d s ys t e m
EOTF と Bar t e n mode l ( Dol by PQ, Phi l i ps EOTF unde r di s c us s i on)
or BBC EOTF ( unde r di s c us s i on @I TU)
• c r e a t or ' s c hoi c e
• me t a : ma s . br i ght ne s s , r e f e r e nc e whi t e , … ( unde r di s c us s i on)
Tr ans mi s s i on と Si ngl e l aye r ( r e gul ar s t r e am) と or SHVC
• f or c ur r e nt de c ode r : s i ngl e l a ye r ( s e pa r a t e s t r e a m f or HDR, LDR)
• SHVC<Sc a l a bl e HEVC> ( J ul / ' 14 s t a nda r di z e d @MPEG)
Re c e i ve r と ① Mul t i EOTF r e ady ②SHVC r e ady ( i f ne c e s s a r y)
• LDR EOTF ( ga mma ) , HDR EOTF ( Ba r t e n, BBC, e t c . )
• SHVC: whe n t r a ns mi s s i on s i de wi l l r e qui r e ( f or f ut ur e )
Col l abor at i ve Sugge s t i on f or HDR
20
Sony suggestion Dolby Vision
technology
EOTF multi EOTF(Barten family & Gamma family) PQ curve (Barten family)
max L variable (operational rule) 10,000cd/m^2
codec Single layer: AVC, HEVC Multi layer: SHVC(future)
Dolby Layered coding(proprietary)
Disp. mapping
meta data base & signal analysis base meta data base
meta data 3 levels: Mandatory/Standard/Expert proprietary
Band width
HDR only same as regular stream LDR+10~20%
HDR & LDR double or LDR+XX%(SHVC/RExt) LDR+10~20%
additional hardware
decoder: noEOTF: <multi> programmablenonLinear-Linear: yes (no w/ simple solution)
decoder: additional composer, meta extractorEOTF: <Dual> PQ, gamma(for LDR)nonLinear-Linear: yes
Sony s ugge s t i on vs Dol by Vi s i on
21TVPF Div.
Sony s ugge s t i on f or me t a
Eac h c ompany has t he i r own opi ni on about HDR
• movi e s t udi o: r i c h me t a ( but not one opi ni on)
• BBC- R&D: f e a r i ng mi s s i ng me t a s ome whe r e t r a ns mi s s i on s t a ge
• HDR f or ma t pr opos e r s : me t a br i ngs a dva nt a ge of t he i r s ugge s t i on
• SMPTE, MPEG信 me t a s houl d be s t a nda r di z e d
Sys t e m t o i nc l ude al l of t hos e r e que s t s
⇒ I nt r oduc i ng ' Le ve l ' of me t a
Le ve l - 1: ma nda t or y ( mi ni mum i nf or ma t i on t o ha ndl e HDR s i gna l )
Le ve l - 2: s t a nda r d ( s t a t i c i nf or ma t i on of c ont e nt i t s e l f )
Le ve l - 3: e xpe r t ( dyna mi c i nf o. of c ont e nt , va l ua bl e i nf o. f or di s pl a y ma ppi ng, …e t c . )
• Above i nf or ma t i on s houl d r e pr e s e nt c ol or vol ume , whi c h i nc l ude s l umi na nc e a nd c ol or i nf or ma t ion.
• Hi ghe r l e ve l i nc l ude s mor e opt i ona l i t e ms t o a ppl y ma ny i de a by pr opos e r s .
HDR me t a dat a
22TVPF Div.
HDR me t a dat a
Le ve l de f i ni t i on
LEVEL信 信 Mandat or y• s t at i c me t a f or c ol or gamut and EOTF ( ut i l i z i ng c ur r e nt s t a nda r d f or ma t )
• VUI : c ol or pr i ma r i e s , ma t r i x_c oe f f s , t r a ns f e r _c ha r a c t e r i c s
• c ol or pr i ma r i e s : BT2020 i s a va i l a bl e a t bot h AVC a nd HEVC
• EOTF: PQ i s a va i l a bl e a t HEVC onl y
LEVEL信 信 St andar d• St at i c me t a at mas t e r i ng ( ne w a ppl i c a t i on)
• VUI , Mas t e r i ng di s pl ay c ol or vol ume SEI : Col or s pa c e , mi n/ ma x l umi na nc e
• SEI i s a va i l a bl e a t HEVC onl y
LEVEL信 信 Expe r t• Dynami c me t a f or e ac h uni t , s c e ne or f r ame ( ne w a ppl i c a t i on)
• VUI , Kne e f unc t i on i nf or mat i on SEI と
• Lumi na nc e f or e a c h Sc e ne / f r a me ( Pe a k l umi na nc e ) , . . .
2014/6/2723
Sc ope
• Te c hnol ogy, St a nda r di z a t i on, Ope r a t i ona l s pe c , I nt e r ope r a bi l i t y
Pur pos e
• Bui l di ng e nt i r e wor kf l ow f or HDR
• Gua r a nt e e qua l i t y of ' HDR'
• Coope r a t i ng pr omot i on
• Common l ogo
Subj e c t s
• Cr e a t i on, Tr a ns mi s s i on, Di s pl a yi ng
• Equi pme nt , Cont e nt , Se r vi c e , . . .
HDR Col l abor at i on
26PTAS Div. / PTS Dept.
HDR s hoot i ng
Cont r as t pe r f or manc e
• ne e d e nough c ont r a s t f or huma n vi s i on s ys t e m
• ( s ugge s t i on) i ma ge c a n de s c r i be mor e t ha n 400% wi t h e nough ba ndi ng pe r for ma nc e
• ne e d t he ba c kgr ound of 400%, how t o e va l ua t e ba ndi ng pe r f or ma nc e
Tr ans mi s s i on pe r f or manc e
• ne e d t o t r a ns mi t e nough s i z e c ol or vol ume wi t h ne c e s s a r y i nf or ma t i on
• ( s ugge s t i on) mor e t ha n 10bi t , wi de r c ol or ga mut t ha n BT. 709, c ol or vol ume me t a i nf or ma t i on
HDR s pe c i f i c at i on ( 1) ( dr a f t )
27PTAS Div. / PTS Dept.
HDR t r ans mi s s i on
s i gnal f or mat r e qui r e me nt
• ne e d t o ha ve e nough c a pa c i t y a nd me t a da t a c a pa bi l i t y t o t r a ns mi t HDR vi de o
• ( s ugge s t i on) mor e t ha n 10bi t , mor e t ha n 400% l umi na nc e i nf or ma t i on, l a r ge r c ol or ga mut t ha n BT. 709, HDR me t a
HDR me t a r e qui r e me nt
• ne e d t o r e pr oduc e HDR/ WCG c ol or vol ume c or r e c t l y
• 3 l e ve l me t a
• ma nda t or y me t a
• s t a nda r d me t a
• e xpe r t me t a
• me t a mi ght be u t i l i z e d not onl y ne w HDR di s pl a y, e ve n c ur r e nt d i s pl a y t oo
• ne e d t o ke e p me t a da t a dur i ng t r a ns mi s s i on
HDR s pe c i f i c at i on ( 2) ( dr a f t )
28PTAS Div. / PTS Dept.
HDR di s pl ay
Br i ght ne s s pe r f or manc e
• ne e d t o ma ke pe opl e f e e l da z z l e d
• ( s ugge s t i on) 700c d/ m2 mor e w/ a r ul e f or a r e a
• ne e d da t a of c ur r e nt s t a t us
Cont r as t pe r f or manc e
• 信 信 信 信 dyna mi c r a nge 信 信 信 信 信 信 信 信 信 信 信 信 信 信
• ( s ugge s t i on) 105 mor e ( e . g. 0 . 01~1000c d/ m2) w/ c l a r i f i e d me a s ur e me nt me t hod
• ne e d da t a of c ur r e nt s t a t us
Bandi ng pe r f or manc e
• ne e d t o a voi d pe opl e s e e i ng ba ndi ng e a s i l y
• ( s ugge s t i on) Col or di f f e r e nc e l e s s t ha n 4dE00 ← de t a i l e d i nve s t i ga t i on i s ne c e s s a r y
• how t o ha ndl e d i t he r i ng f unc t i on, wha t ' s ki nd of e va l ua t i on e nvi r onme nt ?
HDR s pe c i f i c at i on ( 3) ( dr a f t )
29PTAS Div. / PTS Dept.