development of a 4k h.265/ hevc hw encoder · pdf fileelements hevc1 1080p60 encoder elements...
TRANSCRIPT
![Page 1: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/1.jpg)
The International Multimedia Telecommunications Consortium
Development of a 4K H.265/HEVC HW Encoder9th October [email protected] & Co-Founder NGCodec Inc.
1Saturday, October 5, 13
![Page 2: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/2.jpg)
The International Multimedia Telecommunications Consortium
Why NGCodec?
2Saturday, October 5, 13
![Page 3: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/3.jpg)
The International Multimedia Telecommunications Consortium
Video Sucks!
3Saturday, October 5, 13
![Page 4: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/4.jpg)
The International Multimedia Telecommunications Consortium
4Saturday, October 5, 13
![Page 5: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/5.jpg)
The International Multimedia Telecommunications Consortium
5Saturday, October 5, 13
![Page 6: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/6.jpg)
The International Multimedia Telecommunications Consortium
Realism!~20 years to the Holodeck
6Saturday, October 5, 13
![Page 7: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/7.jpg)
The International Multimedia Telecommunications Consortium
Video Quality Components
7Saturday, October 5, 13
![Page 8: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/8.jpg)
The International Multimedia Telecommunications Consortium
Resolution
8Saturday, October 5, 13
![Page 9: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/9.jpg)
The International Multimedia Telecommunications Consortium
Colorimetry8-‐bit
10-‐bit
X
Y
Z
CIE XYZ (1931)UHDTV (Rec 2020) GamutHDTV (Rec 709) GamutSDTV (Rec 601) Gamut
9Saturday, October 5, 13
![Page 10: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/10.jpg)
The International Multimedia Telecommunications Consortium
More Video ComponentsStereoscopy
LatencyHigh frame rate
200 degrees field of view
10Saturday, October 5, 13
![Page 11: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/11.jpg)
The International Multimedia Telecommunications Consortium
Codec, Bit-rate, Bandwidth
11Saturday, October 5, 13
![Page 12: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/12.jpg)
The International Multimedia Telecommunications Consortium
12Saturday, October 5, 13
![Page 13: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/13.jpg)
The International Multimedia Telecommunications Consortium
Watch the video online http://ngcodec.com/imtc2013
13Saturday, October 5, 13
![Page 14: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/14.jpg)
The International Multimedia Telecommunications Consortium
Implementation Challenges
14Saturday, October 5, 13
![Page 15: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/15.jpg)
The International Multimedia Telecommunications Consortium
Today vs Tomorrow
0x
1x
2x
3x
4x
Pixels (M) FPS Colour depth Codec
Today (H.264 1080p30 8-bit)Tomorrow (H.265 2160p60 10-bit)
40xComplexity
15Saturday, October 5, 13
![Page 16: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/16.jpg)
The International Multimedia Telecommunications Consortium
Hardware Implementation ChallengesBeing able to do 4K cost effectively (Multi-core)
Reference frame cache
HEVC, AVC 1080p60 encoder elements
HEVC 1080p60 encoder elements
Vide
o fram
e distrib
uFon
Memory interface
HEVC 1080p60 encoder elements
HEVC 1080p60 encoder elements
Control register interface
Rate control micro-‐processor
NAL and VQ micro-‐processor
1 engine, no WPP for 1080p4 engines with WPP for 4K resoluFon
Engine 1
Engine 2
Engine 3
Engine 4
WPP Processing of 4K (2160p) frame
16Saturday, October 5, 13
![Page 17: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/17.jpg)
The International Multimedia Telecommunications Consortium
Hardware Implementation Challenges (II)Larger blocks/Mode decision/Block partitioning
CB0 CB1
CB2 CB3CB4
CB5 CB6
CB0 CB1 CB2 CB3
CB4 CB5 CB6
H.264 H.265
17Saturday, October 5, 13
![Page 18: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/18.jpg)
The International Multimedia Telecommunications Consortium
Hardware Implementation Challenges (III)Intra prediction
HEVC/H.265AVC/H.264
18Saturday, October 5, 13
![Page 19: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/19.jpg)
The International Multimedia Telecommunications Consortium
4K
4K H.265 Video Conference4K UHD
19Saturday, October 5, 13
![Page 20: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/20.jpg)
The International Multimedia Telecommunications Consortium
4K
PC Software H.265 Encoding
Maximum resolution 480p30 8-bit
4K UHD
20Saturday, October 5, 13
![Page 21: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/21.jpg)
The International Multimedia Telecommunications Consortium
FPGA H.265 Encoding
Maximum resolution 2160p30 10-bit
4K UHD
21Saturday, October 5, 13
![Page 22: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/22.jpg)
The International Multimedia Telecommunications Consortium
Conclusions
Very challenging but possible to deliver 50%Diversity of encoder solutions, SW/FPGA/SoC
1080p30 can be everywhere <1Mbps
UHD 4K 10-bit is coming quicklyScalability extensions coming in 2014
$965.99 Seiki 50” UHD LED TV
4K UHD
22Saturday, October 5, 13
![Page 23: Development of a 4K H.265/ HEVC HW Encoder · PDF fileelements HEVC1 1080p60 encoder elements 1 n ... Larger blocks/Mode decision/Block partitioning CB0 CB1 CB2 CB3 CB4 ... Slides&Video](https://reader034.vdocuments.site/reader034/viewer/2022051722/5a9e8a907f8b9a67178b7f5b/html5/thumbnails/23.jpg)
The International Multimedia Telecommunications Consortium
Thank you – Q&A + DownloadsFree H.265 bit streams/Demo
http://ngcodec.com/hevc-bitstreamshttp://ngcodec.com/imtc2013
Slides & Video
23Saturday, October 5, 13