dash-avc/264 · 2020-07-16 · dash-avc/264 in html5 w3c html5 extensions to use system level media...

26
DASH-AVC/264 Towards an Interoperable OTT Video Delivery Solution June 27, 2013

Upload: others

Post on 25-Jul-2020

27 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH-AVC/264Towards an Interoperable OTT Video

Delivery SolutionJune 27, 2013

Page 2: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

BackgroundOTT Video and Standardization Efforts

2

Page 3: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Video is dominating the Internet

Internet: Real-time video is 50% of the traffic at peak periods notably 30% from Netflix and 11% from YouTube

Mobile: Video traffic is growing exponentially & is a large portion.

Fixed Internet Mobile Internet

3

Page 4: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Traditional Broadcast vs. Internet TV

Internet TV is better than traditional TV in 7 out of 8 experience categories, according to younger consumers

While traditional TV surpasses Internet TV only in quality, it delivers better “overall experience”

Quality Factors of Internet TV

Rebuffering/stalls

Audio-visual quality

Start-up latency

end-to-end delay

Other relevant factors:

scalable and cost-efficient delivery infrastructure

protection of assets

Internal Survey of Younger Consumers:

When comparing traditional and Internet TV, which option is better

for the following factors?

Traditional Internet

Content 7% 79%

Timing Control 7% 83%

Quality 80% 16%

Ease of Use 23% 52%

Control (FF, etc.) 9% 77%

Portability 4% 92%

Interactivity 31% 52%

Sharing 33% 56%

Overall Experience 53% 33%

Source: Cisco IBSG Youth Survey, Cisco IBSG Youth Focus Group Sessions, 2010

4

Page 5: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

HTTP Adaptive Streaming

Media Capture

& Encoding

Media

Origin

Servers

HTTP

Cache

Servers

Client

Devices

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

Split the video into small segments2

Encode each segment at multiple bitrates1

Make each segment addressable via a HTTP-URL

4Client makes decision on which segment to download

Client splices together and plays back

5

5

Encrypt each segment using CENC Specification3

DRM

License

Server

7

Client acquires a licensefor encrypted content6

DRM Encryption

Server

Page 6: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Next Steps

continue collecting conforming test vectors for DASH264

initiate informal interoperability efforts

define technical descriptions for extensions

support the additional efforts

MPEG standardization process

repository for metadata code points and profiles

development of reference client

deployment guidelines

coordinate with interop and testing organizations

demonstration and prototyping efforts

promotion of MPEG-DASH and DASH264

6

Why Standards?

Page 7: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

MPEG-DASH

ISO/IEC 23009-1

2012

3GPP

2009

OIPF

2009

MPEG

2010

Apple HLS

2008

Adobe HDS MS SS

2008

W3C

others

DASH IF

Standardized

Delivery Format

7

Page 8: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Media Presentation on

HTTP Server

What is specified – and what is not?

Segment

DASH Client

HTTP

Access

Client

DASH

Access

Engine

Media

Presentation

Description

(XML)

HTTP/1.1

Resources

located by

HTTP-URLs

Media

Engines

just-in-time

http requests

to segments

encapsulated

media

8

Page 9: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH Industry Forum

Founded with completion of MPEG standard in 08/12

Mission

Addressing the dramatic growth of broadband video by recommending a universal delivery format that provides end users with the best possible media experience by dynamically adapting to changing network conditions.

Objectives:

Promote and catalyze market adoption of MPEG-DASH

Publish interoperability and deployment guidelines

Facilitate interoperability tests

Collaborate with standard bodies and industry consortia in aligning ongoing DASH standards development and the use of common profiles across industry organizations

Please check and join at http://dashif.org

9

Page 10: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Members (67)

Page 11: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Achievements

Established a mediator role among different communities: standardization organizations, fora, interoperability groups, larger and smaller business entities, researchers, open source community, different players in eco system, public/press

successful demonstrations & events at IBC’12, MWC’13, NAB’13

published DASH-AVC/264 Interop Guidelines (details follow)

Established online repository including collection of profile and metadata identifiers: http://dashif.org/identifiers/

Conducted European Broadcasters survey http://goo.gl/Az2sw

established formal and informal communication with MPEG, HbbTV, IMTC, DVB, 3GPP, ATSC, NGMN, DTG, W3C, etc.

11

Page 12: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH-AVC/264Interoperability for DASH-based Video Services

Page 13: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Motivation

MPEG-DASH provides significant flexibility, but at the same time is not a complete specification as it agnostic of codecs, DRM and other functionalities

Building a service and client based on DASH poses questions and challenges, e.g.

Which codec do you support in your DASH client?

What segment encapsulation should the encoder generate?

How should DRM be signaled?

What closed captioning format do you support?

Hence, the DASH-IF decided to take initiative

filling these gaps and create baseline recommendations

creating interoperability efforts to spur fast adoption and accelerate growth

striving for compatibility with consortia standards

DASH-IF believes that DASH-AVC/264 supports the Internet streaming main use cases better than any existing proprietary solution

13

Page 14: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Use Cases and Functionalities

The initially considered use cases/functionalities are:

support for On-Demand, live and catch-up (network PVR) services

support for bitrate adaptivity by seamless Representation switching

support for high-definition AV-quality based on established and broadly supported codecs

support for basic accessibility (e.g. subtitles, closed captions)

support for content protection without committing to one DRM

support for easy and efficient delivery over HTTP-CDNs

support for late-binding, i.e. individual delivery of components

basic support for ad insertion and trick modes

Enhancements are considered in extensions, e.g.

Audio-visual enhancements (1080p, multichannel audio)

advanced codecs, advanced ad insertion, etc.

14

Page 15: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Interoperability Points in DASH-IF

Relevant collection of features that are considered for deployment scenarios

Interoperability Points provide Guidelines for content authors and client implementers on relevant features

Process to define IOPs in DASH-IF

define high-level summary, justification, use cases

identify supporters

provide technical description

define test cases

implement conformance and reference software

provide conforming test vectors and test services

define real-life test scenarios

define testing process and success criteria

Test

Vector

Generation

Test

Vector

conforms?

no

HTTP-

Server

yes

Live

Content

Generation

DASH

Client

Implemen-

tation

Client

Conforms?

no yes

Test Case

passed

15

Page 16: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH-AVC/264 Base IOP Overview

ISO base media file format Segments

ISO/IEC* 14496-12*: ISO Base Media File Format

ISO/IEC* 14496-14*: MP4 File Format

ISO/IEC* 14496-15*: Advanced Video Coding (AVC) file format with avc[1-4]

Video: H.264/AVC Progressive HP@ level 3.1

DASH264 SD: H.264/AVC MP@ level 3.0

Audio: HE-AACv2

Subtitles: SMPTE Timed Text

DRM baseline: ISO/IEC 23001-7 Common Encryption

DASH: Restricted Version ISO BMFF Live & On-Demand profile

HTTP Protocol Features (support for byte ranges, etc.)

16

Page 17: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

HTTP

Number-based

addressing

Time-based

addressing

Playlist-based

addressing

Byte-based

addressing

URLs

URLs

URLs

URLs

MPD

Segment

Index

Adaptiv

e stre

am

ing h

euristic

s

Media

download

(muxed)

Media

Segment

download

(unmuxed)

Audio ES

Video ES

Initialization

Segment

download

Segment

Index

download

ISO

Base

Media

File F

orm

at

Pars

er

Open G

oP

switc

hin

g

Clo

sed G

oP

switc

hin

g

Overview DASH-AVC/264 Client

Com

mon E

ncry

pti

on 2

3001-7

17

Subtitles

mult

iple

DRM

SM

PTE T

TH

E-A

ACv2

H.2

64/AVC

Pr

HP@

3.1

Page 18: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Under Development

Test Case/Vector/Service document is under

development, publication expected by 07/13 for

community review

Includes around 25 test cases that cover the features of

DASH-AVC/264

covers also real-world test scenarios for bitrate variation

Conformance Software is under development,

publication expected by 07/13 for community review

Cover conformance checks for DASH-AVC/264 features

Reference Client is under development next slide

18

Page 19: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Reference client

Delivered as an open source player, hosted on Github

https://github.com/Dash-Industry-Forum/dash.js

Leverages the Media Source Extensions and Encrypted Media

Extensions of the W3C. Enabled in Chrome v23+ and IE11+

Free to use and extend. Released under the BSD-3 license.

Supports the test vectors of DASH-AVC/264, along with

adaptive, late-binding, multi-bitrate playback.

Example player here:

http://dashif.org/reference/players/javascript/index.html

19

Page 20: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH-AVC/264 in HTML5

W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME)

MSE & EME allow

A DASH JavaScript player to stream the content without any need for plug-ins

The player to be downloaded as part of the webpage

IE 11 supports both MSE & EME

Chrome already supporting EME

DASH.JS: DASH-AVC/264 open source JavaScript reference player

20

Page 21: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Ongoing Work & Plans

Continue ongoing technical, promotional and support activities

Publication of Interoperability Guidelines:

DASH-AVC/264 Interoperability Point

published baseline version

published HD & Multichannel audio version for community review

publish test cases/vectors, conformance software and reference client by 07/13 for community review

publish initial DASH-HEVC/265 by 07/13 for community review

Ongoing Technical Support work

Ad Insertion and Events

Improved Supported Live Services

High-Quality Formats with DASH-HEVC/265

DRM Backend Interfaces

Collecting and addressing new use cases and scenarios

21

Page 22: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Why DASH and DASH-AVC/264?

DASH: only international open standard, developed and published by ISO

adopted and referenced by many application standards

addresses a multitude of simple and advanced use cases

enables highest-quality for multiscreen distribution and dynamic adaptive switching with maximum efficiency

enables reuse of existing content, devices and delivery infrastructure

DASH-AVC/264 commitment from many vendors and service providers to support and

enable deployment based on a single Interoperability Point

simple but powerful initial feature set of DASH, DRM and codecs to address urgent deployment use cases

backed by rigorous testing, conformance and reference software

enables revenue generation and differentiation based on solid footings

22

Page 23: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

Thank you

Upcoming Events

IBC 2013 - Sep 13-17,

Amsterdam, with DASH-IF

event on Sep 13, 6pm

SCTE CableTec expo in

Atlanta, Oct 21-24

InterBEE 2013 - Nov 13-15,

Tokyo, Japan with DASH

event on Nov 13

For details please visit us at

http://dashif.org

Q & A

23

Page 24: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

HTTP Adaptive Streaming

Media Capture & Encoding

Media Origin Servers HTTP Cache Servers Client Devices

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

001010100001010

010101010001110

01110100011010101

Encode each segment at multiple bitrates2

Split the video into small segments1

Make each segment addressable via a HTTP-URL3

Client makes decision on which segment to download

4

Client splices together and plays back5

24

Page 25: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

European Broadcasters Survey March 2013

Full report can be found at http://dashif.org/white-papers/

Page 26: DASH-AVC/264 · 2020-07-16 · DASH-AVC/264 in HTML5 W3C HTML5 extensions to use system level media engines: Media Source Extensions (MSE) & Encrypted Media Extensions (EME) MSE &

DASH-IF IOP Group – Ongoing Work

DASH-AVC/264 Interoperability Point

published baseline version (more details to follow)

published HD & Multichannel audio version for community review

will publish test cases/vectors, conformance software and reference client by 07/13 for community review

Task Forces on the following topics

Ad Insertion and Events

Live Services

DASH-HEVC/265

DRM Backend Interfaces

Reference Client

Communication with MPEG, 3GPP, HbbTV, ATSC, IMTC, DVB, …

26