3-d virtual worlds for broadcast television ist project madison

3-D virtual worlds for broadcast television3-D virtual worlds for broadcast television

IST project MADISONIST project MADISON

Thierry KeutgenSenior Application Engineer

DELTATEC

t.keutgen@deltatec.bewww.deltatec.be

Brussels, 28th November 2003

Television ?Television ? Internet ?Internet ?

Brussels, 28th November 2003

Television ?Television ?

Internet on TV …… TV on InternetIs it the issue ?

Television is evolving in a new frameworkNew business models: pay TV, pay-per-view, games,T-commerce, …Content to multiple types of supports

Brussels, 28th November 2003

How do we make it happen ?How do we make it happen ?

Deltatec is a High-tech explorer for its customersSpecialist in broadcast

This revolution is an opportunity

It’s far from trivial … R&D work needed

Brussels, 28th November 2003

European IST ProjectEuropean IST Project

With real-world objectives it is a nice framework to

Meet technical experts

Meet industrial end-users

Explore new technical fields

Get a technical edge for our customers

Brussels, 28th November 2003

Idea – Issues - SolutionsIdea – Issues - Solutions

3-DMulti-user

Client-to-client interactionBroadcast

LatencyDistributed application

No demonstrator for the technology

IEEE DIS MPEG-4

Brussels, 28th November 2003

MPEG-4MPEG-4

MPEG-4 allows to wrap 3-D synthesis information into more general mulitmedia structures where video, audio, 3-D and image objects coexist and

interact

NOT low bit rate videoNOT encoding / decodingNOT internetBROADCAST

Brussels, 28th November 2003

ArchitectureArchitecture

ContentContentProviderProvider

Set-Top Box

Satellite/Cable

receiver

Satellite/Cable

receiver

Operating systemOperating system

Application Software

Application SoftwareNetwork

Layer

NetworkLayer

MPEG 4Subsystem

MPEG 4Subsystem

DataDataInjectorInjector DistributorDistributor

SimulationSimulationServerServer InternetInternet

TV setTV set

UserUserInteractionInteraction

devicesdevices

Brussels, 28th November 2003

Satellite/Cable

receiver

Satellite/Cable

receiver

Operating systemOperating system

Application Software

Application SoftwareNetwork

Layer

NetworkLayer

Set-Top Box

ContentContentProviderProvider MPEG 4

Subsystem

MPEG 4Subsystem

DataDataInjectorInjector DistributorDistributor

SimulationSimulationServerServer InternetInternet

TV setTV set

UserUserInteractionInteraction

devicesdevices

ArchitectureArchitecture

UserUserInteractionInteraction

devicesdevicesApplication

Software

Application Software

MPEG 4Subsystem

MPEG 4Subsystem

TV setTV set

Brussels, 28th November 2003

Satellite/Cable

receiver

Satellite/Cable

receiver

Operating systemOperating system

Application Software

Application SoftwareNetwork

Layer

NetworkLayer

Set-Top Box

ContentContentProviderProvider

DataDataInjectorInjector DistributorDistributor

SimulationSimulationServerServer InternetInternet

UserUserInteractionInteraction

devicesdevices

ArchitectureArchitecture

MPEG 4Subsystem

MPEG 4Subsystem

TV setTV setMPEG 4Subsystem

MPEG 4Subsystem

TV setTV set

Application Software

Application SoftwareInternetInternet

SimulationSimulationServerServer

DataDataInjectorInjector DistributorDistributor

Satellite/Cable

receiver

Satellite/Cable

receiver

UserUserInteractionInteraction

devicesdevicesNetwork

Layer

NetworkLayer

Brussels, 28th November 2003

PartnersPartners

Archetypon

Boostworks

Canal+ Belgique

Deltatec

EPFL

Memondo

Norsk Regnesentral

Brussels, 28th November 2003

Results producedResults produced

Simulation server – IEEE DIS-like message protocol

MPEG-4 over MPEG-2 injector

Network acceleration layer

Prototype STB

Brussels, 28th November 2003

Channel selectionChannel selection

Brussels, 28th November 2003

3-D virtual world3-D virtual world

Brussels, 28th November 2003

Interaction with context or other usersInteraction with context or other users

Brussels, 28th November 2003

Data InjectorData Injector

ContentContentProviderProvider

Set-Top Box

Satellite/Cable

receiver

Satellite/Cable

receiver

Operating systemOperating system

Application Software

Application SoftwareNetwork

Layer

NetworkLayer

MPEG 4Subsystem

MPEG 4Subsystem

DataDataInjectorInjector DistributorDistributor

SimulationSimulationServerServer InternetInternet

TV setTV set

UserUserInteractionInteraction

devicesdevices

DataDataInjectorInjector

Brussels, 28th November 2003

MPEG-4 over MPEG-2 injectorMPEG-4 over MPEG-2 injector

Different options to inject data over a MPEG-2 TS :

Raw data over a MPEG-2 TS

IP over MPEG-2 TS

MP4 file hinting and injection

«True» MPEG-4 SL-Packets embedding through a DMIF interface

Brussels, 28th November 2003

MPEG-4 over MPEG-2 injectorMPEG-4 over MPEG-2 injector

Based on a PCI board with:2 DVB ASI transmitters and 2 receiversReconfigurable I/O controller to process MPEG-2 TS

Applications:PID filtering and TS processing DVB MPEG-2 video serversInteractive Television (iTV)IP data insertion/Data broadcastingVideo over IP (VoIP)Video-on-Demand (VoD)

Brussels, 28th November 2003

SL-Packets injectorSL-Packets injector

Data InjectorData Injector

TS PacketBuilder

TS PacketBuilder

PSIMonitoringand Update

PSIMonitoringand Update

SimulationServer

DVB Server

DVBMultiplexer

FlexMux

CoreEmbedder

MPEG-2 TSMPEG-2 TSASIASI

MPEG-4MPEG-4descriptorsdescriptorsMPEG-4MPEG-4

SL-PacketsSL-Packets

TCP/IPTCP/IP

Brussels, 28th November 2003

MP4 file hinter and injectorMP4 file hinter and injector

DataData InjectorInjector

TS PacketBuilder

TS PacketBuilder

SimulationServer

HinterHinter

PSIMonitoringand Update

PSIMonitoringand Update

DVB Server

MPEG-2 TSMPEG-2 TSASIASI

MP4MP4 filefileTCP/IPTCP/IP

DVBMultiplexer

CoreEmbedder

CoreEmbedder

Local MP4 fileLocal MP4 file

Brussels, 28th November 2003

Prototype Set-Top BoxPrototype Set-Top Box

ContentContentProviderProvider

Set-Top Box

Satellite/Cable

receiver

Satellite/Cable

receiver

Operating systemOperating system

Application Software

Application SoftwareNetwork

Layer

NetworkLayer

MPEG 4Subsystem

MPEG 4Subsystem

DataDataInjectorInjector DistributorDistributor

SimulationSimulationServerServer InternetInternet

TV setTV set

UserUserInteractionInteraction

devicesdevices

Set-Top BoxSet-Top Box

Brussels, 28th November 2003

Prototype STB - MadBoxPrototype STB - MadBox

Based on a PC running Windows 2000QAM receiver board and demultiplexerMPEG-4 DMIF for

Local filesInternetBroadcast

Customised housingEverything managed through a TV remote control

Brussels, 28th November 2003

Broadcast DMIFBroadcast DMIF

Brussels, 28th November 2003

Broadcast DMIFBroadcast DMIFInstanceInstance

Broadcast DMIFBroadcast DMIF

BroadcastInstance Class

CallbackMethods

CallbackMethodsDAI Primitives

DAI Primitives

Top-level terminal layersTop-level terminal layers

Sync LayerSync Layer

Application Layers(Decoders + Compositor)

Application Layers(Decoders + Compositor)

Delivery LayerDelivery Layer

Delivery Medium (MPEG-2 Transport Stream)Delivery Medium (MPEG-2 Transport Stream)

FlexMuxFlexMux

DMIF FilterDMIF Filter

Local FilesDMIF

Local FilesDMIF Network

DMIF

NetworkDMIFBroadcast

DMIF

BroadcastDMIF Low-level TS access functionsLow-level TS access functions

MPEG-2 Parsing functionsMPEG-2 Parsing functions

MPEG-4 Parsing functionsMPEG-4 Parsing functions

Brussels, 28th November 2003

MPEG-4 for broadcast…MPEG-4 for broadcast…for nowfor now

MPEG-4 is not just low bit-rate video

Authoring tools are missing

3-D is really a step forward

MPEG-4 and 3-D are very demanding for the STB

Enhancements are good, content is key

Brussels, 28th November 2003

Next R&D stepNext R&D step

We are ready for MPEG-4 in broadcast

We want to go further

IST ENAMORADO project:

Production of multimedia content for live events: AR, metadata, transmission, …

Delivery to multiple types of mobile clients

Focus on MPEG-7, R&D on MPEG-21

Deltatec, Canal+, Siemens Mobile, …

Brussels, 28th November 2003

Get concreteGet concrete

Brussels, 28th November 2003

DELTA-asiDELTA-asi DELTA-sdiDELTA-sdiFrom a MADISON prototype … to a range of products

www.deltacast.tv

Brussels, 28th November 2003

Get concreteGet concrete

STB processing power is market-driven …

Manufacturers still to endorse the technology

Let’s demonstrate the technology on programs that pay

In football: ad insertion, synthetic replay, new camera

views, T-commerce, virtual after-match pub, …

Brussels, 28th November 2003

Thank you

Thierry Keutgent.keutgen@deltatec.be

+32 4 239 78 80

www.deltatec.be