3-d virtual worlds for broadcast television ist project madison
DESCRIPTION
3-D virtual worlds for broadcast television IST project MADISON. Thierry Keutgen Senior Application Engineer DELTATEC [email protected] www.deltatec.b e. Television ?. Internet ?. Television ?. Internet on TV …… TV on Internet Is it the issue ? - PowerPoint PPT PresentationTRANSCRIPT
3-D virtual worlds for broadcast television3-D virtual worlds for broadcast television
IST project MADISONIST project MADISON
Thierry KeutgenSenior Application Engineer
DELTATEC
Brussels, 28th November 2003
Television ?Television ? Internet ?Internet ?
Brussels, 28th November 2003
Television ?Television ?
Internet on TV …… TV on InternetIs it the issue ?
Television is evolving in a new frameworkNew business models: pay TV, pay-per-view, games,T-commerce, …Content to multiple types of supports
Brussels, 28th November 2003
How do we make it happen ?How do we make it happen ?
Deltatec is a High-tech explorer for its customersSpecialist in broadcast
This revolution is an opportunity
It’s far from trivial … R&D work needed
Brussels, 28th November 2003
European IST ProjectEuropean IST Project
With real-world objectives it is a nice framework to
Meet technical experts
Meet industrial end-users
Explore new technical fields
Get a technical edge for our customers
Brussels, 28th November 2003
Idea – Issues - SolutionsIdea – Issues - Solutions
3-DMulti-user
Client-to-client interactionBroadcast
LatencyDistributed application
No demonstrator for the technology
IEEE DIS MPEG-4
Brussels, 28th November 2003
MPEG-4MPEG-4
MPEG-4 allows to wrap 3-D synthesis information into more general mulitmedia structures where video, audio, 3-D and image objects coexist and
interact
NOT low bit rate videoNOT encoding / decodingNOT internetBROADCAST
Brussels, 28th November 2003
ArchitectureArchitecture
ContentContentProviderProvider
Set-Top Box
Satellite/Cable
receiver
Satellite/Cable
receiver
Operating systemOperating system
Application Software
Application SoftwareNetwork
Layer
NetworkLayer
MPEG 4Subsystem
MPEG 4Subsystem
DataDataInjectorInjector DistributorDistributor
SimulationSimulationServerServer InternetInternet
TV setTV set
UserUserInteractionInteraction
devicesdevices
Brussels, 28th November 2003
Satellite/Cable
receiver
Satellite/Cable
receiver
Operating systemOperating system
Application Software
Application SoftwareNetwork
Layer
NetworkLayer
Set-Top Box
ContentContentProviderProvider MPEG 4
Subsystem
MPEG 4Subsystem
DataDataInjectorInjector DistributorDistributor
SimulationSimulationServerServer InternetInternet
TV setTV set
UserUserInteractionInteraction
devicesdevices
ArchitectureArchitecture
UserUserInteractionInteraction
devicesdevicesApplication
Software
Application Software
MPEG 4Subsystem
MPEG 4Subsystem
TV setTV set
Brussels, 28th November 2003
Satellite/Cable
receiver
Satellite/Cable
receiver
Operating systemOperating system
Application Software
Application SoftwareNetwork
Layer
NetworkLayer
Set-Top Box
ContentContentProviderProvider
DataDataInjectorInjector DistributorDistributor
SimulationSimulationServerServer InternetInternet
UserUserInteractionInteraction
devicesdevices
ArchitectureArchitecture
MPEG 4Subsystem
MPEG 4Subsystem
TV setTV setMPEG 4Subsystem
MPEG 4Subsystem
TV setTV set
Application Software
Application SoftwareInternetInternet
SimulationSimulationServerServer
DataDataInjectorInjector DistributorDistributor
Satellite/Cable
receiver
Satellite/Cable
receiver
UserUserInteractionInteraction
devicesdevicesNetwork
Layer
NetworkLayer
Brussels, 28th November 2003
PartnersPartners
Archetypon
Boostworks
Canal+ Belgique
Deltatec
EPFL
Memondo
Norsk Regnesentral
Brussels, 28th November 2003
Results producedResults produced
Simulation server – IEEE DIS-like message protocol
MPEG-4 over MPEG-2 injector
Network acceleration layer
Prototype STB
Brussels, 28th November 2003
Channel selectionChannel selection
Brussels, 28th November 2003
3-D virtual world3-D virtual world
Brussels, 28th November 2003
Interaction with context or other usersInteraction with context or other users
Brussels, 28th November 2003
Data InjectorData Injector
ContentContentProviderProvider
Set-Top Box
Satellite/Cable
receiver
Satellite/Cable
receiver
Operating systemOperating system
Application Software
Application SoftwareNetwork
Layer
NetworkLayer
MPEG 4Subsystem
MPEG 4Subsystem
DataDataInjectorInjector DistributorDistributor
SimulationSimulationServerServer InternetInternet
TV setTV set
UserUserInteractionInteraction
devicesdevices
DataDataInjectorInjector
Brussels, 28th November 2003
MPEG-4 over MPEG-2 injectorMPEG-4 over MPEG-2 injector
Different options to inject data over a MPEG-2 TS :
Raw data over a MPEG-2 TS
IP over MPEG-2 TS
MP4 file hinting and injection
«True» MPEG-4 SL-Packets embedding through a DMIF interface
Brussels, 28th November 2003
MPEG-4 over MPEG-2 injectorMPEG-4 over MPEG-2 injector
Based on a PCI board with:2 DVB ASI transmitters and 2 receiversReconfigurable I/O controller to process MPEG-2 TS
Applications:PID filtering and TS processing DVB MPEG-2 video serversInteractive Television (iTV)IP data insertion/Data broadcastingVideo over IP (VoIP)Video-on-Demand (VoD)
Brussels, 28th November 2003
SL-Packets injectorSL-Packets injector
Data InjectorData Injector
TS PacketBuilder
TS PacketBuilder
PSIMonitoringand Update
PSIMonitoringand Update
SimulationServer
DVB Server
DVBMultiplexer
FlexMux
CoreEmbedder
MPEG-2 TSMPEG-2 TSASIASI
MPEG-4MPEG-4descriptorsdescriptorsMPEG-4MPEG-4
SL-PacketsSL-Packets
TCP/IPTCP/IP
Brussels, 28th November 2003
MP4 file hinter and injectorMP4 file hinter and injector
DataData InjectorInjector
TS PacketBuilder
TS PacketBuilder
SimulationServer
HinterHinter
PSIMonitoringand Update
PSIMonitoringand Update
DVB Server
MPEG-2 TSMPEG-2 TSASIASI
MP4MP4 filefileTCP/IPTCP/IP
DVBMultiplexer
CoreEmbedder
CoreEmbedder
Local MP4 fileLocal MP4 file
Brussels, 28th November 2003
Prototype Set-Top BoxPrototype Set-Top Box
ContentContentProviderProvider
Set-Top Box
Satellite/Cable
receiver
Satellite/Cable
receiver
Operating systemOperating system
Application Software
Application SoftwareNetwork
Layer
NetworkLayer
MPEG 4Subsystem
MPEG 4Subsystem
DataDataInjectorInjector DistributorDistributor
SimulationSimulationServerServer InternetInternet
TV setTV set
UserUserInteractionInteraction
devicesdevices
Set-Top BoxSet-Top Box
Brussels, 28th November 2003
Prototype STB - MadBoxPrototype STB - MadBox
Based on a PC running Windows 2000QAM receiver board and demultiplexerMPEG-4 DMIF for
Local filesInternetBroadcast
Customised housingEverything managed through a TV remote control
Brussels, 28th November 2003
Broadcast DMIFBroadcast DMIF
Brussels, 28th November 2003
Broadcast DMIFBroadcast DMIFInstanceInstance
Broadcast DMIFBroadcast DMIF
BroadcastInstance Class
CallbackMethods
CallbackMethodsDAI Primitives
DAI Primitives
Top-level terminal layersTop-level terminal layers
Sync LayerSync Layer
Application Layers(Decoders + Compositor)
Application Layers(Decoders + Compositor)
Delivery LayerDelivery Layer
Delivery Medium (MPEG-2 Transport Stream)Delivery Medium (MPEG-2 Transport Stream)
FlexMuxFlexMux
DMIF FilterDMIF Filter
Local FilesDMIF
Local FilesDMIF Network
DMIF
NetworkDMIFBroadcast
DMIF
BroadcastDMIF Low-level TS access functionsLow-level TS access functions
MPEG-2 Parsing functionsMPEG-2 Parsing functions
MPEG-4 Parsing functionsMPEG-4 Parsing functions
Brussels, 28th November 2003
MPEG-4 for broadcast…MPEG-4 for broadcast…for nowfor now
MPEG-4 is not just low bit-rate video
Authoring tools are missing
3-D is really a step forward
MPEG-4 and 3-D are very demanding for the STB
Enhancements are good, content is key
Brussels, 28th November 2003
Next R&D stepNext R&D step
We are ready for MPEG-4 in broadcast
We want to go further
IST ENAMORADO project:
Production of multimedia content for live events: AR, metadata, transmission, …
Delivery to multiple types of mobile clients
Focus on MPEG-7, R&D on MPEG-21
Deltatec, Canal+, Siemens Mobile, …
Brussels, 28th November 2003
Get concreteGet concrete
Brussels, 28th November 2003
DELTA-asiDELTA-asi DELTA-sdiDELTA-sdiFrom a MADISON prototype … to a range of products
www.deltacast.tv
Brussels, 28th November 2003
Get concreteGet concrete
STB processing power is market-driven …
Manufacturers still to endorse the technology
Let’s demonstrate the technology on programs that pay
In football: ad insertion, synthetic replay, new camera
views, T-commerce, virtual after-match pub, …
