personal telepresence using scalable video coding alex eleftheriadis, chief scientist [email protected]
TRANSCRIPT
2 TNC-2008 / May 21, 2008
Videoconferencing Industry – Quality vs. Scale
10 1000 1,000,000
Low Definition
Standard Definition
High Definition
10,000Number ofEnd Points
Resolution
Qu
ali
tyIn
tera
cti
vit
yCisco, HP, PolycomTandberg, LifeSize
$10K-$300KEndpoint
Price-Performance,Interactivity
Existing Technology
All Vendors
Cisco, Microsoft,Nortel, Avaya,Siemens
Skype, Yahoo, AOL,Adobe, Google
3 TNC-2008 / May 21, 2008
Key Videoconferencing System Characteristics
Rate Matching Support for heterogeneous endpoints and access networks
Personalized Layout Each user selects the resolution and users he/she wants to see
Delay Interactivity requires <200msec end-to-end
Error Resilience Tolerance to packet loss rates >10%
Error Localization An error in one user should not affect other users
Complexity Lower complexity = Lower cost Low complexity allows to integrate with existing network services (e.g., in cheap routers)
4 TNC-2008 / May 21, 2008
H.264 SVC
Scalable Video Coding (SVC) Developed by JVT (=Joint Video Team of ITU and ISO)
SVC is Amendment 3 to H.264 AVC Most of SVC is in Annex G of H.264 AVC CFP April 2004, Consented in Nov 2007 RTP payload format should go to last-call in July 2008 IETF (Dublin)
Vidyo™ is the first company to offer H.264/SVC standard-based solution to solve video conferencing challengesArchitecture centered on VidyoRouter™
5 TNC-2008 / May 21, 2008
Temporal Structure of Non-Scalable Codecs
6 TNC-2008 / May 21, 2008
Temporal Scalability
7 TNC-2008 / May 21, 2008
Spatial Scalability
Hierarchical MCP &Intra prediction
Base layercoding
texture
motion
MultiplexScalable
bit-stream
H.264/AVC MCP &Intra prediction
Base layercoding
texture
motion
H.264/AVC compatible encoder
H.264/AVC-compatiblebase layer bit-stream
Inter-layer prediction:•Intra•Motion•Residual
Hierarchical MCP &Intra prediction
Base layercoding
texture
motion
Inter-layer prediction:•Intra•Motion•Residual
Spatialdecimation
Spatialdecimation
8 TNC-2008 / May 21, 2008
Temporal + Spatial Scalability
9 TNC-2008 / May 21, 2008
Temporal + Spatial Scalability
QVGA30 fps
10 TNC-2008 / May 21, 2008
Temporal + Spatial Scalability
VGA15 fps
11 TNC-2008 / May 21, 2008
Multipoint with Native Rate Matching
High ResolutionHigh Frame Rate
Low ResolutionLow Frame Rate
1.5Mbps
512Kbps
128Kbps
Medium ResolutionMedium Frame Rate
256Kbps
Medium ResolutionHigh Frame Rate
High ResolutionHigh Frame Rate
Vid
yoR
ou
ter™
12 TNC-2008 / May 21, 2008
Traditional Transcoding MCU
ENCODE
DECODE
ENCODE
DECODE
Packet Loss Sensitivity, Requires
Dedicated Network
High CostHigh Delay
Quality Degradation
13 TNC-2008 / May 21, 2008
VidyoRouter™
VidyoRoom™ Endpoint
VidyoDesktop™ Endpoint
VidyoRoom™ Endpoint
ENCODE
DECODE
ENCODE
VidyoRouter™
14 TNC-2008 / May 21, 2008
VidyoRouter™ vs. MCU
VidyoRouter is simply an application layer router Nearly zero-delay (~10msec), allows cascading Eliminates video quality loss due to transcoding Extremely low cost of compute power
Limiting parameter is network I/O bandwidth and not number of video streams or resolution
Endpoint processing of the video from different participants makes the VidyoRouter highly scalable
Rate matching and personalized layout are routing decisions
Similar complexity to other network appliances
COMPOSE
DECODE
ENCODE
DECODE
ROUTE
MCUVidyoRouter
USER 1 USER 1 USER 2USER 2
USER 3
USER 3
15 TNC-2008 / May 21, 2008
HD at 60 fps on Every Port
9-site call (US and Europe) mixing HD Rooms and VGA desktops across the public Internet
16 TNC-2008 / May 21, 2008
Error Resilience
Low Reliability Channel
High Reliability Channel
Significant ImpactConventional Coding
Scalable Coding
Minor or No Impact
17 TNC-2008 / May 21, 2008
MCU vs. VidyoRouter™: Computation
Feature MCU VidyoRouter
Rate matching Transcoding FreePersonalized layout Transcoding FreeFrame Rate Increase
(30fps to 50fps)Faster Transcoding None
HD overhead for Server High MinimalMax resolution limited by Server ClientServer Complexity High LowServer Scalability Low Very HighObsolescence Risk High LowCompatibility with H.264 AVC √ √Server Integration with Routers √
Transcoding MCU is complex, adds delay and distortion, and scales poorly Move to HD 720p to HD 1080p to HD 1600p requires “forklift” upgrade for a
transcoding MCU
18
MCU vs. VidyoRouter™: Network
Feature MCU VidyoRouter
Rate matching Transcoding Free
Error Resilience (packet loss) 3% 20% +
End-to-End Delay
Switched Server~150-200ms ~150-200ms
End-to-End Delay
Multipoint Server~400+ms ~150-200ms
Max resolution limited by Server Client
Cascaded Servers √
VidyoRouter operates effectively over the InternetCascading VidyoRouters improves user experience, even in point-to-point calls
19 TNC-2008 / May 21, 2008
Videoconferencing Industry – The Future
10 1000 1,000,000
Low Definition
Standard Definition
High Definition
10,000Number ofEnd Points
Resolution
Qu
ali
tyIn
tera
cti
vit
yCisco, HP, PolycomTandberg, LifeSize
$10K-$300KEndpoint
Price-Performance,Interactivity
Existing Technology
All Vendors
Cisco, Microsoft,Nortel, Avaya,Siemens
Skype, Yahoo, AOL,Adobe, Google
20 April 21, 2023 Vidyo Proprietary Confidential & Patent Pending Information
VidyoConferencing™ Components
21 TNC-2008 / May 21, 2008
VidyoConferencing™ Summary
21
Based on a new standard H.264 SVC, the first effective video codec truly designed for converged IP Networks (Internet)
Much better user experience: better quality, easier to use, more naturalHD becomes deployable everywhere and can reach any desktop or laptop over shared IP networksA unified video solution from telepresence to desktop
An affordable and scalable architecture that matches the Internet model
22 TNC-2008 / May 21, 2008
Vidyo™ Demo
Demo to be held after the end of the session (transatlantic connection using laptop over WiFi connection)
Demo accounts can be set up upon request on the Vidyo system hosted by Surfnet (http://vidyo.showcase.surfnet.nl).
Contact: Eric Le Guiniec, [email protected]
22