vod (arroyo) overview - cisco (arroyo) overview per jensen, [email protected] ... time shifted tv svod...
TRANSCRIPT
1© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential 1© 2006 Cisco Systems, Inc. All rights reserved.VCNBU - jkb Cisco Confidential
VoDVoD (Arroyo) Overview(Arroyo) Overview
Per Jensen, [email protected] Jensen, [email protected] 2006December 2006
2© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Arroyo Now Part of Cisco Video & Content Arroyo Now Part of Cisco Video & Content Networking BU (VCNBU)Networking BU (VCNBU)
•• TimelineTimeline–– 2002: Founded2002: Founded
–– 2004: Field trials2004: Field trials
–– 20052005--2006: Production deployments serving 1M streams/month2006: Production deployments serving 1M streams/month
•• Strong customer baseStrong customer base–– 11 deployments at 6 of North American top 10 11 deployments at 6 of North American top 10 MSOMSO’’ss
–– VOD and VOD and nPVRnPVR trials in other top Telco's and trials in other top Telco's and MSOMSO’’ss
•• Impressive networking heritageImpressive networking heritage–– Paul Paul ShererSherer –– CTO (former CTO of 3Com)CTO (former CTO of 3Com)
++ Originated many current Ethernet technologies/standardsOriginated many current Ethernet technologies/standards
–– Drew Major Drew Major –– Chief Scientist (author of Novell Netware)Chief Scientist (author of Novell Netware)++ Pioneered Pioneered ““networking operating systemnetworking operating system”” and and ““many as onemany as one””
++ Now a Cisco FellowNow a Cisco Fellow
3© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Personalized EntertainmentPersonalized EntertainmentBlend of OnBlend of On--Demand and Broadcast Content DeliveryDemand and Broadcast Content Delivery
•• On Demand TV is top selling On Demand TV is top selling MSO service & table stakes for MSO service & table stakes for telco IPTV offeringtelco IPTV offering–– Driven by host of new Driven by host of new
applicationsapplications
–– Comcast delivered 1.5B streams Comcast delivered 1.5B streams in 2005in 2005
•• Broadcast TV becoming more Broadcast TV becoming more ““personalpersonal””–– New New ““BroadcastBroadcast”” applications applications
are driving this furtherare driving this further
•• Puts a host of new demands on Puts a host of new demands on the video platformthe video platform
• Real-time ingest rates
• Massive stream scale
• Flexible content distribution
• High availability
New Video Platform Demands
4© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Typical VOD SystemTypical VOD System
Trans-codersTransTrans--coderscoders
Transport Network
Aggregation Network
Access (HFC/DSL) Network
STBSTB
End-User AppsTime Shifted TV
sVODnVOD(i)VOD
End-User AppsTime Shifted TV
sVODnVOD(i)VOD
System AppsVideo Control
BillingSubscriber Management
System AppsVideo Control
BillingSubscriber Management
Connection/Control System
Connection/Control Connection/Control SystemSystem
Billing Management System
Billing Management Billing Management SystemSystem
EncoderEncoderEncoder Asset Management System
Asset Management Asset Management SystemSystem
VOD (Streaming) VOD (Streaming) ServersServers
VOD VOD ServersServers
PitcherPitcherCatcherCatcher
Asset Distribution Asset Distribution Interface (ADI)Interface (ADI)
Forms of VODForms of VOD•• Subscription VideoSubscription Video--onon--Demand Demand
(SVOD) (SVOD) •• Free VideoFree Video--OnOn--Demand (FVOD) Demand (FVOD) •• HDTVHDTV--onon--Demand (HDVOD) Demand (HDVOD) •• NetworkNetwork--based Personal Video based Personal Video
Recording (Recording (nPVRnPVR) ) •• Public, Educational & Governmental Public, Educational & Governmental
OnOn--Demand (PEGDemand (PEG--OD) OD) •• Distance Learning (Distance Learning (EduVODEduVOD) ) •• EducationEducation--onon--Demand Demand •• Advanced Advertising Advanced Advertising •• Interactive TV (Interactive TV (iTViTV) )
5© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Typical VOD SystemTypical VOD System
TransTrans--coderscoders
Transport Network
Aggregation Network
Access (HFC/DSL) Network
STBSTB
End-User AppsTime Shifted TV
sVODnVOD(i)VOD
System AppsVideo Control
BillingSubscriber Management
Connection/Control Connection/Control SystemSystem
Billing Management Billing Management SystemSystem
EncoderEncoder Asset Management Asset Management SystemSystem
VOD (Streaming) VOD (Streaming) ServersServers
VOD VOD ServersServers
PitcherPitcherCatcherCatcher
Asset Distribution Asset Distribution Interface (ADI)Interface (ADI)
Forms of VODForms of VOD•• Subscription VideoSubscription Video--onon--Demand Demand
(SVOD) (SVOD) •• Free VideoFree Video--OnOn--Demand (FVOD) Demand (FVOD) •• HDTVHDTV--onon--Demand (HDVOD) Demand (HDVOD) •• NetworkNetwork--based Personal Video based Personal Video
Recording (Recording (nPVRnPVR) ) •• Public, Educational & Governmental Public, Educational & Governmental
OnOn--Demand (PEGDemand (PEG--OD) OD) •• Distance Learning (Distance Learning (EduVODEduVOD) ) •• EducationEducation--onon--Demand Demand •• Advanced Advertising Advanced Advertising •• Interactive TV (Interactive TV (iTViTV) )
Arroyo Components
6© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
•• ““The network is the platformThe network is the platform””–– InternetInternet--proven approachproven approach
•• Distributed architectureDistributed architecture–– Hierarchical network storageHierarchical network storage
–– Streaming at the network edgeStreaming at the network edge
–– Multi level cacheMulti level cache
•• CCDS ElementsCCDS Elements–– VaultVault
++ Ingest & reliable storage of video (or Ingest & reliable storage of video (or other) assetsother) assets
–– StreamerStreamer
++ ““PersonalizedPersonalized”” video streamingvideo streaming
++ Pulls content from Vault on demand & Pulls content from Vault on demand & caches at network edgecaches at network edge
–– System Manager System Manager
++ Element Management SystemElement Management System
++ Single system manages all of CCDSSingle system manages all of CCDS
>95% cache hit rate!
< 300ms from ingest to
streaming!
CatcherCatcher
System System ManagerManager
StreamersStreamers
VaultsVaults
Set Top Box & EPG Set Top Box & EPG
Cisco Content Delivery System (CCDS)Cisco Content Delivery System (CCDS)Next Generation Application & Media Processing PlatformNext Generation Application & Media Processing Platform
7© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
CCDS ProductsCCDS Products
•• Content Delivery Engines (Content Delivery Engines (CDEsCDEs))–– Appliances for Vault and Streamer applicationsAppliances for Vault and Streamer applications
–– 4 types:4 types:
++ 4U SATA, 3U SCSI, 2U SATA, 1U System Manager 4U SATA, 3U SCSI, 2U SATA, 1U System Manager
–– Purchase includes base CDA licensePurchase includes base CDA license
•• Content Delivery Applications (Content Delivery Applications (CDAsCDAs))–– 1 software application per appliance1 software application per appliance
–– 4 types:4 types:
++ Vault, Streaming, SSV (mixture of vault & streaming), Vault, Streaming, SSV (mixture of vault & streaming), ““PlayPlay--OutOut”” application (e.g. application (e.g. for barker channel)for barker channel)
•• License UpgradesLicense Upgrades–– Additional S/D Stream LicensesAdditional S/D Stream Licenses
–– Stream resiliency optionStream resiliency option
–– Vault upgrade, additional hours S/DVault upgrade, additional hours S/D
–– PlayoutPlayout, NVOD, Barker application, NVOD, Barker application
8© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Content Delivery Engine SpecificationsContent Delivery Engine Specifications
•• 4U SATA Appliance4U SATA Appliance–– For Vault & SSVFor Vault & SSV
–– Up to 12 TB of content storageUp to 12 TB of content storage++ ~6000 hours MPEG2~6000 hours MPEG2
–– 16 GB DRAM16 GB DRAM
–– ~1 Gbps simultaneous ingest~1 Gbps simultaneous ingest++ ~200 channels MPEG2~200 channels MPEG2
–– 6 Gbps output6 Gbps output++ Rapid reRapid re--mirrorsmirrors
•• 3U SCSI Appliance3U SCSI Appliance–– For Streamer & For Streamer & PlayoutPlayout
–– 1212--24 Gbps output24 Gbps output++ Up to 6000 streams MPEG2Up to 6000 streams MPEG2
–– 1.7 TB of SCSI cache1.7 TB of SCSI cache
–– 16 GB DRAM16 GB DRAM
9© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Content Delivery Engine SpecificationsContent Delivery Engine Specifications
•• 2U SATA Appliance2U SATA Appliance–– For Vault & SSVFor Vault & SSV
–– Up to 6TB of content storageUp to 6TB of content storage++ ~6000 hours MPEG2~6000 hours MPEG2
–– ~1Gbps simultaneous ingest~1Gbps simultaneous ingest++ ~200 channels MPEG2~200 channels MPEG2
–– 6Gbps output6Gbps output++ Rapid reRapid re--mirrorsmirrors
•• 1U SCSI Appliance1U SCSI Appliance–– For Application System For Application System
ManagerManager
–– 4 GB RAM4 GB RAM
–– 4 x 73GB SCSI drives4 x 73GB SCSI drives
–– AC powerAC power
10© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Vault Content Delivery Application (CDA)Vault Content Delivery Application (CDA)
•• Content can be ingested via an Asset Distribution Interface (ADIContent can be ingested via an Asset Distribution Interface (ADI) that includes asset data or ) that includes asset data or via FTPvia FTP
•• Content ingestion is easy Content ingestion is easy –– each asset only needs to be ingested once and can be ingested each asset only needs to be ingested once and can be ingested at any location in the server groupat any location in the server group
•• Content (video assets) are reliably stored on at least two of thContent (video assets) are reliably stored on at least two of the vault serverse vault servers
•• Configured as an array of servers for reliability & scalabilityConfigured as an array of servers for reliability & scalability
•• Arrays can be coArrays can be co--located or geographically dispersedlocated or geographically dispersed
•• Content distribution processContent distribution process–– The first time a title is requested by a subscriber it is deliveThe first time a title is requested by a subscriber it is delivered from the Vault to the Stream Array red from the Vault to the Stream Array
serving that subscriberserving that subscriber
–– At the same time it is cached so that subsequent viewings by anyAt the same time it is cached so that subsequent viewings by any subscriber serviced by that array subscriber serviced by that array are satisfied locallyare satisfied locally
–– OnDemandOnDemand handles content as a series of short segments, so the only datahandles content as a series of short segments, so the only data moved around the moved around the network are the portions actually viewednetwork are the portions actually viewed
++ Unlike other VOD solutions which waste bandwidth by transmittingUnlike other VOD solutions which waste bandwidth by transmitting entire titles even if the entire titles even if the requesting subscriber ends up only watching part of it requesting subscriber ends up only watching part of it
–– There's no need to predict what titles subscribers will watch moThere's no need to predict what titles subscribers will watch more than others and preemptively push re than others and preemptively push them to the network edgethem to the network edge
•• Trick play modes are created upon ingest Trick play modes are created upon ingest –– this means trick play resource usage is the this means trick play resource usage is the same as normal usage i.e., thousands of users could all hit Fastsame as normal usage i.e., thousands of users could all hit Fast--Forward at the same timeForward at the same time
11© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Stream CDAStream CDA
•• Streamers respond to user requests for VOD streamsStreamers respond to user requests for VOD streams
•• Content is distributed and cached in 8 KB segmentsContent is distributed and cached in 8 KB segments–– Rather than download an entire movie when a user requests a titlRather than download an entire movie when a user requests a title, only the e, only the
segments that are needed are distributed and cachedsegments that are needed are distributed and cached
–– Streamers easily support personalized content e.g., inserting taStreamers easily support personalized content e.g., inserting targeted rgeted advertising, and playing that content out (not) under subscriberadvertising, and playing that content out (not) under subscriber controlcontrol
•• Streamers can be coStreamers can be co--located with Vault Servers or distributed to located with Vault Servers or distributed to remote locationsremote locations
•• Configured as an array of servers for reliability & scalabilityConfigured as an array of servers for reliability & scalability
•• Arrays can be coArrays can be co--located or geographically dispersedlocated or geographically dispersed
•• Load balancing is also automatic; content is replicated and streLoad balancing is also automatic; content is replicated and stream am assignments are determined based on the shared state of the arraassignments are determined based on the shared state of the arrayy
12© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Content Delivery Management SystemContent Delivery Management System
•• The Content Delivery Management The Content Delivery Management System (CDMS) has a GUI interface System (CDMS) has a GUI interface accessible via browseraccessible via browser
•• The CMDS network functions as a The CMDS network functions as a single virtual server that is single virtual server that is extremely easy to manageextremely easy to manage
•• As servers are added they selfAs servers are added they self--configure so that storage and configure so that storage and streaming capacity are streaming capacity are automatically load balanced automatically load balanced ensuring that network resources are ensuring that network resources are always available exactly where they always available exactly where they are neededare needed
•• When a disk is added to a server or When a disk is added to a server or a server is added to the network it a server is added to the network it contributes storage and/or contributes storage and/or streaming resources to the poolstreaming resources to the pool
13© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
•• CDMS is designed to be flexible:CDMS is designed to be flexible:–– It is simple enough to manage a It is simple enough to manage a
small deployment,small deployment,
–– while also being sophisticated while also being sophisticated enough to scale to manage a large enough to scale to manage a large complex service provider networkcomplex service provider network
•• CDMS uses a workflowCDMS uses a workflow--based based approach, automating and approach, automating and centralizing the major system centralizing the major system management functions:management functions:
–– ConfigurationConfiguration
–– MonitoringMonitoring
–– TroubleshootingTroubleshooting
–– ReportingReporting
–– MaintenanceMaintenance
Content Delivery Management SystemContent Delivery Management System
14© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Protocol Interfaces Protocol Interfaces –– TWC ExampleTWC Example
Asset Distribution Interface (ADI)Asset Distribution Interface (ADI)Asset Distribution Interface (ADI)ContentContentContent
FTPFTPFTPContentContentContent
VaultsVaultsVaults
StreamersStreamersStreamers
CCCPCCCPCCCP
Ingress formats:MPEG2
Ingress formats:Ingress formats:MPEG2MPEG2
BMSBMSBMSFile Service Interface
CORBAFile Service InterfaceFile Service Interface
CORBACORBA
LSCP (ISA)LSCP (ISA)LSCP (ISA)
MPEG-2 over IP over GigEMPEGMPEG--2 over IP over GigE2 over IP over GigE
MPEG-2 over IP over GigEAsynchronous Serial Interface (ASI)
MPEGMPEG--2 over IP over GigE2 over IP over GigEAsynchronous Serial Interface (ASI)Asynchronous Serial Interface (ASI)
CDMSCDMSCDMS
NMSNMSNMS
15© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
33rdrd Party VOD System InterfacesParty VOD System Interfaces
Partner Session Control RT Control
Openstream for SA and Mot environments
ISA CORBA LSCP
TWC ISA Environment, Mot and SA
ISA CORBA LSCP
CCOR nAble for Mot/SA ISA CORBA LSCP
NGOD ISA CORBA RTSP (Mot), LSCP (SA)
CV NPVR SSP 2.3, ISA CORBA LSCP
Myrio TotalManage RTSP RTSP
Shaw NPVR RTSP LSCP
Partner Control Transport
ISA (Openstream) CORBA FTP
nABLE XML FTP
Condo nPVR XML MPEG SPTS
NGOD NGOD A3 (XML) FTP
Myrio VOD XML FTP
Myrio nPVR XML MPEG SPTS
Verimatrix (IPTV CA/DRM) SOAP AnyIn/SambaFS
Manual ingest AIM Tape/DVD/CD
Streaming
Asset Ingest
16© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
CCDS Network Load LevelingCCDS Network Load Leveling
•• Services are distributed and loadServices are distributed and load--leveled leveled across the arrayacross the array
–– Multiple servers function as one logical Multiple servers function as one logical arrayarray
–– Services are distributed across the networkServices are distributed across the network
–– Applications can be added without Applications can be added without disruptiondisruption
–– Expand without disruption Expand without disruption –– servers once servers once configured, will broadcast their capabilities configured, will broadcast their capabilities and join the arrayand join the array
•• All functions are loadAll functions are load--leveledleveled–– IngestIngest
–– StorageStorage
–– StreamingStreaming
17© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
NonNon--disruptive, Costdisruptive, Cost--effective Scalabilityeffective Scalability
•• Adapt to your needsAdapt to your needs–– Start centralized & evolveStart centralized & evolve
–– Add adjacent markets by simply Add adjacent markets by simply adding a streameradding a streamer
–– Content from a single ingest point is Content from a single ingest point is available throughout the arrayavailable throughout the array
•• System & Bandwidth ScalingSystem & Bandwidth Scaling–– Systems optimized for unmatched Systems optimized for unmatched
performanceperformance
–– Load is distributed throughout an Load is distributed throughout an arrayarray
–– Extensible platform software Extensible platform software architecturearchitecture
•• Distributed streamingDistributed streaming–– Save $25Save $25--200/stream on aggregation 200/stream on aggregation
network bandwidth costsnetwork bandwidth costs
–– Distribute rack space useDistribute rack space use
18© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Content Distribution AlgorithmsContent Distribution Algorithms
•• Minimize total storage cost Minimize total storage cost –– DRAM, SCSI, SATADRAM, SCSI, SATA
•• Minimize Minimize OpExOpEx –– content management, streamer disk content management, streamer disk cachecache
•• Optimize Network Utilization Optimize Network Utilization –– offer more contentoffer more content
VaultStreamer
100%1-5%
19© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
CCDS AvailabilityCCDS Availability
•• There is a There is a statefulstateful switchover in the event one of the switchover in the event one of the systems in the array goes out of service which meanssystems in the array goes out of service which means
–– Software upgrades can be performed without disruptionSoftware upgrades can be performed without disruption
–– Trickledown Trickledown –– servers can be gracefully shutdown for servers can be gracefully shutdown for upgrade by having the system stop sending new streams to upgrade by having the system stop sending new streams to that serverthat server
–– ““Stream steeringStream steering”” allows you to move the streams allows you to move the streams manually for a faster (yet still graceful) shutdown of a manually for a faster (yet still graceful) shutdown of a serverserver
•• Content is never lost Content is never lost –– there are duplicate copies in the there are duplicate copies in the array and when a server, disk, etc. is OOS the content it array and when a server, disk, etc. is OOS the content it hosted is replicated elsewhere in the array hosted is replicated elsewhere in the array
•• The level of resiliency for content and services is The level of resiliency for content and services is operator configurable i.e., operator configurable i.e.,
–– You can configure how many (backup) copies of an You can configure how many (backup) copies of an individual piece of content are stored in the arrayindividual piece of content are stored in the array
–– The number of stream and/or vault servers can be The number of stream and/or vault servers can be increased as desired for M:N redundancyincreased as desired for M:N redundancy
•• If a server loses capacity e.g., loses a network interface, If a server loses capacity e.g., loses a network interface, it dynamically informs all other servers in the array to it dynamically informs all other servers in the array to take over the streams it was serving off that interfacetake over the streams it was serving off that interface
20© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Switchover Process for an Active Stream Switchover Process for an Active Stream Following a Streamer SwitchoverFollowing a Streamer Switchover
Streamer.4Setup.back
Streamer.3
Streamer.2Control.back
Streamer.1Control.priSetup.pri
192.168.1.110.1.1.1
10.1.1.11
192.168.1.210.1.1.12
10.1.1.22
192.168.1.310.1.1.23
10.1.1.33
192.168.1.410.1.1.34
10.1.1.45
STB.1GQAM.1 HFC
IP Core
Virtual Control IP10.1.1.101
Virtual Control IP10.1.1.102
Virtual Setup IP10.1.1.201
LSCP
eth1eth2
eth13
eth1eth2
eth13
eth1eth2
eth13
eth1eth2
eth13
Stream state information
21© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Switchover Process for an Active Stream Switchover Process for an Active Stream Following a Streamer SwitchoverFollowing a Streamer Switchover
Streamer.4Setup.back
Streamer.3
Streamer.2Control.back
Streamer.1Control.priSetup.pri
192.168.1.110.1.1.1
10.1.1.11
192.168.1.210.1.1.12
10.1.1.22
192.168.1.310.1.1.23
10.1.1.33
192.168.1.410.1.1.34
10.1.1.45
STB.1GQAM.1 HFC
IP Core
Virtual Control IP10.1.1.101
Virtual Control IP10.1.1.102
Virtual Setup IP10.1.1.201
Content
LSCP
Stream state information
eth1eth2
eth13
eth1eth2
eth13
eth1eth2
eth13
eth1eth2
eth13
22© 2006 Cisco Systems, Inc. All rights reserved.JKB Cisco Confidential
Q & A