Building a Video Optimized Private Cloud Platform on Cisco

InfrastructureRohit Agarwalla, Technical Leader

DEVNET-1106

roagarwa@cisco.com, @rohitagarwalla

• Cisco Media Blueprint

• Media Workflows

• Cisco Media Data Center

• Cisco OpenStack Platform

• End-to-End Workflow and Demo

Agenda

Cisco Media Blueprint

Media Industry Transitions

Transition to IP from SDI

10110101 1001010110

101010101010

• Ready for tomorrows new formats and data rates

• Increased throughput with Ethernet

x86 Workloads

• Move away from specialized, dedicated, expensive HW/appliances

• Single, unified, general purpose, low cost compute and storage

Cloud

Architectures

• Automated provisioning and elastic resource pools

• Treat the platform as reusable pools of resources

Open standards approach, directly supported by the

industry’s key software providers

Flexible solutions for changing market

demands, in accord with current and future

industry standards

Cisco Media Blueprint – What ?

Eco-System Industry

Applications and infrastructure for moving, storing, distributing and

securing broadcast media content

Solutions

Automatically and dynamically adjust to

changing market demands for content

Scale globally and securely with proven Cisco performance

Cisco Media Blueprint – Why ?

Generate Revenue Sooner

Prepare for Change

Quickly and economically deploy flexible production,

storage, and distribution capabilities

Move Faster

Cisco Video Applications: vDCM, Infinite Video/Home, cDVR,

3rd Party ISV ApplicationsApplications

Nexus, Unified Computing System, Cisco Scale Out Storage

3rd Party Software Defined Storage

Physical

Infrastructure

Cisco Virtual Video Processing Controller (V2P-C)

3rd Party ISV Orchestration Software

E2E Workflow

Orchestration

Media Data Center: Media-optimized Cloud PlatformCloud

Platform

Full Stack Media Solution

Media Workflows

SP Linear Channel – Logical

TranscodeMulticast

Distribution

10 Mbps multicast MPEG2-TS

Typically hundreds of these channels per service provider, in a handful of regions

Subs

Packager Origin CDN Subs30 M

bps H

TT

P P

UT

Cloud DVR Workflow – Logical

TranscodeMulticast

Distribution

Hundreds of thousands of simultaneous recordings per region, less playout

Subs

Packager Origin CDN Subs

Same as SP Linear

Shared

StorageRecorder Playout

10 Mbps HTTP GET

10 M

bps H

TT

P P

UT

10 M

bps H

TT

P G

ET

Broadcast Channel Playout – Logical

Content

IngestTranscode

Quality

Control

Shared

StoragePlayout

Remote

Storage

Distribution

Live

Feed

220 Mbps multicast flows – mezzanine compressed live feeds

Up to 220 Mbps CIFS read

Typically dozens of these channels per broadcaster, in a handful of locations

VoD Library Transcode – Logical

Shared

StorageExport Distribution

Best effort CIFS read

Millions of assets per library, only a subset transcoded at a time, into 100s of formats

TranscodeTranscode TranscodePackage EncryptEncrypt

Cisco Media Data Center

What Is Media Data Center ?

Optimized cloud platform for running video and media workloads

On-premises private cloud based on OpenStack

Simplified API driven management

Turnkey solution and future proof next-gen media architecture

High performance, efficient resource utilization

Media Data Center : Not Just OpenStackBare Metal and Containers

VM-FEX

Multicast

QoS

IPVS Support

MediaOptimized

SPVSS

Workflows

Video WorkFlows

ISV Certification

Service Provider Workflows

SP Linear Channel

Cloud DVR Workflow

Content Provider Workflows

Broadcast Channel Playout

VoD Library Transcode

Cis

co

Op

en

Sta

ck

Pla

tfo

rm

Media Data Center Architecture

Installation

and

Upgradability

Bare-Metal Containers VM-FEX

Multicast QoS IPVS

Highly

Available and

Scalable

CI /

CD

MediaDataCenter

Physical

Infrastructure

Network

Nexus 9000

Compute

UCS-C

UCS-B

FI

Storage

COS

C3160 (Swift)

C240 (Ceph)

Red Hat Enterprise Linux*

Red Hat OpenStack Platform*, Cisco Plugins/Drivers

Monitoring

and Logging

Media

Enhancements

Cloud99

VMTP

* First version on Cisco hardware and RHEL

Neutron UCS ML2 Mechanism Driver

Ironic UCSM Bare-Metal Driver

Cisco OpenStack Platform

User input and configuration validationBase host (bare-metal) installOpenStack install

Cisco OpenStack Platform – Modularized

Deployment Capabilities

Control PlaneCapabilities

Data Plane

Capabilities

High availability

Upgrade/Update

Enhanced logging and health monitoring

Integrated test and verification tools

Highly available and high throughput network data

plane

Distributed and highly available storage

Automated performance and scale tests

OpenStack Deployment Topology – UCS C series

• Dedicated Build Node

• 3 x Controller nodes

• 2 x (or more) Compute nodes

• 3 x (or more) Block Storage nodes (Ceph)

• 2 x ToR

OpenStack Deployment Topology – UCS B series

• Dedicated Build Node

• 3 x Controller nodes

• 2 x (or more) Compute nodes

• 3 x (or more) Block Storage nodes (Ceph)

• 2 X Fabric Interconnect

• 2 x ToR

OpenStack Node/Service Layout

Installer

Cobbler

MariaDB/Galera

RabbitMQ

HAProxy/VRRP

Keystone

Glance

Nova

Neutron

Cinder

Horizon

Heat

Logstash

Forwarder

Nova Compute

Neutron Agent

Logstash

Forwarder

Ceph

ELK Stack

VMTP

CloudPulse

• Containerized OpenStack Services

• Monitoring on Build node

• External and Internal VIP addresses

• 3-way active for stateful services

OpenStack Networks

Networks/Bonds Functions

Management/Provision • OpenStack control plane traffic

• Server Management: build node will connect to servers on this

network

• PXE booting servers during baremetal install

API • Clients connect to API network

• Dashboard

Tenant • VM to VM traffic

Storage • Communication to CEPH backend

Provider • For external/Provider network

External • For connecting tenant VMs to external networks

OpenStack Deployment Networking

External

API

Tenant (LB VXLAN or OVS VLAN)

Storage

Management/Provisioning

Provider (VLAN)

System Monitoring

Monitoring

System

OpenStack Services

UCS Hardware

Operating System

(Linux Health)

Logging

Monitoring

Alarms

Monitoring, Logging and VisualizationU

ser In

terfa

ce

ELK Stack – Log Management Platform

Data Collection and

Transformation Agent

An Analytics Engine and

DataStoreData Exploration Interface

Logstash Forwarder on

all nodes

OpenStack Service logs

VMTP – Tenant data path performance measurement tool

• VM to VM same network (private

fixed IP, flow #1)

• VM to VM different network

using fixed IP (same as intra-

tenant L3 fixed IP, flow #2)

• VM to VM different network

using floating IP and NAT (same

as floating IP inter-tenant L3,

flow #3)

• External host/VM download and

upload throughput/latency

(L3/floating IP, flow #4 and #5)

CloudPulse – OpenStack Health Service Check Tool

Lig

ht

endpoin

t check Nova list

Cinder list

Glance image-list

Neutron net-list

Keystone tenant-list

Functional check Boot VM

Create volume

Attach volume

Detach volume

Delete volume

Delete VM

Create image

Delete image

Infr

a t

ests Database cluster

status

Rabbit cluster status

HAProxy tests

End-to-End Workflow

Rack and Stack( Days )

Media Data CenterInstaller

( 2 Hours )

Workflow Template( 30 Minutes )

From Bare Metal to Video Workflows

Media Data Center and vDCMDemo Topology

Source (VM2)

vDCM

(VM1)

Output (VM3)

Sending multicast IP stream

•172.31.228.13

•10.0.13.10

•172.31.228.15

•10.0.13.12

•172.31.228.5

•10.0.13.4Sends IGMP join requests

• Spin up new revenue opportunities in minutes, not days

• Transform to a software driven, converged, reusable, infrastructure

• Provides a Cloud Platform with optimizations for media workloads

Summary - Media Data Center

Call to Action

• Visit the World of Solutions for

• Cisco Campus

• Walk in Labs

• Technical Solution Clinics

• Meet the Engineer

• Lunch and Learn Topics

• DevNet zone related sessions

Complete Your Online Session Evaluation

• Please complete your online sessionevaluations after each session.Complete 4 session evaluations& the Overall Conference Evaluation(available from Thursday)to receive your Cisco Live T-shirt.

• All surveys can be completed viathe Cisco Live Mobile App or theCommunication Stations

Thank you