unified communication solution planning and designing...

Post on 25-Apr-2018

236 Views

Category:

Documents

3 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Planning and Designing a Virtual Unified Communication Solution

BRKUCC-2225

Laurent Pham

Technical Marketing Engineer

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Cisco Collaboration Design

Traditional Deployments New Deployments

MCS End-of-Sale Cisco Collaboration Release 10 virtual only

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Laurent PhamTechnical Marketing Engineer

AGENDA

❑ Overview

❑ Platform Options

❑ How to Design

❑ Other Design Considerations

❑ How to Deploy

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Server Virtualization

Traditional Architecture Virtual Architecture

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

With MCS servers

Moving towards Virtualization

Virtualization

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Virtualization Overview and Definitions

Definition Support

Guest Virtual Machine Cisco Collaboration application release 8.0(2)+ in general

Hypervisor Software allowing to run VMs on a host

VMware vSphere ESXi only. Release 4.0, 4.1, 5.0, 5.1, or 5.5

Host Physical Server Cisco UCS or other VMware compatible servers

Guest - Cisco Collaboration application VM

Hypervisor - VMware vSphere ESXi

Host - Physical server

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

OVA – Open Virtualization Archive

Definition Support

OVA(Open Virtualization Archive)

File containing VM configuration

(e.g. virtual hardware)

OVAs must be used when installing a VM.Ensure proper VM configuration and

application partition alignment

OVA

Partition Alignment

BlockBlockChunkStorage

VMFSApplication Block

BlockBlock Block

Chunk

BlockBlockChunkStorage

VMFSApplication Block

BlockBlock Block

Chunk

OVA

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

“DocWiki”: Main Reference for UC Virtualization

• Covers all aspects of Cisco Collaboration Virtualization (Collaboration applications, VMware and platform support for UC virtualization)

• Frequent changes with new updates – check back often

Guide for

UC Virtualization

http://www.cisco.com/go/uc-virtualized

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

✓ Overview

✓ Hardware Options

✓ How to Design

✓ Other Design Considerations

✓ How to Deploy

AGENDA

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Hardware Options

Tested Reference Configuration (TRC) Specs-Based

Any vendor

Business Edition 6000/7000 “UC on UCS” “UC on UCS” “UC on 3rd party servers”

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

UCS 5108 Chassis

UCS 6200Fabric Interconnect

SAN

10GbECatalyst

Nexus

MDS

FC

FCoE

1GbE

Cisco UCS Architecture Overview with TRCs

Fiber Channel Storage Array

UCS B-series TRCs(B200, B230, B440)

Business Edition 6000/7000UCS C-series TRCs(C220, C240, C260)

UCS 2200Fabric Extender

LAN

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

TRC Servers

#Users

# A

pps

*

VM VM VM VM VM

VM VM VM VM VM

VM VM VM VM

<1K users(1.2-2.5K devices)

1K-5K users(<15K devices)

>5K users(>15K devices)

BE 6000 MD Server Small TRC, 8c

BE 6000 HD Server Small Plus TRC,16c Medium TRC*, 12c

Medium TRC*, 8c

Large TRCs*, 16c

Extra-Large TRCs*, 20c

2X-Large TRC*, 40c

VM VM VM VM

VM VM VM VM VM

VM VM VM VM VM

VM VM VM

VM VM VM

VM VM VM

VM VM VM

VM VM VM

VM VM VM

*VM counts are averages/examples only

and vary by design.

Full PerformanceRestricted Performance

Legend8c: 8 cores

BE6000

BE7000

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Component Modifications Allowed?Server Model/Generation ✖

CPUModel ✔ Within the same familyQuantity and # cores ✖Speed ✔ Yes, if higher

Physical Memory ✔ Yes, if higher

DAS StorageQuantity, RAID, technology ✖Disk speed and size ✔ Yes, if higher

AdaptersC-series (NIC Type, vendor, technology) ✖C-series (NIC card quantity) ✔ Yes, if higherB-series (Mezzanine card) ✔

TRC – Allowed DeviationsTRC – Allowed deviations

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

BusinessEdition 6000 UC on UCS

Less

Less More

“Tell me what to do…” “I know what I’m doing…”

More

UC on UCS 3rd-Party

TAC Noteshttp://www.cisco.com/en/US/customer/products/ps6884/products_tech_note09186a0080bf23f5.shtml

Specs-Based – Flexibility

Any Server

BusinessEdition 7000

“Choices”Existing Investment Leverage

“Assurance”“Simplicity”

Tested Reference Configuration (TRC) Specs-Based

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Limited Cisco UCS servers

Any server

UCS C: Limited DAS optionsUCS B: FC SAN only Flexible DAS & SAN

UCS C: Limited OptionsUCS B: Flexible Adapters Flexible adapters

Limited CPUs More CPUs options

Xeon 5600 or 7500 - 2.53+ GHzE5-2400/2600/4600 v1/v2 - 2.0+ GHz (Restricted Performance) E5-2600/4600 v1/v2 - 2.5+ GHzE7-2800/4800/8800 - 2.0+ GHz (Restricted Performance)E7-2800/4800/8800 - 2.4+ GHz

Any Storage compatible with Server and VMwareE.g. Flexible DAS config, FC, FCoE, iSCSI, NFS NAS

vCenter required (for historical logs and statistics)

Any adapters compatible with server and VMware

ANY Server (VMware compatible)

Optional Required

Specs-Based - Requirements

TRC Specs-Based

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

✓ Overview

✓ Hardware Options

✓ How To Design

✓ Other Design Considerations

✓ How To Deploy

AGENDA

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

How to Design - Overview

Application Design

Overall Application DesignApplication Sizing

VM Placement

1

2 New with Virtualization

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Application Design

Resources- Solution Reference Network Design (SRND): www.cisco.com/go/ucsrnd- Cisco Preferred Architecture: http://www.cisco.com/go/cvd/collaboration- Cisco Validated Design CVD: http://www.cisco.com/go/cvd/collaboration- Docwiki: http://www.cisco.com/go/uc-virtualized- Cisco Collaboration Sizing Tool: http://www.cisco.com/go/cvd/collaboration

Same as with MCS

Almost same as with

MCS

1 Application Design• Overall Application Design

- Architecture and Deployment Models- High Availability Design

• Application Sizing- VM Configuration Selection- Determine Number of VMs Required

Simplified design

with BE6000

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

How to Select a VM Configuration

Application VM Config vCPU Restricted UC Performance CPU:BE6000, Small(+)

TRC

Full UC Performance CPU:

BE7000, Medium TRC or larger

Unified CM 10.0

10,000 4 ✗ ✔

7,500 2 ✗ ✔

2,500 1 ✗ ✔

1,000 2 ✔ ✔

IM & Presence

10.0

15,000 4 ✗ ✔

5,000 2 ✗ ✔

2,000 1 ✗ ✔

1,000 full UC

1 ✔ ✔

Unity Connection

20,000 7 ✗ ✔

10,000 4 ✗ ✔

5,000 2 ✗ ✔

1,000 1 ✔ ✔

Select Appropriate VM ConfigConsider:

# users and # vCPU

VM Config compatible with

Hardware?

Yes

No Change VM Config or

Platform

Docwiki: www.cisco.com/go/uc-virtualized

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

How to Determine the Number of VMs Required

Cisco Collaboration Sizing Tool (CST) available to Partners, Cisco Account Teams, and Cisco Advanced Services

http://tools.cisco.com/cucst

Estimate SizingDesign Guides - SRND

Validate Sizing for complex deploymentCollaboration Sizing Tool (CST)

No CST for BE6000

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VM Placement

Resources- Docwiki: http://www.cisco.com/go/uc-virtualized- VM Placement Tool (VMPT): http://www.cisco.com/go/vmpt

New with Virtualization

VM Placement• Goal: Determine the number of physical servers required

• How to do VM Placement?- Manual placement using the rules in the docwiki- Use VM Placement Tool (VMPT)

2

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Logical Processors

CPU Resources – Physical Core

Consider the number of PHYSICAL cores on the server

Core 1 Core 2

Core 3 Core 4

Core 5 Core 6

Do not consider the number of LOGICAL cores obtained through Hyper-threading

CPU Cores

Core 1 Core 2

Core 3 Core 4

Core 5 Core 6

Dual sockets, 6 cores per socket

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

CPU Resources - Mapping

No oversubscription: The number of vCPUs can’t exceed the number of physical cores

Mapping: One vCPU = One physical core

Cores

vCPUUCM-PUB UCM-SUB1 IM&P-1 CER-1 CCX-1

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

CPU Resources – Unity Connection

With Unity Connection only:Reserve a spare core for the ESXi scheduler

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Other Hardware Resources

◆ Memory▪ No Oversubscription▪ Reserve RAM for ESXi scheduler

• ESXi 5.1 or earlier: 2 GB• ESXi 5.5: 4 GB

◆ Storage▪ Ensure enough storage space is available▪ Thick vs. Thin provisioning

• TRC with DAS: Thick provisioning required• Specs-Based or SAN: Thick provisioning recommended, Thin provisioning allowed

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Co-Residency: Mixing Applications

Limited(includes no co-residency) UC with UC Only Full

Cisco UC+ Non-UC/3rd party

3rd Party/Non-UC(e.g. Nexus 1000v, vCenter)

Specific Cisco UC

Examples:CUCM 8.6(2)+IM&P 8.6(1)+CUC 8.6(2)+CCX 8.5+CCE 10+

Examples:CWMSCCE Logger 8.x

Examples:CUCM 8.6(1)-IM&P 8.5(x)-CUC 8.5(1)-CCX 8.0CCE Logger 9.x

Specific Cisco UC

Cisco UC Cisco UC Cisco UC

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Co-residency with 3rd party applications

More info in the docwiki:http://docwiki.cisco.com/wiki/Unified_Communications_Virtualization_Sizing_Guidelines

• The co-residency rules and categories apply to TRC and Specs-Based• Number and Type of 3rd party co-resident applications limited with Cisco

Collaboration virtualization SW OEMs (Cisco UC Virt. Hypervisor/Foundation, default ship with BE6000/BE7000)

• TAC TechNote: http://www.cisco.com/en/US/products/ps6884/products_tech_note09186a0080bbd913.shtml

• UC on UCS rules also imposed on 3rd party VMs (e.g. no Oversubscription allowed for 3rd party apps)

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VM Placement Tool

• Visual VM placement tool

• Greatly simplifies VM Placement

• Most co-residency rules are implemented

Virtual Machine Placement Tool (VMPT): http://www.cisco.com/go/vmpt

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VM Placement Tool

2

3

4

15

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VM Placement – Example with 5000 users

Best Practices• Spread VMs across different

nodes to minimize failure impact.

• Provide spare capacity for future growth, server maintenance, or Collaboration application upgrades possibly requiring more resources.

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

✓ Overview

✓ Platforms

✓ How To Design

✓ Other Design Considerations:➢ Storage and Network Considerations➢ VMware features support

✓ How To Deploy

AGENDA

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Storage Array Requirements

HypervisorKernel Command Latency

< 4ms

Physical Device Command Latency< 20ms

SAN NAS

Total Guest Latency< 24ms

Reference: http://docwiki.cisco.com/wiki/UC_Virtualization_Supported_Hardware

Performance Requirements

UCS B-series TRC Specs-BasedStorage Vendor Any Vendor compatible with Server and VMware

Storage Technology FC only Flexible (FCoE, iSCSI, NFS…)

Other RequirementsMeet Performance Requirements

Thick Provisioning Recommended (not required) Flexible RAID Configuration

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Storage Array Performance Design

BHCA Average IOPS10K ~3525K ~5050K ~100CUCM upgrades generate 800 to 1200 IOPS in addition to steady state IOPS

Unity Connection VM size Average IOPS Peak IOPS2 vCPU (5,000 users) ~130 ~7154 vCPU (10,000 users) ~220 ~870

Unified CM

Unified CCX VM Size Average IOPS Peak IOPS2 vCPU (300 agents) ~150 ~1500

Presence VM Size Average IOPS1000 users ~60

Traffic Type: In general, I/Os are mostly sequential writes

Reference: www.cisco.com/go/uc-virtualized > Collaboration Application

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

DAS Storage Requirements

TRC and BE6000 / BE7000 Specs-Based

BOM (Disks/RAID controllers)

Fixed. Exceptions: Faster/Larger

disks okFlexible

RAID configuration Fixed Flexible

Thick/Thin Provisioning Thick only Thick recommended

Storage Performance Design

No IOPS calculation needed

• Use TRC as reference• Or calculate IOPS

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Networking Considerations with UCS C-series• In general, use all ports available… Or

Calculate Bandwidth requirements for each VM– Bandwidth Formulas available in the Design Guides and SRND.– Only account for traffic in/out of the host (not within host)– Consider traffic streams that carry media, especially Video

• Plan for upstream switch redundancy.With redundancy, need 2x number of ports.

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VMware vSphere Release Compatibility

• ESXi release support varies with UC application (many apps do not support ESXi 5.5)

• ESXi Updates (e.g. U1, U2, etc…) implicitly supported unless specified otherwise

• For the exact release of Cisco Collaboration application or ESXi, refer to the docwiki

For details and latest support: http://www.cisco.com/go/uc-virtualized > Application

Application ESXi 4.0 ESXi 4.1 ESXi 5.0 ESXi 5.1 ESXi 5.5CUCM 8.0(2) and later 8.0(2) and later 8.0(2) and later 8.0(2) and later 9.X or later

CUP/Unified IM&P

8.0(2) or later 8.0(2) or later 8.6(1) or later 8.6(4) or later 9.1(1) or later

CUC 8.0(2) or later 8.0(2) or later 8.0(2) or later 8.0(2) or later 9.X or laterCCX 8.0(2) to 9.x 8.0(2) or later 8.0(2) or later 8.5(1) or later 10.0(1) or later

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VMware vSphere compatibility with ApplicationDocwiki reference example

For YourReference

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

VMware Feature Support

VMware Features vMotion Storage vMotion

CopyClone

HA VMware DRS

Fault Tolerance

CUCM Y (C) Y (C) Y (C) Y (C)

N N

CUP / IM & Presence

Y (P) N Y (C) Y (C)

N N

CUC Y (P) N Y (C) Y (C)

N N

CCX Y (C) Y (C) Y (C) N N N

LEGEND:Y(C) – Supported with CaveatsY(P) – Partial or LimitedN – Not Supported

• vMotion– Y(C): supported with Caveat: Can be done with live traffic, but slight risks to impact calls.– Y(P): Partial: During maintenance window only.

• Copy / Clone– Y(C): supported with Caveat: Shutdown VM first

• VMware Distributed Resource Scheduler (DRS)– Not supported at this time. No real benefits since Oversubscription is not supported

VMware vSphere Requirementshttp://docwiki.cisco.com/wiki/Unified_Communications_VMWare_Requirements

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

High Availability (HA) DesignApplication HA vs. VMware HA

Best Practice:VMware HA is allowed but…Use Cisco Collaboration application built-in redundancy first

Collaboration application HA

VMware HA

DAS Storage Support Yes No (requires shared

storage)VM file system corruption Protection Yes NoFailover Time Faster LongerAdditional mechanisms required to ensure failover does not result in an unsupported configuration

No Yes

Fully Supported Yes No

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Backup StrategyApplication vs. VMware Backup

Cisco Disaster Recovery System

(DRS)

VMware Copy / Clone / vDP

Backup can be taken when VM is running Yes No(Power Off VM)

Restore time Longer Short

Best Practice:Can use VMware Copy for fast restore but…Always perform a DRS Back Up

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

✓ Overview

✓ Platforms

✓ How To Design

✓ Other Design Considerations

✓ How To Deploy➢ Installation➢ Migration to virtualization

AGENDA

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Installation1. Configure platform (e.g. RAID)

2. Install VMware ESXi

3. Deploy OVA template• Use the OVA available on cisco.com for virtual HW settings and for Disk Alignment

cucm_10.0_vmv8_v1.7.ova

UC App UC App release VM Hardware VersionESXi4:vmv7, ESXi5:vmv8

OVA Version

• When deploying the VM template, select VM configuration

5. Install Cisco Collaboration applicationCisco Collaboration on Virtual Servers:http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/virtual/CUCM_BK_CF3D71B4_00_cucm_virtual_servers.pdf

Not needed with

BE6000/BE7000Block

BlockChunkStorage

VMFSApplication Block

BlockBlock Block

Chunk

BlockBlockChunkStorage

VMFSApplication Block

BlockBlock Block

Chunk

Not needed with

BE6000/BE7000

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Migration to Virtualization

CUCM on MCSUpgrade… DRS

• Follow the normal Server Replacement procedure: DRS backup, Install using the same UC release, DRS restore.

• Upgrade… if current CUCM release doesn’t support virtualization.In general, virtualization requires 8.0(2)+.

CUCM release supporting virtualization

CUCM – Virtual

Migration

if current CUCM release doesn’t support virtualization

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Migration to VirtualizationIf done manually, could be long and laborious…

CUCM on MCS

Upgrade DRS Migrate

CUCM release supporting virtualization

CUCM – Virtual

CUCM on MCS Upgrade

or Bridge Upgrade

CUCM – VirtualUpgrade

CUCM 6.1.4, 6.1.5, 7.1.3 or 7.1.5 on MCS

DRS backup

install 6.1.4, 6.1.5, 7.1.3 or 7.1.5 virtual

“Interim” CUCM 9.1.2virtual

Upgrade to 9.1.2

Apply RU Cop file DRS Restore

“Jump” to VM

DRS backup

Final CUCM 9.1.2 virtual

DRS Restore migrate licenses to ELM

Isolated Lab Environment

Reinstall VM

Jump Upgrade to 9.1(2)

(Partition alignment)

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Migration to Virtualization… Or it could be faster and simpler with Prime Collaboration Deployment (PCD)!

Migration with PCD• For Migration to CUCM / IM & Presence 10.0+• Direct upgrade to 10.0+ and Automated Migration Process• Can change IP address / Hostname during migration• Not based on Disaster Recovery System (DRS)

CUCM 6.1.5, 7.1.3 , 7.1.5, 8.x, 9.x on MCS

CUCM 10.0+ virtualPCD Migration

Migration path to UCM 10.0+

Also:• Free of charge• Can perform tasks (change IP/networking, upgrade, switch versions)• Minimum virtualization SW license requirements:

Cisco UC Virt. Foundation or vSphere Standard Edition

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Summary

Application Design

VM Placement

▪ Perform the Application Design as usual – Deployment Model, High Availability, VM Config, Number of VMs…

▪ VM Placement– Select type of platforms (TRC vs. Specs-based, B vs. C,…)– VM placement: Sizing and Co-residency– Storage, Networking, VMware considerations

▪ Plan how to install/migrate

SRND: www.cisco.com/go/ucsrnd Cisco Collaboration Sizing Tool: http://tools.cisco.com/cucstDocwiki: www.cisco.com/go/uc-virtualized

Docwiki: www.cisco.com/go/uc-virtualizedVM Placement Tool: www.cisco.com/go/vmptCisco Collaboration on Virtual Servers

http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/virtual/CUCM_BK_CF3D71B4_00_cucm_virtual_servers.pdf

Questions ?

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Need more?

• Want more details?– BRKUCC-1903 - Migration and Co-Existence Strategy for Collaboration

Applications in a Virtualized Environment (tomorrow, 8:00am)– BRKUCC-2346 - UC on UCS Overview

(recording available on Cisco Live 365)– Upgrade Resource Central https://communities.cisco.

com/community/partner/collaboration/migration

• Questions after you go home? Ask the BU at Collaboration User Group– http://communities.cisco.

com/community/technology/collaboration/usergroups/collaboration – Technical design information at www.cisco.com/go/uc-virtualized

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Complete Your Online Session Evaluation• Give us your feedback and you

could win fabulous prizes. Winners announced daily.

• Complete your session evaluation through the Cisco Live mobile appor visit one of the interactive kiosks located throughout the convention center.

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online

© 2014 Cisco and/or its affiliates. All rights reserved.BRKUCC-2225 Cisco Public

Continue Your Education• Demos in the Cisco Campus

• Walk-in Self-Paced Labs

• Table Topics

• Meet the Engineer 1:1 meetings

top related