unified compute system (ucs) architectural overview · single point of management for ucs system of...

54
Session ID 20PT Unified Compute System (UCS) Architectural Overview Steve McQuerry. CCIE #6108

Upload: others

Post on 15-Mar-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

Session ID 20PT

Unified Compute System (UCS) Architectural Overview

Steve McQuerry. CCIE #6108

Page 2: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 2

Single Management Interface for up to 160 blade servers

Role Based Access for LAN, SAN, and Server Administrators

Clustered for fault tolerance and no single point of failure for any chassis

Open APIs for third party integration

UCS System and Connectivity View

SAN B

SAN A LAN

Server

SAN

Network

Mgmt

Page 3: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 3

Unified Computing System (UCS)

Single Point of Management

Unified Fabric

Stateless Servers

with

Virtualized Adapters

Single Point of Management

Reduced # of management points

Reduced firmware management

Reduced time to resolve issues

Reduced complexity

Page 4: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 4

Unified Computing System (UCS)

Single Point of Management

Unified Fabric

Stateless Servers

with

Virtualized Adapters

Unified Fabric

Reduced # of adapters

Reduced # of switches

Reduced LAN and SAN edge ports

Reduced cabling costs

Reduced power due to less H/W

Page 5: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 5

Unified Computing System (UCS)

Single Point of Management

Unified Fabric

Stateless Servers

with

Virtualized Adapters

Large Memory

Reduced server costs

Reduced power and cooling costs

Reduced software costs

Page 6: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 6

Unified Computing System (UCS)

Single Point of Management

Unified Fabric

Stateless Servers

with

Virtualized Adapters

Virtualization & Stateless Servers

Reduced type of servers via H/W virtualization

Reduced # of standby servers for HA

Reduced downtime due to service profiles

Reduced time to resolve issues with VM’s

Page 7: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 7

Cisco Unified Computing System

Page 8: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 8

System Components

Fabric Interconnect

(40 or 20 10GE ports) + (2 or 1 GEM slots)

Chassis

Upto 8 half width blades or 4 full width blades

Fabric Extender

Host to uplink traffic engineering

Up to 80Gb Flexible bandwidth allocation

Adapter

Virtualized adapter for single OS and hypervisor systems

Compute Blade

Compute Chassis

x86 Computer x86 Computer

X

I I

x8 x8 x8 x8

B

MGMT

S S

B

X X X X X

C C

A

G G

G G

SAN

G

R

A

G

G G

G

R

G

P M P

SAN LAN

Fabric

Interconnect

Fabric

Interconnect

Fabric

Extender

Fabric

Extender

Compute Blade

(Half slot)

Adapter

Compute Blade

(Full slot)

Adapter Adapter

Page 9: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 9

System Components – Details

Compute Chassis

x86 Computer x86 Computer

X

I I

x8 x8 x8 x8

B

MGMT

S S

B

X X X X X

C C

A

G G

G G

SAN

G

R

A

G

G G

G

R

G

P E/Q P

SAN LAN

Fabric

Switch

Fabric

Switch

Fabric

Extender

Fabric

Extender

Compute Blade

(Half slot)

Compute Blade

(Full slot)

Adapter Adapter Adapter

Altos ASIC

0.56 Tbps Xbar

Gatos ASIC

10GE/FC/1GE Media Access Controllers

Forwarding - Ethernet, Fibre Channel, Multipath

Policy Engine

Packet Buffering

Redwood ASIC

Host to uplink traffic engineering

Connectivity detection & management portal

Palo ASIC Data Plane

Virtualized adapter for both single OS and hypervisor systems

Ethernet, FC

Direct Data Placement for Fibre Channel

Page 10: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 10

Wire for Bandwidth, Not Connectivity

Wire Once Architecture

All links can be active all the time

Policy-driven bandwidth allocation

Virtual interface granularity

Uplinks

20Gb/s 40Gb/s 80Gb/s

Page 11: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 11

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 12: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 12

Unified Computing System Manager

• Embedded device manager for family of UCS components

• Enables stateless computing via Service Profiles

• Efficient scale: Same effort for 1 to N blades

• APIs for integration with new and existing data center infrastructure

Page 13: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 13

UCS Manager

Single point of management for UCS system of components

Adapters, blades, chassis, fabric extenders, fabric interconnects

Embedded device manager

Discovery, Inventory, Configuration, Monitoring, Diagnostics, Statistics Collection

Coordinated deployment to managed endpoints

APIs for integration with new and existing data center infrastructure

SMASH-CLP, IPMI, SNMP

XML-based SDK for commercial & custom implementations

UCS Manager

GUI Custom Portal or Tools

Systems Management Software

CLI

Page 14: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 14

Management Protocols

Call-home

SMASH CLP

Remote KVM UCS CLI and GUI

UCS XML API

CIM XML

IPMI

SNMP

Serial Over LAN

syslog

Page 15: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 15

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 16: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 16

UCS 6100 Series Fabric Interconnects

6100 Series Fabric Interconnects • 10 Gigabit Ethernet, FCoE capable, SFP+ ports

• 20 and 40 fixed port versions with Expansion slots for additional

Fiber Channel and 10 GE connectivity

• Upto to 1.04 Tbps of throughput

• Hot pluggable fan and power supplies

• Hardware based support for Cisco VN-Link technology

• Fully managed by UCS Manager through Fabric Interconnect

Page 17: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 17

Combo FC + Ethernet

FC-only (8 ports @ 1/2/4 Gbsec)

Ethernet-only

FC-only (6 ports @ 1/2/4/8 Gbsec)

UCS 6100 Series Expansion Modules

Page 18: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 18

• UCS 6248UP chassis

• 32 fixed Unified Ports

• 1 expansion module slot (16 ports)

• Double the port density in 1RU

• Foundation for future network scalability

• 1.92 Tbps throughput

• 4096 VLANs

• Dual power supplies for both AC and DC

Scalable platform for high density, high

performance, unified infrastructure

Platform for future app and virtualization needs

Benefit

Feature details

UCS 6248UP Fabric Interconnect

Page 19: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 19

Unified Port

Unified Ports Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel

Use-cases

Native Fibre Channel

Flexible LAN & storage convergence based on business needs

Service can be adjusted based on the demand for specific traffic

Convert protocol support on the

same port dynamically

All ports on UCS 6200 Series

16-port Expansion Module for

6248UP and 6296UP

Lossless Ethernet:

1/10GbE, FCoE, iSCSI, NAS

Benefits

Simplify switch purchase - remove ports ratio guess work

Increase design flexibility

Remove bandwidth bottlenecks

Page 20: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 20

UCS 6200 Expansion Module

UCS-FI-E16UP • 16 “Unified Ports”

• Ports can be configured as either

Ethernet or Native FC Ports

• Ethernet operations at 1/10 Gigabit

Ethernet

• Fibre Channel operations at 8/4/2/1G

• Uses existing Ethernet SFP+ and

Cisco 8/4/2G and 4/2/1G FC Optics

Page 21: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 21

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 22: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 22

UCS 2104 Fabric Extender

2104 Fabric Extender • Connects UCS blade chassis to the Fabric Interconnect

• Four 10 Gigabit Ethernet, FCoE capable, SFP+ ports

• Up to 2 Fabric Extenders per chassis for redundancy and up to 80

Gbps of bandwidth per chassis

• Built-in chassis management functionality

• Hardware based support for Cisco VN-Link technology

• Fully managed by UCS Manager through Fabric Interconnect

Page 23: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 23

• Double the uplink bandwidth

• 8 x 10 Gig network-facing ports

• Quadruple the server-facing bandwidth

• 32 x 10 Gig = 4 per half width slot

• Two I/O Modules per chassis

• 80Gbps to a single half-width blade (40Gbps left and right)

• 160Gbps to a full-width blade

I/O scalability and flexibility

Customer benefits

Feature details

UCS 2208XP I/O Module

Page 24: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 24

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 25: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 25

UCS 5108 Blade Chassis

Chassis

• Up to 8 half slot blades

• Up to 4 full slot blades

• 4x power supplies, N+N grid redundant

• 8x fans included

• 2x UCS 2104 Fabric Extender

• All items hot-pluggable

Page 26: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 26

4 to 8 Blades

4 Power

Supplies

6U, 19” Rack

8 Fan Modules

4 Power

Connectors

2 Fabric

Extenders

UCS 5108 Blade Chassis Parts

Page 27: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 27

Redundant data and management paths

I/O Modules

Blade Connectors PSU Connectors

UCS 5108 Blade Chassis Backplane

Page 28: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 28

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 29: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 29

Compute overview B

lade

Rack M

ount

B230 M2

2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM

B250 M2

2 Socket Intel 5600, 2 SFF Disk, 48 DIMM

B200 M2

2 Socket Intel 5600, 2 SFF Disk, 12 DIMM

B440 M2

4 Socket Intel E7,4 SFF Disk, 32 DIMM

C200 M2 2 Socket Intel 5600, 4 Disks, 12 DIMM, 2 PCIe, 1U

C210 M2 2 Socket Intel 5600, 16 Disks, 12 DIMM, 5 PCIe, 2U

C250 M2 2 Socket Intel 5600, 8 Disks, 48 DIMM, 5 PCIe, 2U

C460 M2 4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U

C260 M2 2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U

Page 30: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 30

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 31: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 31

C460 M2 4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U

C260 M2 2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U

C210 M2 2 Socket Intel 5600, 16 Disks, 12 DIMM, 5 PCIe, 2U

C200 M2 2 Socket Intel 5600, 4 Disks, 12 DIMM, 2 PCIe, 1U

Compute overview B

lade

Rack M

ount

B230 M2

2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM

B250 M2

2 Socket Intel 5600, 2 SFF Disk, 48 DIMM

B200 M2

2 Socket Intel 5600, 2 SFF Disk, 12 DIMM

B440 M2

4 Socket Intel E7, 4 SFF Disk, 32 DIMM

C250 M2 2 Socket Intel 5600, 8 Disks, 48 DIMM, 5 PCIe, 2U

Page 32: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 32

UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

Page 33: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 33

High Performance 10Gbps per port maximum throughput for high bandwidth SAN and LAN traffic

Full hardware offload for FCoE protocol processing

250,000 IOPS per port deliver high I/O

Up to 8Gb FC throughput

Full support for TCP/IP and Ethernet with enhancements

Priority-based Flow Control (802.1Qbb)

Jumbo frames

Checksum offloads

Segmentation offloads

Common driver for CNAs and HBAs

Low power ~ 5W

I/O Adapters for B-Series M72KR-Q

Page 34: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 34

Full 10Gbps network performance

with support both LAN and SAN traffic

Full hardware offload for FCoE

protocol processing

PCIe Express 2.0 (x8, 5GT/s), MSI-X support

Integrated data buffer and code space memory

Theoretical 10Gb FC throughput

Common driver for UCNAs and HBAs

Support for Jumbo frames

Cannot do per priority pause on Ethernet traffic.

I/O Adapters for B-Series M72KR-E

Page 35: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 35

I/O Adapters for B-Series M61KR-I

Interface Type PCIe v2.0 (5.0GT/s)

Intel® VT-dVMDq, SR-IOV

Full support for TCP/IP and Ethernet with enhancements:

Priority-based Flow Control (802.1Qbb)

Jumbo frames

Checksum offloads

Segmentation offloads

Low power ~7W

Page 36: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 36

I/O Adapters for B-Series M51KR-B

Broadcom NetXtreme II 57711 Dual-Port 10 Gigabit Ethernet PCIe Adapter

x8 PCI Express base specifications v2.0 and v1.1

iSCSI offload

Virtual LANs (VLANs), IEEE 802.1q

IEEE 802.3x flow control

TCP, IP, UDP checksum offload - TCP segmentation

iSCSI Boot capable

Page 37: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 37

Palo Based Mezzanine Card M81KR-VIC

0 1 2

Eth Eth

FC FC

119

Adapter designed for both single-OS and VM-based deployments • Network Interface Virtualisation support

• VN-link capable hypervisor integration

PCIe standard compliant

Power of 18 watts

Cut-through architecture

High Performance • 2x 10Gb

• Low latency

• 600K IOPS

HW capable of up to 128 vNICs • Ethernet vNIC, and FC vHBA

• Two ports to the backplane

• Switch and network see all vNIC and vHBA

Page 38: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 38

• Dual 4x10 Gbps to a single slot

• Host connectivity PCIe Gen2x16

• HW Capable of 256 PCIe devices

• OS restriction apply

• PCIe virtualization OS independent (similar to Palo)

• OS drivers for 1st Gen VIC and 2nd Gen VIC same

Dual 4x10 Gb to a single slot VM-FEX scale, up to 116 VM interfaces /w ESX 5.0

Customer benefits

Feature details

UCS 1280 2nd Gen VIC

Page 39: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 39

I/0 Adapters:

N2XX-ABPCI02 - Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)

N2XX-ABPCI03 - Broadcom BCM5709, GbE Quad Port GE NIC

N2XX-ABPCI01 - Broadcom BCM5709, GbE Dual Port GE NIC

UCSC-PCIE-BSFP - Broadcom BCM57712, 10GbE Dual Port NIC

N2XX-AEPCI01 - Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)

N2XX-AEPCI03 - Emulex LPE 11002 4Gb Dual Channel FC HBA

N2XX-AEPCI05 - Emulex Lpe 12002 8Gb Dual Port FC HBA

N2XX-AIPCI01 - Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)

N2XX-AIPCI02 - Intel Quad Port GE NIC

N2XX-AQPCI01 - Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)

N2XX-AQPCI03 - Qlogic 2462 4Gb Dual-Channel FC HBA

3rd Party Adapters for UCS C-series

Page 40: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 40

Connectivity

Page 41: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 41

UCS 6100 Operating Modes

• External LAN sees UCS 6100 as an end-host

with multiple adapters (no STP)

• Active/Active use of uplinks by pinning

• Single or disjoint upstream L2 domain

• More scalable than switch mode

• External LAN sees UCS 6100 as a traditional

Ethernet switch (STP = PVST+)

• Some uplinks blocked by STP (no pinning)

• Single or disjoint L2 domains

• MAC learning on uplink/server interfaces

End Host Switch

Page 42: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 42

UCS Ethernet Connectivity

appliance

monitor

LAN IP Storage FCoE Storage

UCS 6100 UCS 6100

Nexus 2248 Nexus 2248

storage target uplinks

Page 43: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 43

Port Types vs. FI Operating Mode

Page 44: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 44

From Chassis to Fabric Interconnect

UCS 2104

10Gb Mezz

IOH

CPU CPU

x16 Gen 2

x16 Gen 2

Mezz

Server Blade

Midplane

IO Modules UCS 2104

SFP+ Module Fabric

Interconnects SFP+ Module

IO Module to 61XX Blades pinned to uplink based On Slot number

Blade Chassis

(UCS 61XX)

Page 45: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 45

From Chassis to Fabric Interconnect - New

UCS 2208

UCS 1280

IOH

CPU CPU

x16 Gen 2

x16 Gen 2

Mezz

Server Blade

Midplane

IO Modules UCS 2208

16x

SFP+

16x

SFP+ Module Fabric

Interconnects

16x

SFP+

16x

SFP+ Module

4x10 Gbps Ether channel from VIC-2 to 2208 IO Modules

No user configuration required

vNIC flows are 5-tuple LB across links

Each individual flow limited to 10Gb

Fabric Failover available

IO Module to 6248 links user configuration Ether channel

Blade Chassis

(UCS 6248)

(UCS 2208)

(UCS 1280)

Page 46: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 46

FC Switch mode

UCS B-Series

UCS 6100 UCS 6100

FCoE Storage FC Storage

Fibre Channel

Ethernet

Unified I/O

FCoE

Core

Fabric A Fabric B

SAN Fabric Storage Arrays

SAN Edge A SAN Edge B

Direct Attach

Must have connection to MDS FC Switch or N5K Data traffic doesn’t have to go

through FC switch or N5K

Only works with Cisco FC Switches or N5K

Page 47: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 47

Management path via FEX, Data path directly connected

UCS C-Series Integration to UCSM

6100 running UCSM 6100 running UCSM

CIMC

GE LOM PCIe Adapter

CPU Mem

OS or Hypervisor

C200, C210, or C250

Mix of B & C Series

is supported

Nexus 2248 Nexus 2248

2 LOM ports

exclusive CIMC

connectivity

Adapter support:

Emulex CNA

Qlogic CNA

Intel 10g NIC

Broadcom 10g NIC

Cisco VIC

Mgmt Traffic

Data Traffic

Page 48: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 48

Stateless computing and management services benefits of Phase 1

Improved C-Series server connectivity

•Management and data connectivity through 2232PP FEX

•Phase 1 topology will no longer be supported (from this server pack forward, a 2248 topology will not work).

•Note that you will not be able to direct connect the data plane to the FI in this topology. Also, the mgmt and data connections from the rack mounts to the 2232 are separate (single wire mgmt is an uncommitted ask for a later software release)

Server Support • Phase 1 supported servers (C200 M2, C210 M2, C250 M2) • Additional C-series models shipping at time of Phase 2 (e.g.,

C200 M2 Small Form Factor, C260 M2, C460 M2)

UCS Manager C-Series Integration Phase 2, UCS 2.0+ (Capitola +1) Server Bundle/ MR (Target Q1 CY2012)

Simplified topology with converged FEX Scalable up to 160 servers (target scale, not QA verified)

Customer benefits

Feature details

UCS 6100 or 6200 UCS 6100 or 6200

Nexus 2232 Nexus 2232

UCS

Manager

Data Connection

Mgmt Connection

1 or 10 Gb LOM

GLC-T connector

10 Gb CNA

Page 49: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 49

New topology

Both mgmt and data connect into a single Nexus 2232 which plugs in to UCS fabric interconnects. A pair of Nexus 2232 is required for HA. Mgmt ports will require a 1000Base-T SFP Transceiver Module (RJ-45 connector).

Required software version

UCS 2.x (maintenance release) – This is NOT part of 2.0 FCS, but rather a follow-on server pack

New topology benefits

Topology simplification (converged connectivity i.e both mgmt and data plane connect into a Nexus 2232)

Increased scale up to 160 servers (targeted value, subject to modification)

·

Highlights of the New Topology

Page 50: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 50

VM-FEX

Page 51: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 51

Emulated Mode VMDirectPath

Standard Mode

12%-15% CPU performance improvement

vMotion supported

High Performance Mode

Co-exists with Standard mode

Bypasses Hypervisor layer

30% improvement in I/O performance

vMotion supported with ESX 5.0

Modes of VM-FEX

Page 52: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 52

… …

UCS Switch

Cis

co

VIC

Adapter Port

VM-FEX with KVM Architecture

Switch Port

… …

Us

er

Ke

rne

l

Macvtap

Interface

Netdev

Interface

Libvirt

Management

Tools

Netlink

Socket

Application

virtio-net

eth1

Macvtap 1

vhost-net

KVM

Guest

OS

Guest 2

Application

virtio-net

Guest

OS

Guest 1

eth2

Macvtap 2

vhost-net

eth0 ethn

PF VF1 VF2 VFn

Port Profile1:

Qos1, vlan1

Port Profile2:

Qos2, vlan2

Veth 1 Veth 2

Port Profile2:

Qos2, vlan2

Port Profile1:

Qos1, vlan1

Page 53: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 53

Complete Your Session Evaluation

Please give us your feedback!!

Complete the evaluation form you were given when you entered the room

This is session BRKxxx-xxxx

Don’t forget to complete the overall event evaluation form included in your registration kit

YOUR FEEDBACK IS VERY IMPORTANT FOR US!!! THANKS

Page 54: Unified Compute System (UCS) Architectural Overview · Single point of management for UCS system of components Adapters, blades, chassis, fabric extenders, fabric interconnects Embedded

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BRKSPM-2604_c1 54