Pluribus “Freedom” Architecture Fusion Of Compute-Network-Storage-Hypervisor

…How Does It Work?

Compute

Storage

Network

Hypervisor

CPU

RAM NIC

CPU

Devic

e

Devic

e

Mem+PCIe

Interconnects

Server OS OS Virtual

Memory

Device Device

We start from an off-the-shelf server…

…and an Open Source Server OS…

CPU

RAM

CPU

Netvisor OS Virtual

Memory

Mem+PCIe

Interconnects

Nx10GE

Device Device

And we replace the NIC with a

merchant silicon switch chip

Switch chip mapped

into OS (unlike

conventional switches!)

Switch-Chip controlled at

multi-10G speed (unlike

conventional switches!)

Switch chip is fully

programmable as an

application flow accelerator

(unlike conventional

switches!)

The Freedom Server-Switch

Devic

e

Devic

e

CPU

RAM

CPU

Netvisor OS Virtual

Memory

Devic

e

Devic

e

Mem+PCIe

Interconnects

Nx10GE

Device Device

Dual Socket Xeon Off-the-shelf Server MB

Up to 1TB of RAM

Inside a Server-Switch

Netvisor Components and APIs

CPU

RAM

CPU

Device Device

Mem+PCIe Interconnects

NIC

vNIC

VM

Guest OS

VM

SRIOV

Hypervisor

vSwitch

CPU

RAM

CPU

Device Device

Mem+PCIe Interconnects

VM VM

SRIOV

Hypervisor(Netvisor)

4x 10GE

VNET

Where Does This Fit In The Datacenter?

Server-Switch

Server

Freedom Development Kit Libraries

Netvisor Open Programmability

inNetwork SDN

CLI

Pluribus GUI

You Can work with the CLI, or you can use fully multi-threaded C, Java, REST

APIs

Fabric-Cluster Application

Every Node shares the

same view of the

Fabric: MAC, IP,

connections and app

flows

Single Point of

Mgmt

Applications/Services/Orc

hestration controllers

“see” only one device

Built-in ARP

suppression

Classic database

3-phase commit

for config

changes

Distributed cluster

free of centralized

controllers

The Fabric-Cluster Application

Fabric-Cluster Application

The Analytics Application

inNetwork Analytics: No Taps, No Monitoring Network

Track any connections

across the entire

fabric-cluster from any

node

Full visibility into

overlay network traffic

‘Industrial’ control plane

permits monitoring at wire-

rate as opposed to

sampling, where nuances

may be lost. No limitation from

traditional switch

chip tables

Analytics Time Machine

Starts at tracking 1 million

application flows in Real

Time and log 400Gb of

data over Fusion-io

without losing any

information.

The VM and application

level analytics are

available in Real Time and

via Time Machine for

outlier analysis and

historical monitoring

Logging on Fusion-IO device

and can be exported over

NFS, iSCSI 3rd party tools can be hosted

on Netvisor itself to process

and visualize the data

natively right inNetwork

F64-L E68-M F64-XLExample: CLI (network-admin@aquila12) > connection-show start-time 16:00 end-time 16:30 switch vlan vxlan vnet client-ip server-ip server-port cur-state latency obytes ibytes total-bytes age -------- ----- ---- ----- ---- ------------ --------------- ----------- --------- ------- ------ ------ ----------- -------- Aquila12 1 0 10.9.9.73 10.9.9.86 nfs fin 49.1us 45 29 74 1h30m54s Aquila12 1 0 10.9.9.73 10.9.9.9 nfs fin 109us 45 29 74 1h30m54s Aquila12 1 0 10.9.9.33 10.9.9.73 nfs fin 103us 45 29 74 1h31m Aquila12 1 0 10.9.9.33 10.9.9.9 nfs fin 311us 45 29 74 1h31m Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 30.5ms 499 174 673 1h31m6s Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 306us 1.59K 3.01K 4.60K 1h31m7s Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 302us 2.72K 11.4K 14.2K 1h31m8s Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 22.4ms 499 174 673 1h31m9s pn-dev03 1 0 10.9.18.149 10.20.100.88 http fin 32.1us 153 362 515 1h30m48s pn-dev03 1 0 10.9.18.149 10.20.100.88 http fin 594us 152 255 407 1h30m48s pn-dev03 1 0 10.9.9.151 10.20.3.9 8084 fin 312us 88 480 568 1h30m50s pn-dev03 1 0 10.9.9.151 10.20.3.9 8443 rst 233us 4.33K 3.31K 7.65K 1h30m50s pn-dev03 1 0 10.9.9.73 10.9.9.86 nfs fin 32.3us 45 29 74 1h30m54s pn-dev03 1 0 10.9.9.73 10.20.9.79 nfs fin 222us 45 29 74 1h30m54s Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 302us 2.72K 11.4K 14.2K 1h31m21s Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 22.4ms 499 174 673 1h31m22s Aquila12 1 0 10.9.10.177 10.9.18.158 http rst 210us 3.17K 39.9K 43.1K 1h31m22s Aquila12 1 0 10.9.9.186 173.164.164.42 ssh fin 13.7ms 2.53K 2.80K 5.33K 1h31m23s

Fabric-Cluster Application

The vFlow Application

Flow abc

Flow xyz

Ability to capture,

analyze, modify,

redirect, drop, and

police flows across the

entire fabric-cluster from

any node in the cluster.

Fabric-wide Flow Programmability

Freedom SDN

Eliminate Scalability Bottleneck of

Controller-Based SDN The Controller programs ONE logical device

Pluribus inNetwork SDN High-BW, low latency, TRUE Server

programming of application flows!

Freedom Development Kit Libraries

CLI

Pluribus GUI

Fabric-Cluster Application

Virtual Networking Application

inNetwork Virtualization

VLAN:100-200 / 16K MAC VLAN:500-600 / 32K MACs VLAN:800-900 / 64K MACs

RED NETWORK BLUE NETWORK GREEN NETWORK

#1

Port 17-46

#1

Port 47-64

#3

Port 1-16

#2

Port 17-46

#3

Port 17-46

#2

Port 47-64

#3

Port 47-64

#2

Port 1-16

#1

Port 1-16

IP Network

Eliminate Separate Overlay-Underlay

VLAN/VXLAN

Freedom Use Cases

Switching/

Analytics

• inNetwork

Monitoring/Anal

ytics

• Clustering

• Congestion

Mgmt

• Large buffers

(NPU)

Stanford Dept. of

Electrical Engineering

Rack/Cloud

Controller

• OpenStack

• inNetwork

Virtualization

• Services

• Storage

• Analytics

• Devops tools

inNetwork

Apps

• Unix-style

Programmability

• Optimize rack

space and

power

• Run services in

the rack

• Latency play

SDN/NFV @

scale

• L4-L7 services

• High-perf

application flow

programmability

Netvisor 2.0

IP Services

Software Defined Fabric

Advanced Software Defined Fabric Advanced

Virtualization and Storage Service

HA Clustering,

Analytics and Network Services

Enterprise L2/L3 Switching

• L2/L3 Switching

• IPv4/IPv6 Routing

• Multicast

• QoS

• ACL

• sFlow / SPAN

• HA Fabric-Cluster

• Fabric-wide Analytcs

• Fabric-wide vFlow

• Services: DHCP, DNS,

PXE Server, NAT,

• Controllers: Floodlight

(Openflow), OpenStack

• Red Hat Linux

OpenStack

• VXLAN Gateway (VTEP)

• VLAG

• Virtual Networks (VNETs)

• VMs for 3rd party apps

• VMs for 3rd party L4-L7

Svcs

• NAS: iSCSI, NFS, CIFS

• Storage Mirroring, RAID

• Per VNET Services

• Per VNET Controllers

• Advanced Analytics

Logging

Pluribus “Freedom” Portfolio At-A-Glance

Netvisor Freedom

Operating System

Three Tiers

IPS, SDF, ASDF

E-Series Server-Switch

(Broadcom Trident 2) F-Series Server-Switch

(Intel Alta)

One Model

E68-M Three Models

F64-M, F64-L, F64-XL

Front view

44 x10G/1G + 6 x 40G 48 x10G/1G + 4 x 40G

Front view

Converged

Infrastructure

Beyond

Traditional

Networks

Unify

Devops-Netops

Pluribus

Value

FASTER DELIVERY OF IT

APPLICATIONS / REDUCE MEAN

TIME TO PROBLEM RESOLUTION

Pluribus Business Value Proposition

Summary

• SDN on bare metal switches is seeing good interest and moving into production

• Every customer is looking to use the switches to do more. Some use cases seeing deployments:

• Analytics • Security • Application performance and debugging

• Services

Fabric-Cluster Application

The Fabric-Cluster Application

IP Network

Works over

ANY IP

Network