![Page 1: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/1.jpg)
State of the Open Source & Disaggregated Ecosystem Russ White
![Page 2: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/2.jpg)
Dev
ice/
Con
trol P
lane
Mod
els
Network Device
Controller
Network Device
Open standard
control plane
Network Device
Open standard
control plane
Open Source NOS
Open Standards SDN Disaggregated
![Page 3: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/3.jpg)
Com
paris
on
SDN White Box Disaggregation
Lower cost hardware Potentially X Potentially
Centralizing control and management
X Potentially Potentially
Application integration X Orthogonal X
Business alignment Potentially Orthogonal X
![Page 4: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/4.jpg)
Dis
aggr
egat
ed M
odel
Routing Stack
Fan/LED/etc. Phy
Hardware Abstraction (HAL)
RIB
BGP IS-IS Configured Routes
. . .
Platform Abstraction (PAL)
Kernel
Forwarding ASIC
ONIE
![Page 5: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/5.jpg)
Opt
ions
Appliance Vendor
Hardware
Open Source
White/Bright Box Hardware
Vendor Software
White/Bright Box Hardware
Open Source Software
Appliance Vendor
Software
Appliance Vendor
Hardware
![Page 6: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/6.jpg)
Whi
te/B
right
Box
BROADCOM
BAREFOOT
CAVIUM
MELLANOX
DELTA ALPHA NETWORKS QCT ACCTON CELESTICA CISCO DELL JUNIPER
![Page 7: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/7.jpg)
Vend
or S
oftw
are
Stac
ks
6WIND CUMULUS NETWORKS
IP INFUSION JUNIPER
LABN
CISCO RTBRICK DELL SNAPROUTE BIGSWITCH
![Page 8: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/8.jpg)
Platform Abstraction Layer • Often one of the hardest components to source • Must connect your hardware platform with your chosen stack and O/S
• Provided by � Hardware vendor � Software vendor � Consulting companies will also write these
Com
pone
nt B
asic
s
![Page 9: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/9.jpg)
ASIC Hardware Abstraction SAI • Supports (pretty much) all chip vendors
• Pluggable architecture OpenNSL • Broadcom only
P4 • Barefoot Networks • Programming language rather than an API
asicd • Snaproute’s interface to a wide variety of asics swtichd • Cumulus’s interface to a wide variety of asics
fd.io • Based on DPDK • Largely focused on accelerated NICs, rather than
network switching hardware
Com
pone
nt B
asic
s
![Page 10: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/10.jpg)
Rou
ting
Stac
ks
GOBGP
open
sou
rce
com
mer
cial
commercial/open source
BIRD
SNAPROUTE
IPINFUSION
CISCO
JUNIPER
![Page 11: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/11.jpg)
FR R
outin
g O
pen
Sour
ce
CUMULUS BIGSWITCH VOLTA NETWORKS 6WIND ARCHITECTURE TECHNOLOGY CORPORATION ORANGE INTERNET SYSTEMS CONSORTIUM OPEN SOURCE ROUTING LABN CONSULTING 128 TECHNOLOGY NETDEF
FR ROUTING
![Page 12: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/12.jpg)
Stab
le 2
.0
BGP Performance & Scale fixes AddPath Support Remote-AS internal/external Support BGP Hostname support Update Groups RFC 5549 (unnumbered) Support Nexthop tracking 32-bit route-tags RIB (Zebra) MPLS Support IPv4/v6 for static LSPs 32-bit route-tags Nexthop Tracking RFC 5549 (unnumbered) Support OSPF (v2/v3) OpenBSD Support restored 32-but route-tags RFC 5549 (unnumbered) Support
LDP RFC 5036 (LDP Specification) RFC 4447 (Pseudowire Setup and Maintenance using LDP) RFC 4762 – (Virtual Private LAN Service (VPLS) using LDP) RFC 6720 - The Generalized TTL Security Mechanism (GTSM) for LDP RFC 7552 - Updates to LDP for IPv6 Others JSON Support VRF Lite Snapcraft Packaging
STABLE 2.0
FR ROUTING
![Page 13: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/13.jpg)
Nex
t Ver
sion
3.0
BGP BGP Shutdown Message Large Communities (RFC8092) eVPN (partial) (RFC 7432) IDR Tunnel (draft-ietf-idr-tunnel-encaps-03#section-3.2.1) IPv6 VPN (misc fixes) IPv4/IPv6 VPN Graceful Restart PIM Unnumbered interfaces MSDP (RFC4611) Sparse Mode (RFC4601) NHRP NHRP (RFC2332) (Linux only, for NBMA-GRE tunnels; no ATM; not supported on BSD) Label Manager
LDP Unnumbered interfaces Capabilities (RFC5561) Typed wildcard FEC (RFC5918, RFC6667) Advertisement completion (RFC5919) Controlling State Advertisements (RFC7473) IS-IS SPF Backoff OSPFv3 Authentication/Confidentiality (RFC4552) CLI Parser rewritten in Bison Lexer rewritten in Flex Definition grammar overhauled
NEXT VERSION 3.0
FR ROUTING
![Page 14: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/14.jpg)
FR Routing - What’s different? • Methodical vetting of submissions • Extensive automated testing of contributions • Git Pull Requests • Github centered development • Elected Maintainers & Steering Committee • Common Assets held in trust by Linux Foundation
![Page 15: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/15.jpg)
FR Routing – How to get it • Binary package � Snap package available now � Snap is a new universal package format – see snapcraft.io � FRR 2.0 in stable channel and FRR 3.0 in beta channel
� Debian / Ubuntu / RedHat packages coming soon � Other packages will follow
• Source � Github ( https://github.com/FRRouting/frr ) � Branch stable/2.0 à Released Version 2.0 � Branch stable/3.0 à Version 3.0 (upcoming release) � Branch master à Latest development (“unstable”)
![Page 16: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/16.jpg)
Some Architectures
![Page 17: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/17.jpg)
Ope
n N
etw
ork
Linu
x
SAI FBOSS
OpenNSL SONIC …
Con
trol P
lane
BGP IS-IS …
Switch Hardware ASIC
Kernel
ONL Platform APIs
CLI REST …
Open Route Cache
Zebra
![Page 18: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/18.jpg)
Orchestration/Automation
Con
trol
Pla
ne
BGP IS-IS …
Switch Hardware ASIC
Kernel
OpenStack
VMWare NSX
…
SwitchD
Zebra
Puppet
Chef
collectd
CU
MU
LUS
LIN
UX
![Page 19: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/19.jpg)
Switch Hardware ASIC
asicd
SAI SoftSwitch
OpenNSL Vendor …
thrift rpc
RIB ARP
BGP IS-IS …
systemd LACP/LLDP/etc.
thrift rpc
configd REST Config
CLI Netconf Ansible Chef
SNAP
RO
UTE
![Page 20: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/20.jpg)
configuration and management tools
SONiC Base
network applications
SON
iC
Telemetry Puppet Chef Ansible
Utility
Platform
SYNCD
LLDP
RedisDB
FR Routing
More apps SNMP BGP DHCP IPv6
SWSS
Database
third party & custom
OCP Business Application
. . .
![Page 21: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/21.jpg)
Network Applications
Switch Services (SWSS)
Object Library
AppDB SAIDB
Orchestration
synchd SAI ASIC
redisdb w/ object library
persist SAI objects persist app objects
synchs SAI objects from software to
hardware
• translation between apps and SAI objects • resolution of dependency and conflict
SON
iC
![Page 22: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/22.jpg)
Challenges
![Page 23: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/23.jpg)
“One Neck to Choke” • Also known as… � A “single point of failure” � “my vendor makes all of my architectural decisions”
• Do you really have this today? � Be honest! J
![Page 24: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/24.jpg)
Market Challenges • This is an immature market � Vendors and projects are in flux � Projects are often based on small communities
• Skill set often == unicorns � There are no certifications, paths, etc. � You have to be an engineer/architect � Rather than “just” a CLI/vendor jockey
� You have to be “full stack” � Integrate business architecture with network architecture � Understand applications, how they use the network, etc. � Know the bits and pieces of a router, what they all mean, etc. � Keep up with ten different sources, rather than one
![Page 25: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/25.jpg)
Hardware Challenges • Silicon support � Route count � Queue depth/buffering � Label imposition depth � Many others—this is an area where you must be careful
• Project/Vendor overlap � Most ASICs are supported by most every option covered here � System/support chipsets are a different story � Fans, LEDs, CPUs, other components
� Be very careful to ask about this when building a system
25
![Page 26: State of the Open Source & Disaggregated Ecosystem · PDF fileand management X Potentially Potentially ... Object Library AppDB SAIDB Orchestration ... System/support chipsets are](https://reader031.vdocuments.site/reader031/viewer/2022030413/5a9e94247f8b9a71178b88d1/html5/thumbnails/26.jpg)
Other Challenges • We ain’t got no features � But part of the point is to stop throwing features and nerd knobs at every imaginable problem
• No tech support unless you buy it • You must be an educated consumer � Participate in open standards � Pay attention to provider venues, papers, etc. � Much is under NDA
• If you’re using open source, you should be a part of the community