geant network evolution - internet2 network evolution rick havern ... • bgp communities and...
TRANSCRIPT
![Page 1: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/1.jpg)
GEANTNetworkEvolution
RickHavernHeadofNetworkEngineering
TechExchangeSeptember2016
Miami
![Page 2: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/2.jpg)
Agenda
Thethingscausingustothinkdifferently
Ourchallenge
Whatwehavedone
Whatwearedoing
Ourcollaborations
Whatwewanttoachieve
![Page 3: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/3.jpg)
Onaveragehumanknowledgeisdoublingevery13monthsAccordingto IBMthebuildoutof the“internet ofthings”willleadtothedoublingofknowledgeevery12hours.
3
HumanBrainIndexingWillConsumeSeveralBillionPetabytesInalectureatHarvardUniversityneuroscientistJeffLichtman,whoisattemptingtomapthehumanbrain,hascalculatedthatseveralbillionpetabytesofdatastoragewouldbeneededtoindextheentirehumanbrain.
We are seeing traffic volumes doubling every 18 monthsThe amount of data forecast to be generated and stored isastounding. This will drive an exponential growth in networktraffic. IP backbone trunks will need to be 400Gbps by 2020 &a terabit by 2025
![Page 4: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/4.jpg)
• Multidomaininteroperation• CommonlysupportedtechnologiessuchasMPLSarekey• CommonOSS/BSSsystemsarchitecture• Commonserviceofferings• InteroperatewithallkindsofServiceProviders&infrastructures
• Commercial• R&E
• Commonserviceofferings- Inalignmentwithglobalpartners;evaluatedagainstcommercialequivalents• Technology&vendoragnosticservices(hardware&software)• Servicesbuiltonstandardsbasedcommoncomponents- CreatedoutofasharedcommonOSS/BSSarchitecture
• Increasingcomplexity• Services&functionsmoveoutofhardwareintosoftware• Virtualised resourcesandfunctions• SoftwareOrchestration
• Sustainability• Morecapacity• Fasterinterfaces• Operationalcomplexity 4
Itisnotonlytrafficgrowththatisdrivingourthinkingforhowourplatforms(network+OSS)needtoevolve
![Page 5: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/5.jpg)
Thisourchallenge
5
• Exponentialtrafficgrowth+
• Needformoreadvancedservices+
• Greateroperationalcomplexity
Forcesustoadopttechnologyearly
We adopt technology here Wepayapremium
![Page 6: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/6.jpg)
• Convergenceofpacketandopticalnetworks• Commonpacket/opticalcontrolplane• Corenetworkmadesimpletoforwardpacketscosteffectively• Sophisticatedservicesdeliveredonoverlays- separationwithcorenetwork• Useofvirtualisednetworkfunctions• Greaterprogrammability• Intelligentmanagementplane(s)• Vendorindependence– separationofhardwareandsoftware• Seamlessinteroperationofinfrastructures
6
Newthinkingisrequiredtomeetlonger-termdemandscosteffectively
![Page 7: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/7.jpg)
WhathavewedoneBuiltalabforevaluatingnewsoftware&technologies
• Labbuilttoemulateproductionenvironmentascloselyaspossiblewithinrealisticfinancialconstraints:• JuniperMXrouters andInfineraDTN-x,alongwithtrafficandroutegenerators,multicastsourcesandreceivers
• Configurationandcodeversionsidenticaltoproductionnetwork• BGPcommunitiesandnetworkseparation
• NetFlow v9• Infinera OTSV
• PXMevaluation&JuniperDWDM• Alienwavetesting
• SDNevaluationandtesting,Corsa DP6410;PICA-8P-3922;DellS4810-ON• DTNtesting• Pre-stagingandtestingequipmentbeforeshipment
7
![Page 8: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/8.jpg)
• Equipment• 2xCORSADP64x0• 2xPICA8Switches• 2xDellS4810SwitchesrunningCumulusLinux
• 1xDellServerforVMs• InterconnectedtotheGÉANTJuniperMXlab
Whathavewedone:BuiltaSDNLabTestinganddevelopment- PoC evaluation
8
![Page 9: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/9.jpg)
WhathavewedoneSuccessfulimplementationofnewIASAStoseparateREN-to-RENfromREN-to-Internettraffic
9
InternetAccessServicevirtualroutingandforwarding(VRF)created– newASestablished,REN-to-RENtrafficseparatedfromREN-to-Internettraffic
• CloudVRFadded
NRENshavetheabilitytotrafficengineertheirroutepropagationthroughtheuseofopt-inoropt-outBGPcommunities,withper-peer&per-PoP/IXgranularity
Ifrequired,createaphysicalseparationoftraffictypes:• RENtoRENon100Gbps• RENtoIonNx10Gbps
NRENB
NRENC
NRENA
Peer/upstream
Peersand upstreammovedtonew
VRF/ASN
GÉANTren-IASN21320 GÉANTren-ren
ASN20965
NewsFlash
![Page 10: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/10.jpg)
NewsflashGÉANTCloudVRFperformancebeatscommercialISP
10
T-Systemsuncappedaccessto10Gforthedurationofthetest
![Page 11: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/11.jpg)
NewsflashGÉANTCloudVRFperformancebeatscommercialISP
11
ThankstoCERNforsharingtheirtestresults
![Page 12: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/12.jpg)
WhathavewedoneSharingspectrumwithNRENs
IdentifiedrouteswhereGÉANTandNRENscouldbenefitfrominfrastructuresharing• Amsterdam– Hamburg,alreadyinservice• Amsterdam– Paris,inserviceQ42016• Milan– Geneva• Madrid– Lisbon• Paris– Lisbon• Marseille– Milan• Marseille– Madrid• Budapest– Zagreb
12
![Page 13: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/13.jpg)
WhathavewedonePacketopticalintegration
IP-over-OTNarchitectureisnowdeployedusingInfinera PXMcards
13
Juniper DWDM implementation is also beingconsidered, currently under lab testing andto be trialled in future
We can now disaggregate 100Gbps interfacewithout any of the nx10G performance issues andcreate multiple direct routes that do not follow thefibre
IPtrunksdidfollowthefibretoreducethenumberof100Gbpsinterfaces&cost
![Page 14: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/14.jpg)
Whatarewedoing:Transportandmulti-layerSDNSoftwarecontrolofpacketandopticallayers
14
NREN
GÉANTWDM/OTN
100GbE 100GbE 100GbE 100GbE
100G
bE
NREN
GÉANTRouter
GÉANTRouter
GÉANTRouter
GÉANTRouter
LegacyODU4/2elinkstoroutersviaTIMports
IPtrunks.ODUflex usedtomanagebandwidthbetween
PXMcards.Thesearestatic(notOTScontrolled)
PXMcardssupportterminationofEVPLcircuitsonvlans
SDNcontroller
L2SDNswitch
L2SDNswitch
L2SDNswitch
Nx10G
bE
Nx10G
bE
OTSv
ODUflex andOTSvusedtodynamicallyinstatiate theselinks
![Page 15: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/15.jpg)
• Solutionsforthecarrierbackbone• Software-DefinedInternetExchange(SDX)atLayer3(SDNIP)andLayer2
• TransportSDN• SDN-basedBandwidthonDemand(BoD)withadvancedpathcomputationcapabilities
Whatarewedoing:DevelopingSDNsolutionsfordifferentdomainsNewfeatures,futureservices
15
• Solutionforintra-campusnetworking• UsinganSDNcontrollertostitchflowspaces toVLANswithinthecampus
• Solutionforintra-DCnetworking• OverlaynetworkingandL2gatewaysolutions
![Page 16: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/16.jpg)
• SDXLayer3:• EnablesanSDNnetworktobeoperatedastheIXPinfrastructure
• IPtransitserviceviaBGPtocustomers:• Dynamicpeeradministration• Same-subnetBGPpeers’configuration
• Directcommunicationbetweenpeers(viamodifiedProxyARPapp)
Whatarewedoing:Developing futureGEANTExchangepointsAhybridenvironmentforL2andL3services
16
BGPSpeaker1
BGPSpeaker2
SDN-IP1 SDN-IP2
ONOS1 ONOS2
ExternalNetwork1
ExternalNetwork2
ExternalNetwork3
ExternalNetwork4
ExternalBGP
Routers
ExternalBGP Router
ExternalBGP Router
ExternalBGP Router
ExternalBGP Router
SDNNetwork
![Page 17: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/17.jpg)
• SDXLayer2:
• L2tunnelsbetweenMAC/VLANendpoints,taggedwithVLAN/MPLS
• AllowsautomatedprovisioningofL2tunnelsbetweenSDXcustomers:
• AbstractionofvirtualSDXs
Whatarewedoing:Developing futureGEANTExchangepointsAhybridenvironmentforL2andL3services
17
SDNNetwork
ExternalNetwork1
ExternalNetwork2
ExternalNetwork3
ExternalNetwork4
BGP peer1 BGP peer2
BGP peer3 BGP peer4
InternalBGPspeakerQuagga router1
InternalBGPspeakerQuagga router2
ONOS1controller
ONOS2controller
SDXL3app
SDXL3app
SDXL2app
SDXL2app
![Page 18: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/18.jpg)
Whatarewedoing:DevelopingSDN-enabledBoDSDN-powered,guaranteed-capacitycircuitsondemand
18
GUITS
NSA IDM NSA
DynPaC DynPaC DynPaCONOS ONOS
TechnologyProxy
OpenFlow OpenFlow
RestAPI
RestAPI
NSI-CS NSI-CS
SW01Pica8
SW02Pica8
SW05CORSA
SW06CORSA
JuniperMX
JuniperMX
JuniperMX
JuniperMX
SW07OVS SW11
OVS
SW10OVSVM VM
SW08OVS
SW09OVS
Domain1
Domain2Domain3
CambridgeLabSDN GÉANT-BoD non-SDN AMRESSDN
JunosSpace
• Vendor-agnosticimplementation• Efficientuseofthenetworkcapacity
• Flowrelocation• Flowdisaggregation
• Resiliencyincaseofalinkfailurewithquickrecoverytimes• Pre-computedbackuppaths
![Page 19: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/19.jpg)
Whatarewedoing:Evolvingournetworkmanagement,controlandserviceplaneDisaggregationandmodularisation ofsoftwarecomponents
19
• Software-ization ofthemanagementandcontrolplane*• Standard-ization ofinterfaces• Vendor-independence
• NotnecessarilyGEANT-builtsoftware
VendorEMS/NMS
OSS/Middleware
Serviceapp Serviceapp Serviceapp
TechnologyProxy
Legacynetworkelements
Embeddedmanagement/controlfeatures/vendorOS
Netconf/SNMP/…
Middleware
*NFVaspectsarestilltobeaddressedforGEANT
Services
SDN
Infrastructure
![Page 20: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/20.jpg)
• DeliveringL2-L3SDNdataplanefunctionalitybyleveragingCORSAhardwarefeatures• Supportfor10/40/100GE,transceiveragnostic,enhancedQoS(Deepbuffers),OF1.3compliant,multi-tablepipeline
• GÉANT-tailoredmulti-tablepipeline• Metering• ONOSdriver
VendorcollaborationGÉANT-tailoredvendordevelopments
20
• Co-developingasolutionformanagingOTN(PXM)cardsusingONOS• LeveragingOTSv• UsingRESTtorequestanEthernetvirtualprivateline(EVPL)servicebetween100GBports
![Page 21: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/21.jpg)
• PresentationofGÉANTservicedefinitions• Specialised presentationsonSDNcontrollerrequirements
• ComparisonofONOSroadmapwithGEANTroadmap• ManyGEANTcommitstotheONOScorecodebase:
• https://github.com/opennetworkinglab/onos/commits• https://github.com/opennetworkinglab/onos-app-samples/commits• Mostofthemreviewedandmerged
• Flow-objectiveframeworkcapabilitynotdeliveredaspromised:• GEANTdeveloperhostedbyON.Lab toimplementandintegratetherequiredfunctionality
• Three-waycollaborationwithCorsa ontheSDXL2/L3cases• Three-waycollaborationwithInfinera ontheTransportSDNcase
CollaborationwithON.LabGÉANTcontributingtoglobalcommunityopen-sourcecontroller
21
![Page 22: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/22.jpg)
• Determinetherightwaytoseparatecontrol,dataandmanagementplanes• PowerfromvendorsintothehandsofUsersandOperators
• Integrationbetweenourpacketandopticalplatforms• Enablesinglecontrolacrosstheselayers– useexpensiveinfrastructuremoreefficiently
• Routerreplacement– separationofcontrolanddataplaneswithamanagementplane• Alternativetoexistingvendorsolutions
• Seamlessinteroperationofinfrastructures• Trulymultidomain
• Moveservicesintosoftware• Becomevendoragnostic
• CosteffectivelyruntheGEANTnetworkinthefuture
WhatwewanttoachievePutSDRIVENNintooperation– PRODUCTIONSDN
22
![Page 23: GEANT Network Evolution - Internet2 Network Evolution Rick Havern ... • BGP communities and network separation ... • Interconnected to the GÉANT Juniper MX lab](https://reader033.vdocuments.site/reader033/viewer/2022052420/5ad81b7a7f8b9a9d5c8ce298/html5/thumbnails/23.jpg)
Thankyou andanyquestions?Thankyou andanyquestions?