ThePossibleHongKong

OpenExchangePoint

Che-HooCHENG04Aug2016

DevelopingaBlueprintforGlobalR&ENetworkArchitecture

http://gna-re.net• TheGlobalNetworkArchitectureprogram(GNA)isaninternationalcollaborationbetweennationalresearchandeducation(R&E)networks.

• TheGNAtechnicalworkinggroupischargedwithdraftingablueprintforinterconnectingR&Enetworksonaglobalscale,basedonthelatesttechnologiesandpromisingdevelopments,withaten-yearhorizon.

• ThisblueprintwillenableR&Enetworkstoaligntheirspendingforintercontinentalbandwidth.

• Participationisopentoallregionsoftheworld.

PlanforGNA–High-levelArchitecture#1

http://gna-re.net/our-plan/• ThediscussionsinsidetheGNAgrouphaveledtoaglobalnetworkarchitecturemodelthatconsistsofapowerfulintercontinentaltransmissionsubstrate,consistingof:– GlobalOpenExchangePoints(GXPs)– High-bandwidthtransmissionpipes(runningbetweenGXPs)– forsharing

GNA – artist’s impressionCredit – Mian Usman (DANTE)

PlanforGNA–High-levelArchitecture#2

• TheGXPsinthisarchitecturemodelhavetwomajorfunctions:– Attachmentpointsforthehigh-bandwidthcircuitsofthesubstrate– forsharing

– ConnectionpointsfortheRegionalandNationalR&ENetworksthatarepartofandmakeuseoftheGNAinfrastructure

PlanforGNA–High-levelArchitecture#3

• WeenvisionatleasttwoGXPspercontinentorregionthatareplacedinconsultationwiththeregion’sR&ENetworkorganizations,takingtheintercontinentalfiber pathsintoaccount.

• TheGNAsubstratesupportsthecreation,modification,anddeletionofoverlaynetworks.Inthefirstinstance,thisisexpectedtobemanual.Overtime,itisexpectedthatthiscanbefullyautomated.

PlanforGNA–High-levelArchitecture#4

• Examplesofpermanentoverlaynetworksinclude:– GeneralpurposeIProutedinterconnect,supportingIPv4andIPv6,bothforunicastandmulticast

– CommercialPeeringServices– LHCOPNandotherOpticalPrivateNetworks– LHCONEandotherOpenNetworkEnvironments

PlanforGNA–High-levelArchitecture#5

• Examplesofadhocoverlaynetworksinclude:– Scienceinstrumentsupportnetworkslikefore-VLBIthatareonlyneededduringasciencerun

– VirtualOrganizationnetworksforlargemulti-continentsciencecollaborationslikeLHC,ITER,Climate,oragencieslikeNIH.

GXPExpectations#1http://gna-re.net/wp-content/uploads/2016/02/GNA-Open-Exchange-Expectations-v1.0-Technical.pdf• ServicesandCapabilities:

– afabricabletoaccommodateaconsistentsetofporttypesandtechnologies

– Colocation– Cross-connectstootherR&E,commercial&carrierfacilities– OutofBandaccess– Terminationandcross-connectionpointforinternationalcircuitsas

wellasdomestic/localconnections– Remotehandandon-callsupport(24x7)– Securityandaccess– Carrierneutral– Space,power,cooling,accesstoameetmeroom,physicalaccess

GXPExpectations#2• PrinciplesofOperation

– OpenAcceptableUseApproach:AbilitytointerconnectwithanyR&EEntity

– OpenAcceptableUseApproach:Supportfor“Commercial”Traffic– ProductionQualityOperationsRegime&CommunityEngagement– Measurement– PrivacyofDataPolicyStatement– Flexibilityandagilityinaccommodatingevolvingtechnologies– PerformanceAssuranceNodeandAdHocTesting– QoS /QueuingSupport– OpenAccesstopeering– TimelinessofServiceSupportandServiceDelivery

GXPExpectations#3• TechnologyandFunctionality

– TosupportthenetworkservicesrequiredbytheGNAmorethanjustlayer2best-effort– Layer2circuits

• SupportVLANtranslation• SupportGuaranteedBandwidthallocation• PolicerandShapersonperVLANandsetofVLANsbasis• TrafficBurstallowed• QinQ capabilities

– Supportpathprotectionandrestoration– DynamicCircuitProvisioning

• Supportdynamiccircuitprovisioningusingastandardizedprovisioningprotocol,e.g.NSI

– PolicyImplementation• GNAwillconsistoflinksprovidedbydifferentparticipants.Itisexpectedthatexchange

pointswillbeabletoimplementandenforcedifferentpoliciesoneachlinkasrequestedbythelinkowner.

• TheexchangepointsshouldbeabletoactasbothPolicyDecisionPoint(PDP)andPolicyEnforcementPoint(PEP)toenforceadmissionandusercontrolasdictatedbyconnectedorganizationpolicy.

InternetExchangePoint(IXP)

• DifferencesfromOXP– Internetfocused– Inter-ASinterconnectionswithBGP4– BigIXVLAN(BroadcastDomain)forpublicpeeringwithstrictcontrol

• PortSecurity– SingleMAC/IPv4/IPv6per“port”

– BLPA&MLPAviaRouteServers– Mostlylayer-2besteffort

WhatisHKIX?• HongKongInterneteXchange(HKIX) isthemainlayer-2InternetExchangePoint(IXP)inHKwherevariousautonomoussystemscaninterconnectwithoneanotherandexchangetraffic

• HKIXwasaprojectinitiatedbyITSC(InformationTechnologyServicesCentre)ofCUHK(TheChineseUniversityofHongKong) andsupportedbyCUHKinApr1995 asacommunityservice

• HKIXservesbothcommercialnetworksandR&Enetworks

• Theoriginalgoalistokeepintra-HongKong trafficwithinHongKong

21st AnniversaryofHKIX

• HKIXstartedwiththincoaxialcablesinApr1995

• Participantshadtoputco-locatedroutersatHKIXsitesinordertoconnect

• Itwasafreeservice

• HKIXstartedveryearly,wellbeforeincumbenttelcos startedtodoISPbusiness,sothatiswhyHKIXcanbesuccessful

ISP DISP A ISP B ISP C

Routes of ISP A

Routes of All ISPs in HKIX

Routes of ISP B

Routes of ISP C

Routes of ISP D

Routes of All ISPs in HKIX

Routes of All ISPs in HKIX

Routes of All ISPs in HKIX

MLPARoute

Servers

Routes of All ISPs in HKIX

Routes from All ISPs Switched Ethernet

HKIXModel—MLPAoverLayer2+BLPA

• MLPA (mandatory only for HK routes) traffic exchanged directly over layer 2 without going through MLPA Route Server

• BLPA over layer 2 without involvement of MLPA Route Server

• Supports both IPv4 and IPv6 over the same layer 2 infrastructure

HKIXToday• theHongKongInterneteXchange Ltd

– 100%ownedbyCUHK– Chargeableservicesbutnotreallyforprofit

• SupportsbothMLPA(MultilateralPeering)andBLPA(BilateralPeering)overlayer2

• SupportsIPv4/IPv6dual-stack• Moreandmorenon-HKparticipants• 241 autonomoussystemsconnected• 463 connectionsintotal

– 257 x10GE & 206 xGE– Afew100GEconnectionsarecoming

• 630+Gbps(5-min)totaltrafficatpeak• AnnualTrafficGrowth=30+%

YearlyTrafficStatistics

• AllowparticipantstoconnecttoHKIXmoreeasilyatlowercost fromthosesatellitesitesinHongKong

• OpentocommercialdatacentresinHKwhichfulfilminimumrequirementssoastomaintainneutralitywhichisthekeysuccessfactorofHKIX

• Intendtocreatewin-winsituationwithsatellitesitecollaborators

• TobenamedHKIX2/3/4/5/6/etc– HKIX2alreadyconfirmed- beingmigratedfromoldarchitectureto

newarchitecture

• HKIX1andHKIX1b(thetwoHKIXcoresiteslocatedwithinCUHKCampus)willcontinuetoserveparticipantsdirectly

SettingupMultipleHKIXSatelliteSites

R&ENetworksHavingPresenceinHK

• APAN-JP/JGN-X• ASCC-ASNET• ASGC• ASTI-PREGINET• CERNET/CERNET2• CSTNET• JUCC-HARNET• KISTI-KREONET2• NIA-KOREN• NUS• TEIN4

• MostoftheseR&EnetworkshavenetworkpresenceatMEGA-iAdvantage (MEGA-i)Building(butondifferentfloors)

• MostareconnectedtoHKIX-R&EatMEGA-i– HKIX-R&EisaspecialnodeofHKIX(www.hkix.net) whichservesR&Enetworksonlyandconnects

toHKIXcoreswitcheswith2x10GEcircuits

HKIX-R&E−SpecialSupportforR&ENetworksHavingPresenceinHK

• HKIXhelpsthoseR&ENetworkstointerconnectwithcommercialnetworks withoutrestrictionsviaHKIX-R&EswitchatMEGA-i

• SupportGE/10GETrunkPortsforR&ENetworksonly• Supportspecialpoint-to-pointVLANsforR&ENetworksonly

– Forprivateinterconnectionsamongany2R&Enetworks– JumboFramesupport

• Offercolo atnewHKIX1bsiteinsideCUHKCampus– Upto2racksperR&Enetwork

• DiscountedMRC– NoMRCforfibercross-connects– BasicRemoteHands&Eyesincluded– Thisofferalwaysstands

HKIX-R&ESwitchatMEGA-i

Utilizationofthe2x10GELinks

PossibleGuam-HK10G/100GCircuitTerminationPoint

• TobefundedbyNSFofUS:Confirmed?Timeline?• Ifgoahead,whereisthebestterminationpointinHK?

– BesttoterminateitatthepossibleHKOXP

• BesttohaveallR&Enetworksco-locatedinthesameroomwithlong-termcontractforeasiestinterconnectionsandsustainabledevelopment– Currently,individualR&EnetworksatMEGA-i needtorelocatefromonefloor

toanotherwithinMEGA-i onceevery2to3yearsduetochangeofsupplier– Layingfibercross-connectsacrossfloorswithinMEGA-i canbedifficult

sometimes• Twomainoptionswereidentified,butthereareotheroptions:

– MEGA-i• Colo,PowerandCross-Connectsareexpensive• BesttomovetothesameroomonthesamefloorinsideMEGA-i

– AlreadyconfirmedwithiAdvantage thatthisisfeasible,subjecttocommercialagreement

– CUHK/HKIX1b• Backhaulforinternationalcircuitsmaybemoreexpensive

ThingstoDetermine• DoweneedOpenExchangePointinHongKong(HKOXP)?Whotosetup

andoperateit?– IfHKhasaGlobalOpenExchangePoint(GXP),itcanbenefitmostpartofR&E

community• NotethatalotofR&EnetworkshavealreadychosentohavenetworkpresenceinHongKong

– JUCC/HARNET iswillingtocontributebyprovidingandoperatingtheswitchneededforGXP

• Mustsupport100G• MaygraduallytakeovertheexistingroleofHKIX-R&Enode(theleftpart)

• Whereshouldbethelocationofthesharedcolo spaceinHongKongforallR&EnetworkshavingpresenceinHK?

– MEGA-i?– CUHK/HKIX1b?– Othercommercialdatacenteroptions?

• BetterbeHKIXSatelliteSites

– Betterbelong-termandcost-effectivebutNOTverycriticalthough

TheDecisionProcess?

• Toomanystakeholdersinvolved• Differentstakeholdershavedifferentrestrictions• WillallR&Enetworksfollow?

– Relocatetheirequipmenttonewlocation?– TerminatetheirexistinginternationalcircuitstothenewHKOXPswitch?

• ForsharingamongallR&Enetworks

• Willexistinglayer-3networks(suchasTEIN)becomeoverlaynetworks?

• ItisNOTeasy…

HKOXPForumonAug3(Wed)• Healthydiscussionondifferentoptions• SomestakeholdersstillprefertostayatMEGA-i• “RoughConsensus”wastomaintainthestatusquoandtodo

regularreviewatthefutureAPANmeetings,whiletheset-upforHKOXPandtheestablishmentofGuam-HKcircuitarebeingdetermined

• Statusquoisagoodstartingpointasthingsareworkingfornow• Evolution,notrevolution

• Alsoreceivedfurthercommentsfromotherstakeholdersafter theForum– SomeprefertohaveeverybodyinthesameroominsideMEGA-i– SomeprefertomoveawayfromMEGA-i

• Morecommentsarewelcome

AnyQuestions/Comments/Suggestions?