2016 summer internship - uc davis: networks...

8
2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7 th , 2016 NetLab Friday Group Meeting (all info in this presentation is publicly available) 10/7/16 1

Upload: others

Post on 27-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

2016 SUMMER INTERNSHIP @ Rafael LourençoOctober 7th, 2016NetLab Friday Group Meeting(all info in this presentation is publicly available)

10/7/161

Page 2: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

10/7/162

(...)

• Some products are handled by the same organizational structure (aka team)

• Each team mighthave its own developers, managers, commercial people, etc...

Page 3: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

Google Platforms• Most teams within the Platforms group exist to serve other product

teams in Google, e.g.:• Infrastructure software: Borg, MapReduce, GFS, FlumeJava,

BigTable, etc...• Infrastructure hardware: Servers, Racks, Cooling systems,

Chips (TCUs), etc...• Networking hardware and software• Operations

10/7/163

Page 4: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

Google Platforms and other TeamsEx: Google Search Autocomplete

10/7/164

ToimplementAutocomplete

functionality,GoogleSearchTeamneeds

lowlatency

DelegatesconstructionofnewDatacenters

GooglePlatformsdeploysnew

Datacenters:design(”manufacture”)servers,networkconfiguration,operation,etc.

Page 5: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

The Datacenter as a Computer

10/7/165

B4

B2

DC

DC

DC

ISP1

ISP2

EventuallytoB4andB2

Jupiter

SuperBlock

SpineBlocks

SuperBlock

Page 6: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

SDN @Google• SDN implementation started several years ago: already a well

established technology• B4 and Jupiter: fully SDN• Each domain has its control plane, each control plane has several

pieces of specialized software

10/7/166

Page 7: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

My Internship ProjectDeveloped a tool to perform a time-continuous assessment ofGoogle's Software Defined Networks. This tool checked how differentnetwork properties evolved in a timeline. This computational-intensivetask was distributed across several machines using Flume, a Google library that creates highly efficient parallel data-processing pipelines.

10/7/167

Page 8: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016  · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,

Next Challenges• General:

Ø Run the networks as hot as possibleØ Make latency as small as possible

• Specific – Colorless, Directionless, Contention-less ROADMs:Ø How to coordinate L2 and L3 restoration? (Should repair be

made on L3 or L2?)Ø What is the availability improvement of CDC? Capacity

utilization improvement? How much cheaper?Ø Demand forecast unpredictable: what is a good buffer

strategy for capacity allocation?10/7/168