symbiotic routing in future data center 工科三 陳泰穎. outline 1. camcube 1. traditional data...
TRANSCRIPT
SYMBIOTIC ROUTING IN FUTURE DATA CENTER
工科三 陳泰穎
Outline
1. CamCube1. Traditional data center2. The problems3. CamCube philosophy4. Feature5. What’s different?
2. Symbiotic Routing1. Service
1. TCP/IP2. VM distribution service3. Cache service4. Aggregation service
2. Properties3. Conclusion
1. CamCube – the Goal
Design a data center from the perspective of a distributed systems builder
1.1 Traditional Data Center
Distributed system philosophy vs. reality
1.2 The Problems ( of the traditional data
center)
Addressing Bandwidth Server has little or no control over
network
1.3 ComCube Philosophy
No Swiches Topology: 3D Torus
1.3 CamCube Philosophy – why? The CamCube API
(x,y,z) coordinate Coordinate easily remapped
in case of failure 1-hop API (send/recv from
1-hop neighbors)
1.4 feature
Two types of networks: Dierect-connect for intra-server traffic Switched network for inter-camcube traffic
Multiple independent network can be used
What’s different?
High Performance Computing CamCube make topology explicit Service can intercept(modify) packet on path Failure resilience Multiple independent service
Distributed System Key-space naturally mapped physically
Networking No switches/routers (symmetry of role) Not using TCP/IP
2. Symbiotic Routing
Symbiotic Routing is coupled with CamCube because: Each server link to other server closer Each server plays a role of switch/router too Each server share the resourse
(memory/FS)
2.1 TCP/IP Service
Required to implement TCP/IP for existing service
CamCube use its own method to enhance performance
2.2 VM distribution Service
Traditional: may create high number of interior server and edges (of tree of file system) than necessary.
New approach with CamCube: Use its topology feature. The custom routing protocol is
hierarchical, recursively dividing the coordinate space into 3D mini-cubes.
2.3 Cache service
Traditional remote cache Here Llcal cache
Not local cache
2.4 Aggregation
Don’t have to do traverse Use 3D topology feature (ex. X->y->z)
2.5 Properties
Key to server mapping Path specification (x,y,z) Fault-tolerance Multipath Packet buffers Prioritization
3. Conclusion
Symbiotic Routing is coupled with CamCube-like Infrastructure
This routing method provide flexible implement of service (protocol)
Support in-network packet processing CamCube + API(this routing method) =
easy-built data center
Comment
Challenge If service goes inner the CamCube, chances
may be multi-hop network. Beyond network efficiency, what’s else
can we benefit from CamCube ? High level switch/router is costly The energy saves by remove switch/router
Make better use of energy consumption in computation
Thank you