scalable and extensible network monitoring for scalable and extensible network monitoring for geni...
TRANSCRIPT
Scalable and Extensible Network Monitoring For GENI
http://illusion.hpl.hp.com/genis3monitor
Sonia Fahmy(Purdue University)Puneet Sharma (HP Labs)
2
RECAP: Scalable Sensing Service (S3)
• Sensor pods−Measure system state from a node perspective−Web-Service enabled collection of sensors
• Sensing information manager−Controls pods, and aggregates measured system
state−Portal to request and invoke measurements
• Inference engines−Infer O(n2) E2E path info by measuring a few paths−Dynamically schedules measurements on pods
3
Sensor Pod
Secu
re W
eb
Inte
rface
Controller
Latency
Loss
Bandwidth
Load
Capacity
MemoryRepository
Configuration& Data
API: query, control, and notification
Web-Service (WS) enabled collection of sensors
Sensor Pod
Secu
re W
eb
Inte
rface
Controller
Latency
LossrateBandwidth
Load
Capacity
MemoryRepository
Configuration& Data
API: query, control, and notification
Web-Service (WS) enabled collection of sensors
Secure Web Interface:
• Standard communication protocols
• Flexible interface
Basic Measurement Invocation• Invocation node
http://pc150.emulab.net:46000/cgi-bin/csi.cgi?
• Tool/Sensor to be invokedhttp://pc150.emulab.net:46000/cgi-bin/csi.cgi?COMMAND=PATHCHIRP
• Sensor Parametershttp://pc150.emulab.net:46000/cgi-bin/csi.cgi?COMMAND=PATHCHIRP&DEST=10.10.1.2&PORT=8366
• Examplehttp://pc150.emulab.net:46000/cgi-bin/csi.cgi?COMMAND=PING&DEST=10.10.1.2
5
Sensor Pod
Secu
re W
eb
Inte
rface
Controller
Latency
LossrateBandwidth
Load
Capacity
MemoryRepository
Configuration& Data
API: query, control, and notification
Web-Service (WS) enabled collection of sensors
Archive measurement data for sharing
Store sensor invocation configurations
Sensor Pod
Secu
re W
eb
Inte
rface
Controller
Latency
LossrateBandwidth
Load
Capacity
MemoryRepository
Configuration& Data
API: query, control, and notification
Web-Service (WS) enabled collection of sensors
Process requests, invoke sensors according to installed configurations
8
Sensing Information Manager
−Control the sensor-pods−Aggregate data from sensor−Answer researcher queries
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terfac
e
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Sensing Information Manager/Portal
Chaining Sensor Pods• Tools that need to be started at both ends
simultaneously−Capacity
• Pathrate
−Available BW• PathChirp• Spruce
Secu
re W
eb In
terface
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terface
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terface
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Secu
re W
eb In
terface
Controller
Latency
Lossrate
Bandwidth
Load
Capacity
Memory
Repository
Configuration& Data
API: query, control, and notification
Node A
Node B
Measure CAP(AB)
CAP(B)1) Start CAP_SEND
2) Start CAP_RCV at B
3) Measure
Start CAP_RCV
Host Landmark Router (Milestone)
d1d2…dn
d1d2…dn
d1d2…dn
d1d2…dn
d1d2…dn
Use landmark vectors for local clustering
Leverage Route Informationtraceroute to landmarks
Landmark
Vector
Complex Sensors: E.g. Netvigator
Complex Sensors: E.g. Netvigator• For each node invoke traceroute to each
landmark
http://nodei
:46000/cgi-bin/csi.cgi?COMMAND=TRACEROUTE&DEST=LM1
http://nodei
:46000/cgi-bin/csi.cgi?COMMAND=TRACEROUTE&DEST=LM2
http://nodei:46000/cgi-bin/csi.cgi?COMMAND=TRACEROUTE&DEST=LM3...
• Extract vectors and run clustering algorithm
11
Related Extensions• Security/Access Control• Semantic Data Store
12
Scalable Access Control“Scalable Access Control ForWeb Services”, Gayatri Swamynathan, Tyler Close, Sujata Banerjee, Rick McGeer, Fifth International Conference on Creating, Connecting and Collaborating through Computing (C5), Kyoto, Japan, January 2007
• Capabilities based URL-Rewriter Service
13
Semantic Data Store
“Temporal Views over RDF Store”, Geetha Manjunath, Badrinath Ramamurthy, Craig Sayers, Venugopal KS, WWW'2008, Beijing , April 2008
• Convert the measurement results into RDF store
• Create temporal views to maintain liveness of data
• SPARQL queries on the RDF store
14
15
Example View Specification
16
