A Portal Based Approach to A Portal Based Approach to Viewing Aggregated Network Viewing Aggregated Network

Performance Data in Distributed Performance Data in Distributed Brokering SystemsBrokering Systems

ByBy

Gurhan Gunduz, Shrideep Pallickara, Geoffrey FoxGurhan Gunduz, Shrideep Pallickara, Geoffrey Fox

Syracuse University, Syracuse University,

Indiana University, Community Grid LabsIndiana University, Community Grid Labs

ggunduz, spallick, gcf@indiana.eduggunduz, spallick, gcf@indiana.edu

IC 2003 IC 2003

LAS VEGAS, NV, USALAS VEGAS, NV, USA

IntroductionIntroduction

More applications, services and More applications, services and frameworks becoming network centric.frameworks becoming network centric.

Network performance is important.Network performance is important.

Efforts on network measurementEfforts on network measurement

IP provider Metrics(subgroup of IETF’s IP provider Metrics(subgroup of IETF’s Bench Marking Working Group)Bench Marking Working Group)

CADIA(Cooperative Association for CADIA(Cooperative Association for Internet Analysis Data)Internet Analysis Data)

NWS(Network Weather System)NWS(Network Weather System)

NaradaBrokeringNaradaBrokering

Distributed event brokering system designed to Distributed event brokering system designed to run on a large network of cooperating broker run on a large network of cooperating broker nodes.nodes.Broker nodes are organized in a cluster-based Broker nodes are organized in a cluster-based architecture which allows the system to support architecture which allows the system to support large heterogeneous client configurations. large heterogeneous client configurations. Communication in NaradaBrokering is Communication in NaradaBrokering is asynchronous. asynchronous. NaradaBrokering provides support for JMS, P2P NaradaBrokering provides support for JMS, P2P interactions, audio-video conferencing while interactions, audio-video conferencing while supporting communication through firewalls and supporting communication through firewalls and proxiesproxies

NaradaBrokering Transport NaradaBrokering Transport FrameworkFramework

Transport framework aims to abstract the Transport framework aims to abstract the operations that need to be supported for operations that need to be supported for enabling efficient communications between enabling efficient communications between nodes. TCP, UDP, SSL, RTP and HTTP.nodes. TCP, UDP, SSL, RTP and HTTP.

Operations that need to be supported between Operations that need to be supported between two communication endpoints are encapsulated two communication endpoints are encapsulated within the “link” primitive.within the “link” primitive.

A Link is an abstraction that hides details A Link is an abstraction that hides details pertaining to communications between 2 pertaining to communications between 2 communicating entities.communicating entities.

Link and Performance Link and Performance MeasurementMeasurement

Can expose and measure a set of performance Can expose and measure a set of performance factors.factors.

Cooperation from the other end-point of the Cooperation from the other end-point of the communication link.communication link.

Echo behaviorEcho behavior

Can measure round trip delays, jitter, bandwidth, Can measure round trip delays, jitter, bandwidth, loss rates, etc.loss rates, etc.

Links can enable/disable the measurement of all Links can enable/disable the measurement of all performance factors or a specific factor.performance factors or a specific factor.

Accumulating performance metrics Accumulating performance metrics for a nodefor a node

Every broker incorporates a Monitoring Every broker incorporates a Monitoring Service(MS).Service(MS).

Transport Controller of a node maintains Transport Controller of a node maintains the list of the linksthe list of the links

MS cycles through the links and retrieve MS cycles through the links and retrieve performance information.performance information.

MS controls frequency of metric MS controls frequency of metric measurements.measurements.

Aggregating performance metrics Aggregating performance metrics from multiple nodesfrom multiple nodes

MS report performance data to a MS report performance data to a Performance Aggregation Service(PAS).Performance Aggregation Service(PAS).

PAS exchanges information with MS.PAS exchanges information with MS.

PAS can give simple commands to MS.PAS can give simple commands to MS.

PASs can exchange information with each PASs can exchange information with each otherother

Encapsulating performance dataEncapsulating performance data

MS encapsulates performance data in an MS encapsulates performance data in an XML format.XML format.

Why XML;Why XML; Easy access to relevant fields in the Easy access to relevant fields in the

performance data.performance data. Description capability of the content provides Description capability of the content provides

intelligent data mining.intelligent data mining. XPATH queriesXPATH queries

PASPAS

BrokerNode

LinkData

BrokerNode

LinkData

Performance AggregationService

Control MessageExchange

Aggregates infofrom nodes in acertain domain

MonitoringService

Multiple PASMultiple PAS

PAS

Control MessageExchange

Aggregates infofrom nodes in acertain domain

MonitoringService

PAS

PAS

PAS

BrokerNode

Aggregating performance metrics Aggregating performance metrics from multiple nodesfrom multiple nodes

Aggregated data is saved in a databaseAggregated data is saved in a database

Currently flat file Currently flat file

We plan using light weight XML database We plan using light weight XML database for this purpose.for this purpose. Apache XindiceApache Xindice SourceForge exist SourceForge exist

Accumulation of data in a portalAccumulation of data in a portal

Information accumulated within Information accumulated within Aggregators is accessible from a portalAggregators is accessible from a portal

Apache Jetspeed is used as a portal Apache Jetspeed is used as a portal environment.environment.

Portal viewPortal view

Accumulation of data in a portal IIAccumulation of data in a portal II

Portals can display multiple HTMLPortals can display multiple HTMLCan collect content from disparate remote Can collect content from disparate remote sources.sources.Can facilitate customized user groups. Can facilitate customized user groups. Restrictive user view using customized view Restrictive user view using customized view capability of a portalcapability of a portalPortlets, a specialized module, Java servlet Portlets, a specialized module, Java servlet which operates in a portal, is used to view which operates in a portal, is used to view accumulated performance data within the accumulated performance data within the aggregators.aggregators.

Accumulation of data in a portal IIIAccumulation of data in a portal III

XSLT portlet is used to view aggregated XSLT portlet is used to view aggregated performance data.performance data.

XSLT portlet converts a given XML file into XSLT portlet converts a given XML file into HTML using the given XSL style sheet.HTML using the given XSL style sheet.

Accumulation of data in a portal IVAccumulation of data in a portal IV

Two ways for customized user viewTwo ways for customized user view

Having separate database file for each user Having separate database file for each user groupgroup

Let portlet select it from one database fileLet portlet select it from one database file

Detecting conditionsDetecting conditions

Evaluate constraints in the aggregation node. Evaluate constraints in the aggregation node. Adv?Adv?

Use XPATH to query our database.Use XPATH to query our database.

Check metrics for thresholdsCheck metrics for thresholds

Inform nodes to take actions to correct situationInform nodes to take actions to correct situation

Future WorkFuture Work

Trade-offs of using flat files versus light-Trade-offs of using flat files versus light-weight databases.weight databases.

Identify, circumvent, project and prevent Identify, circumvent, project and prevent system bottlenecks.system bottlenecks.

Aid routing algorithms.Aid routing algorithms.