ntu gice swarm intelligence for routing in communication networks speaker: shih-chun lin advisor:...
TRANSCRIPT
NTU GICE
Swarm Intelligence for Routing in Communication Networks
Speaker: Shih-Chun Lin
Advisor: Kwang-Cheng Chen
NTU GICE
Outline
Introduction Routing Algorithm Swarm Intelligence
- Swarm Intelligence Concept- Advantages- Example Algorithms
Swarm Intelligence Routing- Ant-Based Control (ABC)- AntNet- Multiple Round Trip Routing
Conclusion and Discussion Reference
2
NTU GICE
Outline
Introduction
Swarm Intelligence Swarm Intelligence Concept
Advantages
Swarm Intelligence RoutingAnt-Based Control (ABC)
AntNet
Multiple Round Trip Routing
Conclusion and Discussion
Reference
3
NTU GICE
Introduction
Communication network managements is becoming increasingly difficult due to • Increasing network size• Rapidly changing topology• Complexity
The need for seamless interaction of numerous heterogeneous network components represents a formidable challenge, especially for networks that have traditionally used centralized methods of network control. This is true for both packet-switched and virtual-circuit networks.
Routing algorithm in modern networks - Performance metric• Average throughput and delay• Quality of service (Qos) guarantee
- Classification • Centralized vs. distributed• Static vs. dynamic 4
NTU GICE
Introduction
Swarm intelligence utilizes • Mobile software agents• Stigmergy (i.e. communication through the environment)
Emergent behavior
Simple interactions of autonomous, with simple primitives, give rise to a complex behavior
5
NTU GICE
Outline
Introduction Routing Algorithm
Swarm IntelligenceSwarm Intelligence Concept
Advantages
Swarm Intelligence RoutingAnt-Based Control (ABC)
AntNet
Multiple Round Trip Routing
Conclusion and Discussion
Reference
6
NTU GICE
Routing Algorithm
Average throughput and delay - Centralized• Scalability• Inordinate demand for managing decisions requiring human attention• Inability of the network to recover in case of failure at the central controlling station
- Static• Network conditions are time-invariant• Does not assess the traffic load
- Adaptive• Inconsistencies arising from node failures • Potential oscillations that lead to circular paths and instability• Changes in the network occur too frequently to allow routing updates to propagate throughout
all network nodes.Combinatorially stable: if it changes sufficiently slowly for the routing updates to be
propagated to all the nodes
7
NTU GICE
Routing Algorithm
- Minimal vs. non-minimal • Minimal: only minimal cost paths
1) Optimal routing
2) Shortest-path routing
• Non-minimal: allows more flexibility in choosing the path by utilizing other heuristics
Qos guantee: pertaining to delay and bandwidth- Usually message based• Have the tendency to temporarily overuse network resources until they find the appropriate path
8
NTU GICE
Outline
Introduction
Swarm Intelligence - Swarm Intelligence Concept- Advantages- Example Algorithms
Swarm Intelligence RoutingAnt-Based Control (ABC)
AntNet
Multiple Round Trip Routing
Conclusion and Discussion
Reference
9
NTU GICE
Swarm Intelligence Concept
Swarm intelligence gives rise to complex and often intelligent behavior through complex interaction of thousands of autonomous swarm members.
The main principle behind these interactions:
Stigmergy or communication through the environment
Two examples for stigmergy - Pheromone laying on trails followed by ants • Autocatalytic reaction
- Task-related stigmergy: alters the environment as to promote further similar action by the agents
E.g. Sand grain laying by termites when constructing nests • Lay sand grains at random locations A single heap reaches a critical mass, then construct their
nest there
10
NTU GICE
Advantages
Swarm intelligence boasts a number of advantages due to the use of mobile agents and stigmergy.- Scalability• Population and interactions of the agents
- Fault tolerance• Graceful, scalable degradation other than catastrophic failure
- Adaptation• Change, die, or reproduce
- Speed• Changes in the network can be propagated very fast
- Modularity• Agents act independently of other network layers
- Autonomy• Little or no human supervision is required
- Parallelism• Agent’s operations are inherently parallel
11
NTU GICE
Example Algorithms [2]
Ant colony optimization (ACO): a class of optimization algorithms modeled on the actions of an ant colony- Useful in problems that need to find paths to goals• Artificial 'ants' - simulation agents - locate optimal solutions by moving through a parameter
space representing all possible solutions. • Real ants lay down pheromones directing each other to resources while exploring their
environment. • The simulated 'ants' similarly record their positions and the quality of their solutions, so that in
later simulation iterations more ants locate better solutions.
Particle swarm optimization (PSO): a global optimization algorithm for dealing with problems in which a best solution can be represented as a point or surface in an n-dimensional space- Advantage: the large number of members that make up the particle swarm make the
technique impressively resilient to the problem of local minima Stochastic diffusion search (SDS): an agent-based probabilistic global search
and optimization technique best suited to problems where the objective function can be decomposed into multiple independent partial-functions
12
NTU GICE
Outline
Introduction
Swarm Intelligence Swarm Intelligence Concept
Advantages
Swarm Intelligence Routing- Ant-Based Control (ABC)- AntNet- Multiple Round Trip Routing
Conclusion and Discussion
Reference
13
NTU GICE
Ant-Based Control (ABC) [3]
The algorithm is adaptive and exhibits robustness under various network conditions.
It’s accomplished by using agents, called ants, who deposit virtual pheromone on the trails they follow, which affects the routing tables of the affected nodes.
The probabilities of the routing tables are updated as the ant visits the nodes.- Life time of the ant at the time of the visit (T): • Delay (Di) :
- Step size for the visited node (δr): - The routing table is then updated according to:
14
1,1,
,,
11
1 11
ii si
i s
in si
n s
r t rr t
r
r t rr t n i
r
ii
T Dd S
iD c e a
r bT
NTU GICE
Ant-Based Control (ABC) [3]
The ant both uses and updates the routing table at the same time. - E.g. if the source is node F and the destination is node E, then the ant will update the
row for F and use the node for E to find the next hop• Update rules:
[1]
Cooperation of an exploration factor g
- With probability (1-g) the ants are forwarded with a total uniform distribution;
with probability g the ants are forwarded according to the routing table probabilities
15
, 1in s
n
r
NTU GICE
AntNet [4]
Routing is determined by means of very complex interactions of forward and backward network exploration agents (“ants”).- The idea behind this subdivision of the agents:
Allow the backward ants to utilize the useful information gathered by the forward ants on their trip from source to destination.
The entries of the routing table are probabilities, and as such, must sum to 1 for each row of the network. - These probabilities serve a dual purpose:
1) The exploration agents of the network use them to decide the next hop to a destination, randomly selecting among all candidates based on the routing table probabilities for a specific destination
2) The data packets deterministically select the path with the highest probability for the next hop
[1]
16
NTU GICE
AntNet [4]
The sequence of actions is simple and intuitive:1. Each network node launches forward ants to all destinations in regular time
intervals.
2. The ant finds a path to the destination randomly based on the current routing tables.
3. The forward ant creates a stack, pushing in trip times for every node as that node is reached.
4. When the destination is reached, the backward ant inherits the stack.
5. The backward ant pops the stack entries and follows the path in reverse.
6. The node tables of each visited node are updated based on the trip times.
[1]
17
NTU GICE
AntNet [4]
Except for the routing table, each node also possesses a table with records of the mean and variance of the trip to every destination.
[1]
From the trip time table to the routing table:A. Intermediate quantity in the processing of the raw trip time information (r’):
The ratio of the variance to the mean (σ /μ) is used as a measure of the consistency
of the trip times.
18
, 1 if 1'
1 otherwise
T Tc
c cr
NTU GICE
AntNet [4]
With the case where the consistence is high and the time is good, we want the
processed r’ to be even smaller.
B. Further positive or negative reinforcement of good or bad routes takes place next, via negative feedback.
[1]
C. Update the routing table probabilities.
The packets of the network then use these probabilities in a deterministic way, choosing as next hop the one with the highest probability.
19
df df
dn dn
P P r
P P r
1 ' 1
1 ' , ,
df
dn k
r r P
r r P n f n N
NTU GICE
Multiple Round Trip Routing [5]
The basic version utilizes the cost measured by the forward ants to update the routing table entries.A. As in AntNet, nodes launch forward ants in regular intervals.
B. The forward ant keeps track of the visited nodes in a stack Jk and of their associated cost dk
n,d.
C. Once the destination d is reached, then a backward ant is launched, which updates the distance estimation for node n to d via j as follows:
Routing table probabilities are updated via:
20
, , ,1 1n n kj d j d n dD t D t d
,
,
,
1
, 1
nj dn
j d
nl j d
D tp t j l
D t
NTU GICE
Multiple Round Trip Routing [5]
The interesting improvement is based on Bellman’s principle of dynamic programming.- Every node in the path Jk of a source-destination pair s-d, is considered a destination.
[1]
21
1 1 1 1 1, , ,1 1n n k
s s s s n sD t D t d
NTU GICE
Outline
Introduction
Swarm Intelligence Swarm Intelligence Concept
Advantages
Swarm Intelligence RoutingAnt-Based Control (ABC)
AntNet
Multiple Round Trip Routing
Conclusion and Discussion
Reference
22
NTU GICE
Conclusion and Discussion
AntNet and Multiple Trip Routing are two examples of the class of swarm intelligence algorithms that incorporate round-trip agents.- In this type of algorithms, the forward ants act as investigators and the backward ants
are the ones who update the routing tables. ABC is an algorithm that incorporates only forward agents, who perform the
update as they travel through the network. - In this type of algorithms update is faster and more reliable, since there is no delay
between the information gathering and the actual update.
23
NTU GICE
Outline
Introduction
Swarm Intelligence Swarm Intelligence Concept
Advantages
Swarm Intelligence RoutingAnt-Based Control (ABC)
AntNet
Multiple Round Trip Routing
Conclusion and Discussion
Reference
24
NTU GICE
Reference
1. I. Kassabalidis, M. A. El-Sharkawi, R. J. Marks II, P. Arabshahi, and A. A. Gray, “Swarm intelligence for routing in communication networks,” Global Telecommunications Conference, 2001. GLOBECOM ‘01. IEEE , vol.6, no., pp.3613-3617 vol.6, 2001.
2. http://en.wikipedia.org/wiki/Swarm_intelligence
3. R. Schoonderwoerd, O.E. Holland, J. Bruten, and L. Rothkrantz, “Ant-based load balancing in telecommunications networks,” HP Labs Technical Report, HPL-96-76, May 21, 1996.
4. G. Di Caro and M. Dorigo, “AntNet: a mobile agents approach to adaptive routing ,” Tech. Rep. IRIDIA/97-12, Université Libre de Bruxelles, Belgium.
5. M. Heusse, D. Snyers, S. Guérin, and P. Kuntz, “Adaptive agent-driven routing and load balancing in communication network,” Proc. ANTS'98, First International Workshop on Ant Colony Optimization, Brussels, Belgium, October 15-16, 1998.
25