particle swarm optimization (pso) pso is a robust stochastic optimization technique based on the...
TRANSCRIPT
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)• PSO is a robust stochastic optimization technique based on
the movement and intelligence of swarms.
• PSO applies the concept of social interaction to problem solving.
• It was developed in 1995 by James Kennedy (social-psychologist) and Russell Eberhart (electrical engineer).
• It uses a number of agents (particles) that constitute a swarm moving around in the search space looking for the best solution.
• Each particle is treated as a point in a N-dimensional space which adjusts its “flying” according to its own flying experience as well as the flying experience of other particles.
• Each particle keeps track of its coordinates in the solution space which are associated with the best solution (fitness) that has achieved so far by that particle. This value is called personal best , pbest.
• Another best value that is tracked by the PSO is the best value obtained so far by any particle in the neighborhood of that particle. This value is called gbest.
• The basic concept of PSO lies in accelerating each particle toward its pbest and the gbest locations, with a random weighted accelaration at each time step as shown in Fig.1
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)
Fig.1 Concept of modification of a searching point by PSO
sk : current searching point. sk+1: modified searching point. vk: current velocity. vk+1: modified velocity. vpbest : velocity based on pbest. vgbest : velocity based on gbest
sk
vk
vpbest
vgbest
sk+1
vk+1
sk
vk
vpbest
vgbest
sk+1
vk+1
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)
x
y
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)• Each particle tries to modify its position using the following
information: the current positions,
the current velocities,
the distance between the current position and pbest,
the distance between the current position and the gbest.
• The modification of the particle’s position can be mathematically
modeled according the following equation :
Vik+1 = wVi
k +c1 rand1(…) x (pbesti-sik) + c2 rand2(…) x (gbest-si
k) ….. (1)
where, vik : velocity of agent i at iteration k,
w: weighting function, cj : weighting factor, rand : uniformly distributed random number
between 0 and 1, sik : current position of agent i at
iteration k, pbesti : pbest of agent i, gbest: gbest of the group.
The following weighting function is usually utilized in (1)
w = wMax-[(wMax-wMin) x iter]/maxIter (2)
where wMax= initial weight,
wMin = final weight,
maxIter = maximum iteration number,
iter = current iteration number.
sik+1 = si
k + Vik+1 (3)
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)
Comments on the Inertial weight factor:Comments on the Inertial weight factor: A large inertia weight (A large inertia weight (ww) facilitates a global search while ) facilitates a global search while
a small inertia weight facilitates a local search.a small inertia weight facilitates a local search.
By linearly decreasing the inertia weight from a relatively By linearly decreasing the inertia weight from a relatively large value to a small value through the course of the large value to a small value through the course of the PSO run gives the best PSO performance compared PSO run gives the best PSO performance compared with fixed inertia weight settings.with fixed inertia weight settings.
Larger w ----------- greater global search abilityLarger w ----------- greater global search abilitySmaller w ------------ greater local search ability.Smaller w ------------ greater local search ability.
Particle Swarm Optimization Particle Swarm Optimization (PSO)(PSO)
Particle Swarm Optimization (PSO)Particle Swarm Optimization (PSO)Flow chart depicting the General PSO Algorithm:
Start
Initialize particles with random position and velocity vectors.
For each particle’s position (p) evaluate fitness
If fitness(p) better than fitness(pbest) then pbest= pL
oop
un
til a
ll
par
ticl
es e
xhau
st
Set best of pBests as gBest
Update particles velocity (eq. 1) and position (eq. 3)
Loop
unt
il m
ax it
er
Stop: giving gBest, optimal solution.
Comparison with other evolutionary Comparison with other evolutionary computation techniques.computation techniques.
• Unlike in genetic algorithms, evolutionary programming and evolutionary strategies, in PSO, there is no selection operation.
• All particles in PSO are kept as members of the population through the course of the run
• PSO is the only algorithm that does not implement the survival of the fittest.
• No crossover operation in PSO.
• eq 1(b) resembles mutation in EP.
• In EP balance between the global and local search can be adjusted through the strategy parameter while in PSO the balance is
achieved through the inertial weight factor (w) of eq. 1(a)
Variants of PSOVariants of PSO
• Discrete PSO ……………… can handle discrete binary variables
• MINLP PSO………… can handle both discrete binary and continuous variables.
• Hybrid PSO…………. Utilizes basic mechanism of PSO and the natural selection mechanism, which is usually
utilized by EC methods such as GAs.
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LI→CP conversion
Intialization parameters used for PSO:
wMax=0.41
wMin=0.4
(Note:The inertial weight ,w is linearly decreased from wMax to wMin according the Eq. (2), w is chosen virtually constant in this case for better
local search near the Sun’s Optimized parameters. )
c1=c2=1.49
maxIter=2000
The above parameters are used in conjuction with eqs.(1) & (2)
Swarm size/Population size used for solution search : 25
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LI→CP conversion
Frequency band of interest: 3.5 to 6.5 (GHz)
(evaluated at 12 frequency points)
Desired VSWR <= 1.2
Desired AR <= 0.5 (dB)
Total number of fitness evaluations: 100025
Note: For my implementation of the PSO the number of fiteness evaluations are calculated as follows: (2 x swarmsize x maxIter)+ swarmsize = (2 x 25 x 2000)+ 25
The following slides include the results for the broadband case.
Mean best & Best fitness over 50 runs
VSWR
Axial Ratio (dB)
4 Layers for CP
SpacerSpacer
(inches)(inches)
lloioi
dielectric dielectric (inches)(inches)
llii
Line WidthLine Width
(inches)(inches)
ww11 w w22
HeightHeight
(inches)(inches)
hh
PeriodPeriod
(inches)(inches)
bb
PitchPitch
(inches)(inches)
aaLayerLayer
--------8.4705018E-8.4705018E-0303
1.5984001E-1.5984001E-0202
2.2501351E2.2501351E-02-020.25205650.25205650.72833820.72833820.34493600.344936044
0.54281280.54281283.4676325E-3.4676325E-0303
9.4296653E-9.4296653E-0303
5.3999661E5.3999661E-03-030.47074200.47074200.87043980.87043980.37984690.379846933
0.42118450.42118453.4676325E-3.4676325E-0303
9.4296653E-9.4296653E-0303
5.3999661E5.3999661E-03-030.47074200.47074200.87043980.87043980.37984690.379846922
0.54281280.54281288.4705018E8.4705018E-03-03
1.5984001E1.5984001E-02-02
2.2501351E2.2501351E-02-020.25205650.25205650.72833820.72833820.34493600.344936011
DielectricSheet
MetalLayer
Spacer
55.2i 15.1i0 Dielectric constants:
Optimized dimensions for 4-layer Meander Line Polarizer
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LI→CP conversion
Frequency bands of interest:
Band1: 3.7 to 4.2 (GHz)
Band2: 5.9 to 6.4 (GHz)
(evaluated at 2 frequency points: 3.95 (GHz), 6.15 (GHz))
Desired VSWR <= 1.2
Desired AR <= 0.5 (dB)
Total number of fitness evaluations: 100025
The following slides include the results for the dualband case.
Mean best & Best fitness over 50 runs
VSWR
Axial Ratio (dB)
4 Layers for CP
SpacerSpacer
(inches)(inches)
lloioi
dielectric dielectric (inches)(inches)
llii
Line WidthLine Width
(inches)(inches)
ww11 w w22
HeightHeight
(inches)(inches)
hh
PeriodPeriod
(inches)(inches)
bb
PitchPitch
(inches)(inches)
aaLayerLayer
--------4.1147252E-4.1147252E-0303
2.7704202E-2.7704202E-0202
4.0456183E4.0456183E-02-020.24801430.24801430.80816690.80816690.25289130.252891344
0.45338230.45338233.9593712E-3.9593712E-0303
4.4981677E-4.4981677E-0202
5.0358579E5.0358579E-02-020.34337220.34337220.95296580.95296580.54257240.542572433
0.44821950.44821953.9593712E-3.9593712E-0303
4.4981677E-4.4981677E-0202
5.0358579E5.0358579E-02-020.34337220.34337220.95296580.95296580.54257240.542572422
0.45338230.45338234.1147252E4.1147252E-03-03
2.7704202E2.7704202E-02-02
4.0456183E4.0456183E-02-020.24801430.24801430.80816690.80816690.25289130.252891311
DielectricSheet
MetalLayer
Spacer
55.2i 15.1i0 Dielectric constants:
Optimized dimensions for 4-layer Meander Line Polarizer
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LP rotation
Intialization parameters used for PSO:
wMax=0.41
wMin=0.4
(Note:The inertial weight ,w is linearly decreased from wMax to wMin according the Eq. (2), w is chosen virtually constant in this case for better
local search near the Sun’s Optimized parameters.)
c1=c2=1.3
maxIter=1000
The above parameters are used in conjuction with eqs.(1) & (2)
Swarm size/Population size used for solution search : 25
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LP rotation
Frequency band of interest: 3.5 to 6.5 (GHz)
(evaluated at 12 frequency points)
Desired VSWR <= 1.2
Phase Difference around 180°
Total number of fitness evaluations: 50025
The following slides include the results for the broadband case.
Mean best & Best fitness over 15 runs
VSWR
Axial Ratio (dB)
Phase Difference
8 Layers for LP
SpacerSpacer
(inches)(inches)
lloioi
dielectric dielectric (inches)(inches)
llii
Line WidthLine Width
(inches)(inches)
ww11 w w22
HeightHeight
(inches)(inches)
hh
PeriodPeriod
(inches)(inches)
bb
PitchPitch
(inches)(inches)
aaLayerLayer
--------2.1623570E-2.1623570E-0202
3.0709708E-3.0709708E-0202
2.8606838E2.8606838E-02-020.21480450.21480451.0206001.0206000.36318780.36318784, 84, 8
0.45507970.45507974.0660784E-4.0660784E-0202
3.4942929E-3.4942929E-0202
4.1542474E4.1542474E-02-020.43749990.43749990.82257650.82257650.38481700.38481703, 73, 7
0.39594680.39594684.0660784E-4.0660784E-0202
3.4942929E-3.4942929E-0202
4.1542474E4.1542474E-02-020.43749990.43749990.82257650.82257650.38481700.38481702, 62, 6
0.45507970.45507972.1623570E2.1623570E-02-02
3.0709708E3.0709708E-02-02
2.8606838E2.8606838E-02-020.21480450.21480451.0206001.0206000.36318780.36318781, 51, 5
DielectricSheet
MetalLayer
Spacer
55.2i 15.1i0 Dielectric constants:
Optimized dimensions for 8-layer Meander Line Polarizer
Application of PSO ALGORITHM to Optimize a Meander-line Polarizer for LP rotation
Frequency bands of interest:
Band1: 3.7 to 4.2 (GHz)
Band2: 5.9 to 6.4 (GHz)
(evaluated at 2 frequency points: 3.95 (GHz), 6.15 (GHz))
Desired VSWR <= 1.2
Phase Difference around 180°
Total number of fitness evaluations: 50025
The following slides include the results for the dualband case.
Mean best & Best fitness over 15 runs
VSWR
Axial Ratio (dB)
Phase Difference
8 Layers for LP
SpacerSpacer
(inches)(inches)
lloioi
dielectric dielectric (inches)(inches)
llii
Line WidthLine Width
(inches)(inches)
ww11 w w22
HeightHeight
(inches)(inches)
hh
PeriodPeriod
(inches)(inches)
bb
PitchPitch
(inches)(inches)
aaLayerLayer
--------2.2299249E-2.2299249E-0202
3.2010745E-3.2010745E-0202
3.3202391E3.3202391E-02-020.27475690.27475691.0555961.0555960.31508690.31508694, 84, 8
0.35447250.35447253.1127717E-3.1127717E-02020.11262980.11262986.0811251E6.0811251E
-02-020.35656080.35656081.1645761.1645760.40858010.40858013, 73, 7
0.31593890.31593893.1127717E-3.1127717E-02020.11262980.11262986.0811251E6.0811251E
-02-020.35656080.35656081.1645761.1645760.40858010.40858012, 62, 6
0.35447250.35447252.2299249E2.2299249E-02-02
3.2010745E3.2010745E-02-02
3.3202391E3.3202391E-02-020.27475690.27475691.0555961.0555960.31508690.31508691, 51, 5
DielectricSheet
MetalLayer
Spacer
55.2i 15.1i0 Dielectric constants:
Optimized dimensions for 8-layer Meander Line Polarizer
END