1 ie 607 heuristic optimization particle swarm optimization
TRANSCRIPT
![Page 1: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/1.jpg)
1
IE 607 Heuristic Optimization
Particle Swarm Optimization
![Page 2: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/2.jpg)
2
• Developed by Jim Kennedy, Bureau of Labor Statistics, U.S. Department of Labor and Russ Eberhart, Purdue University
• A concept for optimizing nonlinear functions using particle swarm methodology
Origins and Inspiration from Natural Systems
![Page 3: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/3.jpg)
3
• Inspired by simulation social behavior
• Related to bird flocking, fish schooling and swarming theory
- steer toward the center
- match neighbors’ velocity
- avoid collisions
![Page 4: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/4.jpg)
4
• PSO algorithm is not only a tool for optimization, but also a tool for representing sociocognition of human and artificial agents, based on principles of social psychology.
• A PSO system combines local search methods with global search methods, attempting to balance exploration and exploitation.
![Page 5: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/5.jpg)
5
• Population-based search procedure in which individuals called particles change their position (state) with time.
individual has position
& individual changes velocityix
iv
![Page 6: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/6.jpg)
6
• Particles fly around in a multidimensional search space. During flight, each particle adjusts its position according to its own experience, and according to the experience of a neighboring particle, making use of the best position encountered by itself and its neighbor.
![Page 7: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/7.jpg)
7
1. Initialize population in hyperspace
2. Evaluate fitness of individual particles
3. Modify velocities based on previous best and global (or neighborhood) best positions
4. Terminate on some condition
5. Go to step 2
Particle Swarm Optimization (PSO) Process
![Page 8: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/8.jpg)
8
• Inertia Weight
d is the dimension, c1 and c2 are positive constants, rand1 and rand2 are random numbers, and w is the inertia weight
PSO Velocity Update Equations
newid
oldid
newid
idgdididoldidi
newid
vxx
xprandcxprandcvwv
)()( 2211
![Page 9: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/9.jpg)
9
• Vmax
if Vid > Vmax , Vid = Vmax
else if Vid < -Vmax , Vid = -Vmax
PSO Velocity Update Equations
newid
oldid
newid
idgdididoldid
newid
vxx
xprandcxprandcvv
)()( 2211
![Page 10: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/10.jpg)
10
PSO Velocity Update Equations Using Constriction Factor Method
0.729)K so 4.1, set to was(
4 ,
42
2
)]()([
21
2
2211
cc
K
vxx
xprandcxprandcvKvnewid
oldid
newid
idgdididoldid
newid
![Page 11: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/11.jpg)
11
• Global version vs Neighborhood version
change pgd to pld .
where pgd is the global best position
and pld is the neighboring best position
PSO Velocity Update Equations
![Page 12: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/12.jpg)
12
• Large inertia weight facilitates global exploration, small on facilitates local exploration
• w must be selected carefully and/or decreased over the run
• Inertia weight seems to have attributes of temperature in simulated annealing
Inertia Weight
![Page 13: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/13.jpg)
13
• An important parameter in PSO; typically the only one adjusted
• Clamps particles velocities on each dimension
• Determines “fineness” with which regions are searched
if too high, can fly past optimal solutions
if too low, can get stuck in local minima
Vmax
![Page 14: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/14.jpg)
14
• PSO has a memory
not “what” that best solution was, but “where” that best solution was
• Quality: population responds to quality factors pbest and gbest
• Diverse response: responses allocated between pbest and gbest
• Stability: population changes state only when gbest changes
• Adaptability: population does change state when gbest changes
![Page 15: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/15.jpg)
15
• There is no selection in PSO
all particles survive for the length of the run
PSO is the only EA that does not remove candidate population members
• In PSO, topology is constant; a neighbor is a neighbor
• Population size: Jim 10-20, Russ 30-40
![Page 16: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/16.jpg)
16
• Simple in concept
• Easy to implement
• Computationally efficient
• Application to combinatorial problems?
Binary PSO
![Page 17: 1 IE 607 Heuristic Optimization Particle Swarm Optimization](https://reader036.vdocuments.site/reader036/viewer/2022082611/56649eda5503460f94be8bb2/html5/thumbnails/17.jpg)
17
• Swarm Intelligence by Kennedy, Eberhart, and Shi, Morgan Kaufmann division of Academic Press, 2001.
http://www.engr.iupui.edu/~eberhart/web/PSObook.html• http://www.particleswarm.net/• http://web.ics.purdue.edu/~hux/PSO.shtml• http://www.cis.syr.edu/~mohan/pso/• http://clerc.maurice.free.fr/PSO/index.htm• http://users.erols.com/cathyk/jimk.html
Books and Website