dr. shazzad hosain department of eecs north south universtiy [email protected] lecture 03 –...
TRANSCRIPT
![Page 1: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/1.jpg)
Dr. Shazzad Hosain
Department of EECSNorth South Universtiy
Lecture 03 – Part ALocal Search
![Page 2: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/2.jpg)
Beyond IDA* …
2
So far: systematic exploration: O(bd)Explore full search space (possibly) using pruning (A*, IDA*
… )
Best such algorithms (IDA*) can handle 10100 states ≈ 500 binary-valued variables
but. . . some real-world problem have 10,000 to 100,000 variables 1030,000 states
We need a completely different approach: Local Search Methods or Iterative Improvement Methods
![Page 3: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/3.jpg)
Local Search Methods
Applicable when seeking Goal State & don't care how to get there. E.g.,
N-queens, map coloring, finding shortest/cheapest round trips (TSP)VLSI layout, planning, scheduling, time-tabling, . .
. resource allocationprotein structure predictiongenome sequence assembly
3
![Page 4: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/4.jpg)
Key Idea
Local Search Methods
![Page 5: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/5.jpg)
Local search
5
Key idea (surprisingly simple):
1. Select (random) initial state (generate an initial guess)
2. Make local modification to improve current state (evaluate current state and move to other states)
3. Repeat Step 2 until goal state found (or out of time)
![Page 6: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/6.jpg)
TSP
Local Search: Examples
![Page 7: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/7.jpg)
Traveling Salesman PersonFind the shortest Tour traversing all cities
once.
7
![Page 8: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/8.jpg)
Traveling Salesman Person
A Solution: Exhaustive Search (Generate and Test) !!
The number of all tours is about (n-1)!/2
If n = 36 the number is about:
566573983193072464833325668761600000000
Not Viable Approach !!
8
![Page 9: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/9.jpg)
Traveling Salesman Person
A Solution: Start from an initial solution and improve using local transformations.
9
![Page 10: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/10.jpg)
2-opt mutation (2-Swap) for TSP
10
Choose two edges at random
![Page 11: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/11.jpg)
2-opt mutation for TSP
11
Choose two edges at random
![Page 12: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/12.jpg)
2-opt mutation for TSP
12
Remove them
![Page 13: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/13.jpg)
2-opt mutation for TSP
13
Reconnect in a different way (there is only one valid new way)Continue until there is no 2-opt mutation
Can be generalized as 3-opt (two valid ways), k-opt etc.
![Page 14: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/14.jpg)
N-Queens
Local Search: Examples
![Page 15: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/15.jpg)
Example: 4 Queen
15
States: 4 queens in 4 columns (256 states) Operators: move queen in column Goal test: no attacks Evaluation: h(n) = number of attacks
Not v
alid
initi
al so
lutio
n
![Page 16: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/16.jpg)
Graph-Coloring
Local Search: Examples
![Page 17: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/17.jpg)
Example: Graph Coloring
17
1. Start with random coloring of nodes 2. Change color of one node to reduce # of conflicts 3. Repeat 2
![Page 18: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/18.jpg)
Local Search AlgorithmsLocal Search Algorithms
18
Basic idea: Local search algorithms operate on a single state – current state – and move to one of its neighboring states.
The principle: keep a single "current" state, try to improve it
Therefore: Solution path needs not be maintained. Hence, the search is “local”.
Two advantages Use little memory. More applicable in searching large/infinite search space.
They find reasonable solutions in this case.
![Page 19: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/19.jpg)
Hill Climbing,Simulated Annealing,
Tabu Search
Local Search Algorithms
![Page 20: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/20.jpg)
Hill Climbing
Hill climbing search algorithm (also known as greedy local search) uses a loop that continually moves in the direction of increasing values (that is uphill).
It teminates when it reaches a peak where no neighbor has a higher value.
20
• "Like climbing Everest in thick fog with amnesia"
![Page 21: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/21.jpg)
Hill Climbing
21
states
evaluation
![Page 22: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/22.jpg)
Hill Climbing
22
Initial state … Improve it … using local transformations (perturbations)
![Page 23: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/23.jpg)
Hill Climbing
23
Steepest ascent version
function HILL-CLIMBING(problem) returns a solution state
inputs: problem, a problem static: current, a node next, a node
current MAKE-NODE(INITIAL-STATE[problem]) loop do next a highest-valued successor of current if VALUE[next] ≤ VALUE[current] then return
current current next end
![Page 24: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/24.jpg)
Hill Climbing: NeighborhoodConsider the 8-queen problem:
A State contains 8 queens on the board
The neighborhood of a state is all states generated by moving a single queen to another square in the same column (8*7 = 56 next states)
The objective function h(s) = number of pairs of queens that attack each other in state s (directly or indirectly).
24h(s) = 17 best next is 12 h(s)=1 [local minima]
![Page 25: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/25.jpg)
Hill Climbing DrawbacksHill Climbing Drawbacks
Local maxima/minima : local search can get stuck on a local maximum/minimum and not find the optimal solution
25
Local minimum
Cost
States
![Page 26: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/26.jpg)
Hill Climbing in Action …
26
Cost
States
![Page 27: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/27.jpg)
Hill Climbing
27
Current Solution
![Page 28: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/28.jpg)
Hill Climbing
28
Current Solution
![Page 29: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/29.jpg)
Hill Climbing
29
Current Solution
![Page 30: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/30.jpg)
Hill Climbing
30
Current Solution
![Page 31: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/31.jpg)
Hill Climbing
31
Best
Local Minimum
Global Minimum
![Page 32: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/32.jpg)
Local Search: State SpaceLocal Search: State Space
32
A state space landscape is a graph of states associated with their costs
![Page 33: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/33.jpg)
Issues
33
The Goal is to find GLOBAL optimum.
1. How to avoid LOCAL optima? 2. When to stop? 3. Climb downhill? When?
![Page 34: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/34.jpg)
PlateauxPlateaux
34
A plateu is a flat area of the state-space landscape
![Page 35: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/35.jpg)
Sideways MoveSideways Move
35
Hoping that plateu is realy a shoulderLimit the number of sideway moves, otherwise infinite loopExample:
100 consecutive sideways moves for 8 queens problemChances increase form 14% to 94%It is incomplete, because stuck at local maxima
![Page 36: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/36.jpg)
Random-restart hill Random-restart hill climbingclimbing
36
Randomly generate an initial state until a goal is foundIt is trivially complete with probability approaching to 1Example:
For 8-quens problem, very effectiveFor three million queens, solve the problem within minute
![Page 37: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/37.jpg)
Simulated Annealing(Stochastic hill climbing …)
Local Search Algorithms
![Page 38: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/38.jpg)
Simulated Annealing
38
Key Idea: escape local maxima by allowing some "bad" moves but gradually decrease their frequency
Take some uphill steps to escape the local minimum
Instead of picking the best move, it picks a random move
If the move improves the situation, it is executed. Otherwise, move with some probability less than 1.
Physical analogy with the annealing process:Allowing liquid to gradually cool until it freezes
The heuristic value is the energy, E
Temperature parameter, T, controls speed of convergence.
![Page 39: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/39.jpg)
39
Basic inspiration: What is annealing? In mettallurgy, annealing is the physical process used to
temper or harden metals or glass by heating them to a high temperature and then gradually cooling them, thus allowing the material to coalesce into a low energy cristalline state.
Heating then slowly cooling a substance to obtain a strong cristalline structure.
Key idea: Simulated Annealing combines Hill Climbing with a random walk in some way that yields both efficiency and completeness.
Used to solve VLSI layout problems in the early 1980
Simulated Annealing
![Page 40: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/40.jpg)
Simulated Annealing in Action …
40
Cost
States
Best
![Page 41: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/41.jpg)
Simulated Annealing
41
Cost
States
Best
![Page 42: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/42.jpg)
Simulated Annealing
42
Cost
States
Best
![Page 43: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/43.jpg)
Simulated Annealing
43
Cost
States
Best
![Page 44: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/44.jpg)
Simulated Annealing
44
Cost
States
Best
![Page 45: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/45.jpg)
Simulated Annealing
45
Cost
States
Best
![Page 46: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/46.jpg)
Simulated Annealing
46
Cost
States
Best
![Page 47: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/47.jpg)
Simulated Annealing
47
Cost
States
Best
![Page 48: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/48.jpg)
Simulated Annealing
48
Cost
States
Best
![Page 49: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/49.jpg)
Simulated Annealing
49
Cost
States
Best
![Page 50: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/50.jpg)
Simulated Annealing
50
Cost
States
Best
![Page 51: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/51.jpg)
Simulated Annealing
51
Cost
States
Best
![Page 52: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/52.jpg)
Simulated Annealing
52
Cost
States
Best
![Page 53: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/53.jpg)
Simulated Annealing
53
Cost
States
Best
![Page 54: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/54.jpg)
Simulated Annealing
54
Cost
States
Best
![Page 55: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/55.jpg)
Simulated Annealing
55
Cost
States
Best
![Page 56: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/56.jpg)
Simulated Annealing
56
Cost
States
Best
![Page 57: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/57.jpg)
Simulated Annealing
57
Cost
States
Best
![Page 58: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/58.jpg)
Simulated Annealing
58
Cost
States
Best
![Page 59: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/59.jpg)
Simulated Annealing
59
Cost
States
Best
![Page 60: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/60.jpg)
Simulated Annealing
60
Cost
States
Best
![Page 61: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/61.jpg)
Simulated Annealing
61
Cost
States
Best
![Page 62: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/62.jpg)
Simulated Annealing
62
Cost
States
Best
![Page 63: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/63.jpg)
63
Simulated Annealing
![Page 64: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/64.jpg)
64
Temperature T Used to determine the probability High T : large changes Low T : small changes
Cooling Schedule Determines rate at which the temperature T is lowered Lowers T slowly enough, the algorithm will find a
global optimum
In the beginning, aggressive for searching alternatives, become conservative when time goes by
Simulated Annealing
![Page 65: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/65.jpg)
65
Initial State Permutation of numbers 1 … N Where cities are numbered
from 1 … N
Rearrangements for new states
2-swap, 3-swap, k-swap or any other
Energy i.e. heuristic function Total distance ∆E = distance (current) –
distance (next)
Simulated Annealing for TSP
![Page 66: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/66.jpg)
66
Temperature T Initially a value considerably
larger than the largest ∆E normally encountered
Cooling Schedule Determines rate at which the
temperature T is lowered, say 10% decrease of T
Keep new value of T constant, say 100N reconfigurations or 10N successful reconfigurations
Simulated Annealing for TSP
![Page 67: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/67.jpg)
Tabu Search(hill climbing with small memory)
Local Search Algorithms
![Page 68: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/68.jpg)
Tabu Search
68
The basic concept of Tabu Search as described by Glover (1986) is "a meta-heuristic superimposed on another heuristic.
The overall approach is to avoid entrainment in cycles by forbidding or penalizing moves which take the solution, in the next iteration, to points in the solution space previously visited ( hence "tabu").
The Tabu search is fairly new, Glover attributes it's origin to about 1977.
![Page 69: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/69.jpg)
Tabu Search Algorithm (simplified)
69
1. Start with an initial feasible solution
2. Initialize Tabu list
3. Generate a subset of neighborhood and find the best solution from the generated ones
4. If move is not in tabu list then accept
5. Repeat from 3 until terminating condition
![Page 70: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/70.jpg)
Tabu Search: TS in Action …
70
Cost
States
![Page 71: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/71.jpg)
Tabu Search: TS
71
Best
![Page 72: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/72.jpg)
Tabu Search: TS
72
Best
![Page 73: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/73.jpg)
Tabu Search: TS
73
Best
![Page 74: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/74.jpg)
Tabu Search: TS
74
Best
![Page 75: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/75.jpg)
Tabu Search: TS
75
Best
![Page 76: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/76.jpg)
Tabu Search: TS
76
Best
![Page 77: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/77.jpg)
Tabu Search: TS
77
Best
![Page 78: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/78.jpg)
Tabu Search: TS
78
Best
![Page 79: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/79.jpg)
Tabu Search: TS
79
Best
![Page 80: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/80.jpg)
Tabu Search: TS
80
Best
![Page 81: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/81.jpg)
Tabu Search: TS
81
Best
![Page 82: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/82.jpg)
Tabu Search: TS
82
Best
![Page 83: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/83.jpg)
Tabu Search: TS
83
Best
![Page 84: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/84.jpg)
Tabu Search: TS
84
Best
![Page 85: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/85.jpg)
Tabu Search: TS
85
Best
![Page 86: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/86.jpg)
Tabu Search: TS
86
Best
![Page 87: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/87.jpg)
Tabu Search: TS
87
Best
![Page 88: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/88.jpg)
Tabu Search: TS
88
Best
![Page 89: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/89.jpg)
Tabu Search: TS
89
Best
![Page 90: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/90.jpg)
Tabu Search: TS
90
Best
![Page 91: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/91.jpg)
Tabu Search: TS
91
Best
![Page 92: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/92.jpg)
Tabu Search: TS
92
Best
![Page 93: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/93.jpg)
Tabu Search for TSP
93
1. Start with an initial feasible solution
2. Initialize Tabu list, initially emptyA pair of nodes that have been exchanged recently
3. Generate a subset of neighborhood and find the best solution from the generated ones
4. If move is not in tabu list then accept
5. Repeat from 3 until terminating condition i.e. T = 0
![Page 94: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/94.jpg)
Population Based AlgorithmsBeam Search, Genetic Algorithms &
Genetic Programming
Optimization Problems
![Page 95: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/95.jpg)
Beam Search Algorithm
Population based Algorithms
![Page 96: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/96.jpg)
Local Beam Search
96
Idea: keep k states instead of just 1
Begins with k randomly generated states
At each step all the successors of all k states are generated.
If one is a goal, we stop, otherwise select k best successors from complete list and repeat
![Page 97: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/97.jpg)
97
Unlike Hill Climbing, Local Beam Search keeps track of k states rather than just one.
It starts with k randomly generated states.
At each step, all the successors of all the states are generated.
If any one is a goal, the algorithm halts, otherwise it selects the k best successors from the complete list and repeats.
LBS≠ running k random restarts in parallel instead of sequence.
Drawback: less diversity. → Stochastic Beam Search
Local Beam Search
![Page 98: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/98.jpg)
Local Beam Search
98
Cost
States
![Page 99: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/99.jpg)
Local Beam Search
99
![Page 100: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/100.jpg)
Local Beam Search
100
![Page 101: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/101.jpg)
Local Beam Search
101
![Page 102: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/102.jpg)
Local Beam Search
102
![Page 103: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/103.jpg)
Local Beam Search
103
![Page 104: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/104.jpg)
Local Beam Search
104
![Page 105: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/105.jpg)
Local Beam Search
105
![Page 106: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/106.jpg)
Local Beam Search
106
![Page 107: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/107.jpg)
Local Beam Search
107
![Page 108: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/108.jpg)
Local Beam Search
108
![Page 109: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/109.jpg)
Local Beam Search
109
![Page 110: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/110.jpg)
Local Beam Search
110
![Page 111: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/111.jpg)
Local Beam Search
111
![Page 112: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/112.jpg)
Local Beam Search
112
![Page 113: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/113.jpg)
Local Beam Search
113
![Page 114: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/114.jpg)
A variant of stochastic beam search
Genetic Algorithms
![Page 115: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/115.jpg)
Genetic Algorithms - History
Pioneered by John Holland in the 1970’s
Got popular in the late 1980’s
Based on ideas from Darwinian Evolution
Can be used to solve a variety of problems that are not easy to solve using other techniques
![Page 116: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/116.jpg)
![Page 117: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/117.jpg)
Evolution in the real worldEach cell of a living thing contains chromosomes -
strings of DNAEach chromosome contains a set of genes - blocks of
DNAEach gene determines some aspect of the organism
(like eye colour)A collection of genes is sometimes called a
genotypeA collection of aspects (like eye colour) is sometimes
called a phenotypeReproduction involves recombination of genes from
parents and then small amounts of mutation (errors) in copying
The fitness of an organism is how much it can reproduce before it dies
Evolution based on “survival of the fittest”
![Page 118: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/118.jpg)
Start with a Dream…Suppose you have a problemYou don’t know how to solve itWhat can you do?Can you use a computer to somehow find a
solution for you?This would be nice! Can it be done?
![Page 119: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/119.jpg)
A dumb solution
A “blind generate and test” algorithm:Repeat
Generate a random possible solutionTest the solution and see how good it is
Until solution is good enough
![Page 120: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/120.jpg)
Can we use this dumb idea?Sometimes - yes:
if there are only a few possible solutionsand you have enough timethen such a method could be used
For most problems - no:many possible solutionswith no time to try them allso this method can not be used
![Page 121: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/121.jpg)
A “less-dumb” idea (GA)
Generate a set of random solutionsRepeat
Test each solution in the set (rank them)Remove some bad solutions from setDuplicate some good solutions
make small changes to some of them
Until best solution is good enough
![Page 122: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/122.jpg)
Stochastic Search: Genetic Algorithms
122
GAs emulate ideas from genetics and natural selection and can search potentially large spaces.
Before we can apply Genetic Algorithm to a problem, we need to answer:
- How is an individual represented?- What is the fitness function?- How are individuals selected?- How do individuals reproduce?
![Page 123: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/123.jpg)
How do you encode a solution?
Obviously this depends on the problem!
GA’s often encode solutions as fixed length “bitstrings” (e.g. 101110, 111111, 000101)
Each bit represents some aspect of the proposed solution to the problem
For GA’s to work, we need to be able to “test” any string and get a “score” indicating how “good” that solution is
![Page 124: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/124.jpg)
Silly Example - Drilling for Oil
Imagine you had to drill for oil somewhere along a single 1km desert road
Problem: choose the best place on the road that produces the most oil per day
We could represent each solution as a position on the road
Say, a whole number between [0..1000]
![Page 125: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/125.jpg)
Where to drill for oil?
0 500 1000
Road
Solution2 = 900Solution1 = 300
![Page 126: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/126.jpg)
Digging for OilThe set of all possible solutions [0..1000]
is called the search space or state space
In this case it’s just one number but it could be many numbers or symbols
Often GA’s code numbers in binary producing a bitstring representing a solution
In our example we choose 10 bits which is enough to represent 0..1000
![Page 127: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/127.jpg)
Convert to binary string
512
256
128
64 32 16 8 4 2 1
900 1 1 1 0 0 0 0 1 0 0
300 0 1 0 0 1 0 1 1 0 0
1023
1 1 1 1 1 1 1 1 1 1
In GA’s these encoded strings are sometimes called “genotypes” or “chromosomes” and the individual bits are
sometimes called “genes”
![Page 128: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/128.jpg)
Drilling for Oil
0 1000
Road
Solution2 = 900 (1110000100)
Solution1 = 300 (0100101100)
O I L
Location
35
![Page 129: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/129.jpg)
Generate a set of random solutionsRepeat
Test each solution in the set (rank them)Remove some bad solutions from setDuplicate some good solutions
make small changes to some of them
Until best solution is good enough
Back to the (GA) Algorithm
![Page 130: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/130.jpg)
Select a set of random population
No. Decimal Chromosome Fitness
1 666 1010011010 1
2 993 1111100001 2
3 716 1011001100 3
4 640 1010000000 1
5 16 0000010000 3
6 607 1001011111 5
7 341 0101010101 1
8 743 1011100111 2
![Page 131: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/131.jpg)
Roulette Wheel Selection
1 2 3 1 3 5 1 2
0 18
21 3 4 5 6 7 8
Rnd[0..18] = 7
Chromosome4
Parent1
Rnd[0..18] = 12
Chromosome6
Parent2
![Page 132: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/132.jpg)
Other Kinds of Selection (not roulette)
132
TournamentPick k members at random then select the best of these
Different variations are there too
Elitism, etc.Always keep at least one copy of the fittest solution so far
Linear ranking
Exponential ranking
Many more
![Page 133: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/133.jpg)
Crossover - Recombination
1010000000
1001011111
Crossover single point -
random
1011011111
1000000000
Parent1
Parent2
Offspring1
Offspring2
With some high probability (crossover rate) apply crossover to the parents. (typical values are 0.8 to 0.95)
![Page 134: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/134.jpg)
Variants of Crossover - Recombination
134
Half from one, half from the other:0110 1001 0100 1110 1010 1101 1011 0101 1101 0100 0101 1010 1011 0100 1010 0101 0110 1001 0100 1110 1011 0100 1010 0101
Or we might choose “genes” (bits) randomly:0110 1001 0100 1110 1010 1101 1011 0101 1101 0100 0101 1010 1011 0100 1010 0101 0100 0101 0100 1010 1010 1100 1011 0101
Or we might consider a “gene” to be a larger unit:0110 1001 0100 1110 1010 1101 1011 0101 1101 0100 0101 1010 1011 0100 1010 0101 1101 1001 0101 1010 1010 1101 1010 0101
![Page 135: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/135.jpg)
Mutation
1011011111
1000000000
Offspring1
Offspring2
1011001111
1010000000
Offspring1
Offspring2
With some small probability (the mutation rate) flip each bit in the offspring (typical values between 0.1 and 0.001)
mutate
Original offspring Mutated offspring
719
640
![Page 136: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/136.jpg)
Drilling for Oil
0 1000
Road
Solution2 = 900 (1110000100)
Solution1 = 300 (0100101100)
O I L
Location
35
![Page 137: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/137.jpg)
Drilling for Oil
0 1000
Road
Solution2 = 719 (1011001111)
Solution1 = 640 (1010000000)
O I L
Location
35
1
6
![Page 138: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/138.jpg)
Generate a set of random solutionsRepeat
Test each solution in the set (rank them)Remove some bad solutions from setDuplicate some good solutions
make small changes to some of them
Until best solution is good enough
Back to the (GA) Algorithm
![Page 139: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/139.jpg)
Genetic Algorithms in Action …
139
Cost
States
![Page 140: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/140.jpg)
Genetic Algorithms
140
Mutation
Cross-Over
![Page 141: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/141.jpg)
Genetic Algorithms
141
![Page 142: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/142.jpg)
Genetic Algorithms
142
![Page 143: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/143.jpg)
Genetic Algorithms
143
![Page 144: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/144.jpg)
Genetic Algorithms
144
![Page 145: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/145.jpg)
Genetic Algorithms
145
![Page 146: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/146.jpg)
Genetic Algorithms
146
![Page 147: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/147.jpg)
Genetic Algorithms
147
![Page 148: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/148.jpg)
Genetic Algorithms
148
![Page 149: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/149.jpg)
Genetic Algorithms
149
![Page 150: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/150.jpg)
Genetic Algorithms
150
![Page 151: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/151.jpg)
Genetic Algorithms
151
![Page 152: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/152.jpg)
Genetic Algorithms
152
![Page 153: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/153.jpg)
Genetic Algorithms
153
![Page 154: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/154.jpg)
Genetic Algorithms
154
![Page 155: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/155.jpg)
Genetic Algorithms
155
![Page 156: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/156.jpg)
Genetic Algorithms
156
![Page 157: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/157.jpg)
Genetic Algorithms
157
![Page 158: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/158.jpg)
158
Another Example:The Traveling Salesman Problem (TSP)
The traveling salesman must visit every city in his territory exactly once and then return to the starting point; given the cost of travel between all cities, how should he plan his itinerary for minimum total cost of the entire tour?
TSP NP-Complete
Note: we shall discuss a single possible approach to approximate the TSP by GAs
![Page 159: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/159.jpg)
159
TSP (Representation, Evaluation, Initialization and Selection)
A vector v = (i1 i2… in) represents a tour (v is a permutation of {1,2,…,n})
Fitness f of a solution is the inverse cost of the corresponding tour
Initialization: use either some heuristics, or a random sample of permutations of {1,2,…,n}
We shall use the fitness proportionate selection
![Page 160: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/160.jpg)
160
TSP (Crossover1)
OX – builds offspring by choosing a sub-sequence of a tour from one parent and preserving the relative order of cities from the other parent and feasibility
Example:p1 = (1 2 3 4 5 6 7 8 9) and
p2 = (4 5 2 1 8 7 6 9 3)
First, the segments between cut points are copied into offspring
o1 = (x x x 4 5 6 7 x x) and
o2 = (x x x 1 8 7 6 x x)
![Page 161: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/161.jpg)
161
TSP (Crossover2)
Next, starting from the second cut point of one parent, the cities from the other parent are copied in the same order
The sequence of the cities in the second parent is
After removal of cities from the first offspring we get
This sequence is placed in the first offspring
o1 = (2 1 8 4 5 6 7 9 3), and similarly in the second
o2 = (3 4 5 1 8 7 6 9 2)
p1 = (1 2 3 4 5 6 7 8 9) and
p2 = (4 5 2 1 8 7 6 9 3)
p2 = (4 5 2 1 8 7 6 9 3)
9 – 3 – 4 – 5 – 2 – 1 – 8 – 7 – 6
9 – 3 – 4 – 5 – 2 – 1 – 8 – 7 – 6
![Page 162: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/162.jpg)
Why does crossover work?
A lot of theory about this and some controversy
Holland introduced “Schema” theory
The idea is that crossover preserves “good bits” from different parents, combining them to produce better solutions
A good encoding scheme would therefore try to preserve “good bits” during crossover and mutation
![Page 163: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/163.jpg)
Summary of Genetic AlgorithmWe have seen how to:represent possible solutions as a numberencoded a number into a binary stringgenerate a score for each number given a
function of “how good” each solution is - this is often called a fitness function
Our silly oil example is really optimisation over a function f(x) where we adapt the parameter x
![Page 164: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/164.jpg)
Genetic programming: GP
Optimization Problems
![Page 165: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/165.jpg)
Genetic Programming
165
Genetic programming (GP)
Programming of Computersby Means of Simulated Evolution
How to Program a ComputerWithout Explicitly Telling It What to Do?
Genetic Programming is Genetic Algorithms where solutions are programs …
![Page 166: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/166.jpg)
Genetic programming
166
When the chromosome encodes an entire program or function itself this is called genetic programming (GP)
In order to make this work,encoding is often done in the form of a tree representation
Crossover entials swaping subtrees between parents
![Page 167: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/167.jpg)
Genetic programming
167
It is possible to evolve whole programs like this but only small ones. Large programs with complex functions present big problems
![Page 168: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/168.jpg)
Genetic programming
168
Inter-twined Spirals: Classification Problem
Red Spiral
Blue Spiral
![Page 169: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/169.jpg)
Genetic programming
169
Inter-twined Spirals: Classification Problem
![Page 170: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/170.jpg)
New AlgorithmsACO, PSO, QGA …
Optimization Problems
![Page 171: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/171.jpg)
Anything to be Learnt from Ant Colonies?
Fairly simple units generate complicated global behaviour.
An ant colony expresses a complex collective behavior providing intelligent solutions to problems such as:
carrying large items forming bridges finding the shortest routes from
the nest to a food source, prioritizing food sources based on their distance and ease of access.
“If we knew how an ant colony works, we might understand more about how all such systems work, from brains to ecosystems.”
(Gordon, 1999)
171
![Page 172: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/172.jpg)
Shortest path discovery
172
![Page 173: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/173.jpg)
Shortest path discovery
173
Ants get to find the shortest path after few minutes …Ants get to find the shortest path after few minutes …
![Page 174: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/174.jpg)
Ant Colony Optimization
174
Each artificial ant is a probabilistic mechanism that Each artificial ant is a probabilistic mechanism that constructs a solution to the problem, using:constructs a solution to the problem, using:
• Artificial pheromone depositionArtificial pheromone deposition• Heuristic information: pheromone trails, Heuristic information: pheromone trails, already visited cities memory …already visited cities memory …
![Page 175: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/175.jpg)
The sizes of the Traveling Salesman Problem
100,000 = 105 people in a stadium.
5,500,000,000 = 5.5 109 people on earth.
1,000,000,000,000,000,000,000 = 1021 liters of water on the earth.
1010 years = 3 1017 seconds = The age of the universe
# of cities npossible solutions (n-1)!
= # of cyclic permutations10 181,000
20 10,000,000,000,000,000
= 1016
50 100,000,000,000,000,000,000,000,000,000,000,000,000,000,
000,000,000,000,000,000,000
= 1062
![Page 176: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/176.jpg)
Assignment 4
176
TSP with genetic algorithm
TSP with Ant Colony Optimization (ACO)
TSP with Bee Algorithm
![Page 177: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/177.jpg)
Summary
177
* Local search methods keep small number of nodes in memory.
They are suitable for problems where the solution is the goal state
itself and not the path.
* Hill climbing, simulated annealing and local beam search areexamples of local search algorithms.
* Stochastic algorithms represent another class of methods forinformed search. Genetic algorithms are a kind of stochastic
hill-climbing search in which a large population of states is maintained. New states are generated by mutation and bycrossover which combines pairs of states from the population.
![Page 178: Dr. Shazzad Hosain Department of EECS North South Universtiy shazzad@northsouth.edu Lecture 03 – Part A Local Search](https://reader030.vdocuments.site/reader030/viewer/2022032709/56649ed85503460f94be663c/html5/thumbnails/178.jpg)
ReferencesChapter 4 of “Artificial Intelligence: A
modern approach” by Stuart Russell, Peter Norvig.
Chapter 5 of “Artificial Intelligence Illuminated” by Ben Coppin