approximation model guided selection for evolutionary .../file/ref_17.pdf · 11 ams framework o a....
TRANSCRIPT
![Page 1: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/1.jpg)
Approximation Model Guided Selection for Evolutionary Multiobjective Optimization
Aimin Zhou1, Qingfu Zhang2, and Guixu Zhang1
1Each China Normal University, Shanghai, China
2University of Essex, Colchester, UK
03/2013
![Page 2: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/2.jpg)
2
Outline
§ Background
§ Approximation Model Guided Selection
§ Experimental Results
§ Discussions & Conclusions
Approximation Model Guided Selection, EMO 2013
![Page 3: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/3.jpg)
3
Outline
§ Background
§ Approximation Model Guided Selection
§ Experimental Results
§ Discussions & Conclusions
Approximation Model Guided Selection, EMO 2013
![Page 4: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/4.jpg)
4
€
minF (x) = ( f1 (x), f2 (x),…, fm (x))s.t x ∈ D
Multiobjective Optimization Problem
Approximation Model Guided Selection, EMO 2013
o Definition
where
o Pareto domination
o Optimum • Pareto set (PS) • Pareto front (PF)
2f
1f
)(DF
Pareto front (PF)
Pareto set (PS)
F
D : decision (variable) space. fi : D→ R, objective functionF : D→ Rm, objective vector function
![Page 5: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/5.jpg)
5
o Find an approximation set, which is
• as diverse as possible • as close to the PF (PS)
as possible
Target of MOEA
Approximation Model Guided Selection, EMO 2013
Lower dimensional problems!
2f
1f
)(DF
Pareto front (PF)
Pareto set (P)
F
![Page 6: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/6.jpg)
6
o Reproduction • Generate new trial solutions
o Selection • Select fittest ones into the
next generation
A General MOEA Framework
Approximation Model Guided Selection, EMO 2013
Population
New Solutions
Reproduction Selection
![Page 7: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/7.jpg)
7
o Step 1: rank population • dominance rank • dominance count • dominance strength
o Step 2: estimate density • niche and fitness sharing • crowding distance • K-nearest neighbor • gridding
Dominance based Selection
Approximation Model Guided Selection, EMO 2013
Define a complete order over individuals!
![Page 8: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/8.jpg)
8
o Convert an MOP into an SOP • Obj. = performance metric
Indicator based Selection
Approximation Model Guided Selection, EMO 2013
Define a complete order over populations!
![Page 9: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/9.jpg)
9
Model Guided Selection
Approximation Model Guided Selection, EMO 2013
o Step 1: model the PF
o Step 2: choose reference points
o Step 3: select promising solutions
Much work needs to be done along this direction!
o H. J. F. Moen, et al., Many-objective Optimization Using Taxi-Cab Surface Evolutionary Algorithm, EMO, 2013.
o H. Jain, and K. Deb, An improved Adaptive Appraoch for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization, EMO, 2013.
![Page 10: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/10.jpg)
10
Outline
§ Background
§ Approximation Model Guided Selection
§ Experimental Results
§ Discussions & Conclusions
Approximation Model Guided Selection, EMO 2013
![Page 11: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/11.jpg)
11
AMS Framework
o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization, Ph.D Thesis, University of Essex, 2009. (Chapter 5.3)
o A. Zhou, Q. Zhang, Y. Jin, and B. Sendhoff, Combination of EDA and DE for Continuous Biobjective Optimization, CEC 2008.
o Q. Zhang and H. Li, MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition, IEEE Trans. on Evolutionary Computation, 2007.
Approximation Model Guided Selection, EMO 2013
Model PF
Define sub-problem
Select
![Page 12: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/12.jpg)
12
Zero-order Approximation(AMS0)
o A single point to approximate the PF
o Model (ideal point)
o Distance to utopian PF (sub-problem)
Approximation Model Guided Selection, EMO 2013
Simple, but does not consider the shape of PF!
![Page 13: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/13.jpg)
13
First-order Approximation(AMS1)
o A simplex to approximate the PF
o Model (vertices of simplex)
o Distance to simplex
Approximation Model Guided Selection, EMO 2013
Simple, and consider the shape of PF in a sense!
![Page 14: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/14.jpg)
14
Outline
§ Background
§ Approximation Model Guided Selection
§ Experimental Results
§ Discussions & Conclusions
Approximation Model Guided Selection, EMO 2013
![Page 15: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/15.jpg)
15
Settings
o Offspring reproduction operator • A probability model based reproduction operator (RM-MEDA)
o Comparison strategy • NDS: non-dominated sorting scheme (NSGA-II)
o Test instances • 8 instances with different properties
o Performance metric • IGD: inverted general distance
Approximation Model Guided Selection, EMO 2013
![Page 16: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/16.jpg)
16
Convex PF
NDS
Approximation Model Guided Selection, EMO 2013
AMS0 AMS1
![Page 17: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/17.jpg)
17
Concave PF
NDS
Approximation Model Guided Selection, EMO 2013
AMS0 AMS1
![Page 18: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/18.jpg)
18
Tri-objective MOP
NDS
Approximation Model Guided Selection, EMO 2013
AMS0 AMS1
![Page 19: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/19.jpg)
19
Statistical Results
Approximation Model Guided Selection, EMO 2013
NDS:1 AMS0:4 AMS1:4
![Page 20: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/20.jpg)
20
Outline
§ Background
§ Approximation Model Guided Selection
§ Experimental Results
§ Discussions & Conclusions
Approximation Model Guided Selection, EMO 2013
![Page 21: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/21.jpg)
21
o AMS works better than NDS in most of the test instances
o AMS0 is more stable than AMS1
o AMS1 works better than AMS0 if a good simplex model can be found
Approximation Model Guided Selection, EMO 2013
order of model
stability of AMS
number of objectives
stability of AMS
![Page 22: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/22.jpg)
22
o How to build a high-quality model? • model should be cheap • model should be stable
o What’s the performance on complicated problems? • non-concave (non-convex) • with disconnected PF
o What’s the performance on many-objective problems? • interesting sub-problems (reference points, targets points)
Approximation Model Guided Selection, EMO 2013
![Page 23: Approximation Model Guided Selection for Evolutionary .../file/REF_17.pdf · 11 AMS Framework o A. Zhou, Estimation of Distribution Algorithms for Continuous Multiobjective Optimization,](https://reader033.vdocuments.site/reader033/viewer/2022051920/600d924624660034d54dfb60/html5/thumbnails/23.jpg)
23
Thanks!
The source code is available from [email protected]
Approximation Model Guided Selection, EMO 2013