A new prediction strategy combining T-S fuzzy nonlinear regression prediction and multi-step prediction for dynamic multi-objective optimization

Abstract Many dynamic multi-objective optimization problems have been widely developed to track the changing optima quickly and effectively in dynamic environments. Prediction-based methods can be used to predict future changes by learning past experience. This paper employed a new prediction strategy combining Takagi-Sugeno fuzzy nonlinear regression prediction and multi-step prediction named TSMP to estimate the new initial Pareto solutions whenever the environment changes. In TSMP, when environmental changes occur, the next initial center of Pareto solutions (PS) is predicted by a Takagi-Sugeno fuzzy nonlinear regression prediction model and then one trail population is generated by combining the predicted center and an approximate manifold of PS. Moreover, the other trail population is generated by a linear multi-step prediction model. Furthermore, the next initial PS is reinitialized by a random hybridization of these two trail populations. The proposed TSMP strategy is systematically compared with re-initialization strategy (RIS), feed-forward prediction strategy (FPS) and population prediction strategy (FPS) under different multi-objective optimizers on benchmark test problems with different features. Experimental results and performance comparisons with other state-of-the-art algorithms indicate that TSMP is effective and promising for solving dynamic multi-objective optimization problems.

[1]  Shengxiang Yang,et al.  A memetic ant colony optimization algorithm for the dynamic travelling salesman problem , 2011, Soft Comput..

[2]  Andries Petrus Engelbrecht,et al.  Dynamic Multi-objective Optimisation Using PSO , 2010, Multi-Objective Swarm Intelligent System.

[3]  Pascal Bouvry,et al.  On dynamic multi-objective optimization, classification and performance measures , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[4]  Xiaodong Li,et al.  On performance metrics and particle swarm methods for dynamic multiobjective optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[5]  Kay Chen Tan,et al.  Solving Multiobjective Optimization Problems in Unknown Dynamic Environments: An Inverse Modeling Approach , 2017, IEEE Transactions on Cybernetics.

[6]  Yaochu Jin,et al.  A directed search strategy for evolutionary dynamic multiobjective optimization , 2014, Soft Computing.

[7]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[8]  Zbigniew Michalewicz,et al.  Adaptation in Dynamic Environments: A Case Study in Mission Planning , 2012, IEEE Transactions on Evolutionary Computation.

[9]  Witold Pedrycz,et al.  Multidirectional Prediction Approach for Dynamic Multiobjective Optimization Problems , 2019, IEEE Transactions on Cybernetics.

[10]  Zhen Zhang,et al.  Novel Interactive Preference-Based Multiobjective Evolutionary Optimization for Bolt Supporting Networks , 2020, IEEE Transactions on Evolutionary Computation.

[11]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[12]  Peter A. N. Bosman,et al.  Evolutionary Multiobjective Optimization for Dynamic Hospital Resource Management , 2009, EMO.

[13]  Lam Thu BUI,et al.  An adaptive approach for solving dynamic scheduling with time-varying number of tasks — Part I , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO.

[15]  Liu Min,et al.  Memory Enhanced Dynamic Multi-Objective Evolutionary Algorithm Based on Decomposition , 2013 .

[16]  Ponnuthurai Nagaratnam Suganthan,et al.  $I_{\rm SDE}$ +—An Indicator for Multi and Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[17]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[18]  Julio Ortega Lopera,et al.  Performance Measures for Dynamic Multi-Objective Optimization , 2009, IWANN.

[19]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[20]  Bojin Zheng,et al.  A New Dynamic Multi-objective Optimization Evolutionary Algorithm , 2007, Third International Conference on Natural Computation (ICNC 2007).

[21]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[22]  Qingfu Zhang,et al.  Prediction-Based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization , 2007, EMO.

[23]  Shengxiang Yang,et al.  The effect of diversity maintenance on prediction in dynamic multi-objective optimization , 2017, Appl. Soft Comput..

[24]  Xi Chen,et al.  Using Diversity as an Additional-objective in Dynamic Multi-objective Optimization Algorithms , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[25]  Xudong Zhao,et al.  Control of Switched Nonlinear Systems via T–S Fuzzy Modeling , 2016, IEEE Transactions on Fuzzy Systems.

[26]  Feng Zou,et al.  Community detection in complex networks: Multi-objective discrete backtracking search optimization algorithm with decomposition , 2017, Appl. Soft Comput..

[27]  Shengxiang Yang,et al.  A prediction strategy based on center points and knee points for evolutionary dynamic multi-objective optimization , 2017, Appl. Soft Comput..

[28]  Peter A. N. Bosman Learning and Anticipation in Online Dynamic Optimization , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[29]  Peter Xiaoping Liu,et al.  Online data-driven fuzzy clustering with applications to real-time robotic tracking , 2004, IEEE Transactions on Fuzzy Systems.

[30]  Shengxiang Yang,et al.  A predictive strategy based on special points for evolutionary dynamic multi-objective optimization , 2019, Soft Comput..

[31]  Bin Li,et al.  Investigation of memory-based multi-objective optimization evolutionary algorithm in dynamic environment , 2009, 2009 IEEE Congress on Evolutionary Computation.

[32]  Julio Ortega Lopera,et al.  A single front genetic algorithm for parallel multi-objective optimization in dynamic environments , 2009, Neurocomputing.

[33]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[34]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[35]  Hussein A. Abbass,et al.  A multi-objective evolutionary method for Dynamic Airspace Re-sectorization using sectors clipping and similarities , 2012, 2012 IEEE Congress on Evolutionary Computation.

[36]  Swagatam Das,et al.  Utilizing time-linkage property in DOPs: An information sharing based Artificial Bee Colony algorithm for tracking multiple optima in uncertain environments , 2013, Soft Computing.

[37]  Trung Thanh Nguyen,et al.  Continuous dynamic optimisation using evolutionary algorithms , 2011 .

[38]  Kay Chen Tan,et al.  Dynamic Multiobjective Optimization Using Evolutionary Algorithm with Kalman Filter , 2013 .

[39]  Andries Petrus Engelbrecht,et al.  Analyses of guide update approaches for vector evaluated particle swarm optimisation on dynamic multi-objective optimisation problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[40]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[41]  Mark Johnston,et al.  Automatic Design of Scheduling Policies for Dynamic Multi-objective Job Shop Scheduling via Cooperative Coevolution Genetic Programming , 2014, IEEE Transactions on Evolutionary Computation.

[42]  Attia A. El-Fergany,et al.  Multi-objective Allocation of Multi-type Distributed Generators along Distribution Networks Using Backtracking Search Algorithm and Fuzzy Expert Rules , 2016 .

[43]  Ponnuthurai N. Suganthan,et al.  Evolutionary multiobjective optimization in dynamic environments: A set of novel benchmark functions , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[44]  Carlos Cruz,et al.  Optimization in dynamic environments: a survey on problems, methods and measures , 2011, Soft Comput..

[45]  Andries P. Engelbrecht,et al.  Analysing the performance of dynamic multi-objective optimisation algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[46]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[47]  Lin Li,et al.  Quantum immune clonal coevolutionary algorithm for dynamic multiobjective optimization , 2014, Soft Comput..

[48]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[49]  Aluizio F. R. Araújo,et al.  Generalized immigration schemes for dynamic evolutionary multiobjective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[50]  Haluk Topcuoglu,et al.  A Memory-Based NSGA-II Algorithm for Dynamic Multi-objective Optimization Problems , 2016, EvoApplications.

[51]  Zhuhong Zhang,et al.  Multiobjective optimization immune algorithm in dynamic environments and its application to greenhouse control , 2008, Appl. Soft Comput..

[52]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[53]  Jinhua Zheng,et al.  Achieving balance between proximity and diversity in multi-objective evolutionary algorithm , 2012, Inf. Sci..

[54]  Min Liu,et al.  Novel prediction and memory strategies for dynamic multiobjective optimization , 2014, Soft Computing.

[55]  Shengxiang Yang,et al.  A Steady-State and Generational Evolutionary Algorithm for Dynamic Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[56]  Kay Chen Tan,et al.  Evolutionary Dynamic Multiobjective Optimization Via Kalman Filter Prediction , 2016, IEEE Transactions on Cybernetics.

[57]  Xiangxiang Zeng,et al.  A Stable Matching-Based Selection and Memory Enhanced MOEA/D for Evolutionary Dynamic Multiobjective Optimization , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[58]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[59]  Zhuhong Zhang,et al.  Artificial immune system in dynamic environments solving time-varying non-linear constrained multi-objective problems , 2011, Soft Comput..

[60]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[61]  Duncan A. Campbell,et al.  Multi-Objective Four-Dimensional Vehicle Motion Planning in Large Dynamic Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).