Simulated Evolution and Learning

This paper addresses maximum likelihood (ML) estimation based model fitting in the context of extrasolar planet detection. This problem is featured by the following properties: (1) the candidate models under consideration are highly nonlinear; (2) the likelihood surface has a huge number of peaks; (3) the parameter space ranges in size from a few to dozens of dimensions. These properties make the ML search a very challenging problem, as it lacks any analytical or gradient based searching solution to explore the parameter space. A population based searching method, called estimation of distribution algorithm (EDA), is adopted to explore the model parameter space starting from a batch of random locations. EDA is featured by its ability to reveal and utilize problem structures. This property is desirable for characterizing the detections. However, it is well recognized that EDAs can not scale well to large scale problems, as it consists of iterative random sampling and model fitting procedures, which results in the well-known dilemma curse of dimensionality. A novel mechanism to perform EDAs in interactive random subspaces spanned by correlated variables is proposed and the hope is to alleviate the curse of dimensionality for EDAs by performing the operations of sampling and model fitting in lower dimensional subspaces. The effectiveness of the proposed algorithm is verified via both benchmark numerical studies and real data analysis.

[1]  Qingfu Zhang,et al.  An Intelligent Multi-Restart Memetic Algorithm for Box Constrained Global Optimisation , 2013, Evolutionary Computation.

[2]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Hilan Bensusan,et al.  Tell me who can learn you and I can tell you who you are: Landmarking Various Learning Algorithms , 2000 .

[4]  Kalyanmoy Deb,et al.  Analyzing Deception in Trap Functions , 1992, FOGA.

[5]  Mario Köppen,et al.  Evolution of Developmental Timing for Solving Hierarchically Dependent Deceptive Problems , 2014, SEAL.

[6]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Qingfu Zhang,et al.  Approximating the Set of Pareto-Optimal Solutions in Both the Decision and Objective Spaces by an Estimation of Distribution Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Witold Pedrycz,et al.  Learning of Fuzzy Cognitive Maps Using Density Estimate , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Aimin Zhou,et al.  A Multiobjective Evolutionary Algorithm Based on Decomposition and Preselection , 2015, BIC-TA.

[10]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[11]  Nikolaus Hansen,et al.  Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[12]  Andrei Lihu,et al.  Real-Valued Genetic Algorithms with Disagreements , 2011, NICSO.

[13]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[14]  Donald F. Towsley,et al.  On distinguishing between Internet power law topology generators , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[15]  Maoguo Gong,et al.  A multi-objective optimization framework for ill-posed inverse problems , 2016, CAAI Trans. Intell. Technol..

[16]  Dirk Thierens,et al.  More concise and robust linkage learning by filtering and combining linkage hierarchies , 2013, GECCO '13.

[17]  Dirk Thierens,et al.  Mixing in Genetic Algorithms , 1993, ICGA.

[18]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[19]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[20]  Liangpei Zhang,et al.  Adaptive Multiobjective Memetic Fuzzy Clustering Algorithm for Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Tian-Li Yu,et al.  Optimization by Pairwise Linkage Detection, Incremental Linkage Set, and Restricted / Back Mixing: DSMGA-II , 2015, GECCO.

[22]  E. D. Weinberger,et al.  The NK model of rugged fitness landscapes and its application to maturation of the immune response. , 1989, Journal of theoretical biology.

[23]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[24]  Zhen-quan Zhuang,et al.  Multi-objective Q-bit Coding Genetic Algorithm for Hardware-Software Co-synthesis of Embedded Systems , 2006, SEAL.

[25]  John E. Beasley,et al.  A Genetic Algorithm for the Multidimensional Knapsack Problem , 1998, J. Heuristics.

[26]  Mario A. Muñoz,et al.  ICARUS: Identification of complementary algorithms by uncovered sets , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[27]  Ender Özcan,et al.  A case study of memetic algorithms for constraint optimization , 2009, Soft Comput..

[28]  Carlos M. Fonseca,et al.  On the performance of linkage-tree genetic algorithms for the multidimensional knapsack problem , 2014, Neurocomputing.

[29]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[30]  Maoguo Gong,et al.  Natural and Remote Sensing Image Segmentation Using Memetic Computing , 2010, IEEE Computational Intelligence Magazine.

[31]  G. Harik Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[32]  David E. Goldberg,et al.  Hierarchical Problem Solving and the Bayesian Optimization Algorithm , 2000, GECCO.

[33]  Qingfu Zhang,et al.  A decomposition based multiobjective evolutionary algorithm with classification , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[34]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[35]  Kwang-Baek Kim,et al.  An Intelligent System for Container Image Recognition Using ART2-Based Self-organizing Supervised Learning Algorithm , 2006, SEAL.

[36]  Kaori Yoshida,et al.  Genetic clustering based on segregation distortion caused by selfish genes , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[37]  Martin Pelikan,et al.  An introduction and survey of estimation of distribution algorithms , 2011, Swarm Evol. Comput..

[38]  Yang Lou,et al.  Sequential Learnable Evolutionary Algorithm: A Research Program , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[39]  Witold Pedrycz,et al.  A Competent Memetic Algorithm for Learning Fuzzy Cognitive Maps , 2015, IEEE Transactions on Fuzzy Systems.

[40]  Dirk Thierens,et al.  Hierarchical problem solving with the linkage tree genetic algorithm , 2013, GECCO '13.

[41]  S. Kabanikhin Definitions and examples of inverse and ill-posed problems , 2008 .