Darwin, Lamarck, or Baldwin: Applying Evolutionary Algorithms to Machine Learning Techniques

Evolutionary Algorithms (EAs), inspired by biological mechanisms observed in nature, such as selection and genetic changes, have much potential to find the best solution for a given optimisation problem. Contrary to Darwin, and according to Lamarck and Baldwin, organisms in natural systems learn to adapt over their lifetime and allow to adjust over generations. Whereas earlier research was rather reserved, more recent research underpinned by the work of Lamarck and Baldwin, finds that these theories have much potential, particularly in upcoming fields such as epigenetics. In this paper, we report on some experiments with different evolutionary algorithms with the purpose to improve the accuracy of data mining methods. We explore whether and to what extent an optimisation goal can be reached through a calculation of certain parameters or attribute weightings by use of such evolutionary strategies. We provide a look at different EAs inspired by the theories of Darwin, Lamarck, and Baldwin, as well as the problem solving methods of certain species. In this paper we demonstrate that the modification of well-established machine learning techniques can be achieved in order to include methods from genetic algorithm theory without extensive programming effort. Our results pave the way for much further research at the cross section of machine learning optimisation techniques and evolutionary algorithm research.

[1]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[2]  Jerzy W. Grzymala-Busse,et al.  A Comparison of Two Approaches to Data Mining from Imbalanced Data , 2004, J. Intell. Manuf..

[3]  Lance D. Chambers,et al.  Practical Handbook of Genetic Algorithms , 1995 .

[4]  G. Simpson.  THE BALDWIN EFFECT , 1953 .

[5]  J. Baldwin.  A New Factor in Evolution , 1896, The American Naturalist.

[6]  John H. Holland,et al.  Outline for a Logical Theory of Adaptive Systems , 1962, JACM.

[7]  Sreeram V Ramagopalan,et al.  Is Lamarckian evolution relevant to medicine? , 2010, BMC Medical Genetics.

[8]  Weixin Xie,et al.  Novel Hybrid Feature Selection Algorithms for Diagnosing Erythemato-Squamous Diseases , 2012, HIS.

[9]  Harry Zhang,et al.  Learning weighted naive Bayes with accurate ranking , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[10]  E. Koonin,et al.  Is evolution Darwinian or/and Lamarckian? , 2009, Biology Direct.

[11]  Paula A. Kiberstis.  All Eyes on Epigenetics , 2012 .

[12]  V. L. Anderson.  Evolutionary Operation : A Method for Increasing Industrial Productivity , 1970 .

[13]  Kennetb A. De.  Genetic Algorithms Are NOT Function Optimizers , 1992 .

[14]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[15]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[16]  Lawrence Davis,et al.  Using a genetic algorithm to optimize problems with feasibility constraints , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[17]  Adrian Bird,et al.  Perceptions of epigenetics , 2007, Nature.

[18]  L. Darrell Whitley,et al.  Lamarckian Evolution, The Baldwin Effect and Function Optimization , 1994, PPSN.

[19]  Brian J. Ross,et al.  A Lamarckian Evolution Strategy for Genetic Algorithms , 1998, Practical Handbook of Genetic Algorithms.

[20]  Andreas Holzinger,et al.  Darwin or Lamarck? Future Challenges in Evolutionary Algorithms for Knowledge Discovery and Data Mining , 2014, Interactive Knowledge Discovery and Data Mining in Biomedical Informatics.

[21]  Frank Klawonn,et al.  Computational Intelligence: A Methodological Introduction , 2015, Texts in Computer Science.

[22]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[23]  Andreas Holzinger,et al.  Functional and genetic analysis of the colon cancer network , 2014, BMC Bioinformatics.

[24]  Yong Shi,et al.  Multi-criteria optimization classifier using fuzzification, kernel and penalty factors for predicting protein interaction hot spots , 2014, Appl. Soft Comput..