From Evolutionary Computation to Natural Computation

Evolutionary computation has enjoyed a tremendous growth in more than a decade in both its theoretical foundations and industrial applications. Its scope has gone beyond its earlier meaning of “genetic evolution”. Many research topics in evolutionary computation nowadays are not necessarily “evolutionary” in any sense. There is a need for studying a wide variety of nature inspired computational algorithms and techniques, including evolutionary, neural, ecological computation, etc., in a unified framework This paper gives an overview of some work that has been going on in the Natural Computation Group at The University of Birmingham, UK. It covers topics in optimisation, learning and design using nature inspired algorithms and techniques. Some recent theoretical results in the computational time complexity of evolutionary and neural optimisation algorithms will also be mentioned.

[1]  D. Fogel.  Applying evolutionary programming to selected traveling salesman problems , 1993 .

[2]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[3]  Xin Yao,et al.  Evolutionary computation : theory and applications , 1999 .

[4]  Harris Drucker,et al.  Boosting and Other Ensemble Methods , 1994, Neural Computation.

[5]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[6]  David B. Fogel,et al.  System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[7]  Xin Yao,et al.  A new simulated annealing algorithm , 1995, Int. J. Comput. Math..

[8]  Xin Yao,et al.  Digital filter design using multiple pareto fronts , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[9]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[10]  David B. Fogel,et al.  Evolving artificial intelligence , 1992 .

[11]  H. Szu.  Fast simulated annealing , 1987 .

[12]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[13]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[15]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[16]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[17]  Xin Yao,et al.  Making use of population information in evolutionary artificial neural networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[18]  L. Ingber.  Very fast simulated re-annealing , 1989 .

[19]  Michael I. Jordan,et al.  Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks , 1990, Cogn. Sci..

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  Thomas Bäck,et al.  An Overview of Evolutionary Computation , 1993, ECML.

[22]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[23]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[24]  Xin Yao,et al.  Drift analysis and average time complexity of evolutionary algorithms , 2001, Artif. Intell..

[25]  Xin Yao,et al.  A cooperative ensemble learning system , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[26]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[27]  Xin Yao,et al.  Simultaneous training of negatively correlated neural networks in an ensemble , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[28]  Xin Yao,et al.  Towards Designing Neural Network Ensembles by Evolution , 1998, PPSN.

[29]  C. H. Edwards,et al.  Calculus with analytic geometry , 1994 .