Engineering Evolutionary Intelligent Systems: Methodologies, Architectures and Reviews

Designing intelligent paradigms using evolutionary algorithms is getting popular due to their capabilities in handling several real world problems involving complexity, noisy environment, imprecision, uncertainty and vagueness. In this Chapter, we illustrate the various possibilities for designing intelligent systems using evolutionary algorithms and also present some of the generic evolutionary design architectures that has evolved during the last couple of decades. We also provide a review of some of the recent interesting evolutionary intelligent system frameworks reported in the literature.

[1]  Alessandro Saffiotti,et al.  Fuzzy Logic Techniques for Autonomous Vehicle Navigation , 2001 .

[2]  Dr. David W. Pearson,et al.  Artificial Neural Nets and Genetic Algorithms , 1995, Springer Vienna.

[3]  Ajith Abraham,et al.  Web usage mining using artificial ant colony clustering and linear genetic programming , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Kyoung-jae Kim.  Artificial neural networks with evolutionary instance selection for financial forecasting , 2006, Expert Syst. Appl..

[5]  Frédéric Gruau,et al.  Genetic synthesis of Boolean neural networks with a cell rewriting developmental process , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[6]  Jonathan Baxter.  The evolution of learning algorithms for artificial neural networks , 1993 .

[7]  Carsten Franke,et al.  Development of scheduling strategies with Genetic Fuzzy systems , 2008, Appl. Soft Comput..

[8]  Sung-Bae Cho,et al.  Evolved neural networks based on cellular automata for sensory-motor controller , 2006, Neurocomputing.

[9]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[10]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  Ajith Abraham.  i-Miner: a Web usage mining framework using hierarchical intelligent systems , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[13]  Chia-Feng Juang,et al.  Recurrent fuzzy network design using hybrid evolutionary learning algorithms , 2007, Neurocomputing.

[14]  Andy J. Keane,et al.  Pruning backpropagation neural networks using modern stochastic optimisation techniques , 1997, Neural Computing & Applications.

[15]  Risto Miikkulainen,et al.  Forming Neural Networks Through Efficient and Adaptive Coevolution , 1997, Evolutionary Computation.

[16]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..

[17]  Robert F. Port,et al.  Fractally configured neural networks , 1991, Neural Networks.

[18]  Sam Kwong,et al.  Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection , 2007, Pattern Recognition.

[19]  Juan Julián Merelo Guervós,et al.  Comparing evolutionary hybrid systems for design and optimization of multilayer perceptron structure along training parameters , 2007, Inf. Sci..

[20]  L. Yi-Hui,et al.  Evolutionary neural network modeling for forecasting the field failure data of repairable systems , 2007, Expert Syst. Appl..

[21]  Omer Kelesoglu,et al.  Fuzzy multiobjective optimization of truss-structures using genetic algorithm , 2007, Adv. Eng. Softw..

[22]  Lior Rokach,et al.  Clustering Methods , 2005, The Data Mining and Knowledge Discovery Handbook.

[23]  Ajith Abraham,et al.  Evolutionary Multiobjective Optimization Approach for Evolving Ensemble of Intelligent Paradigms for Stock Market Modeling , 2005, MICAI.

[24]  Adel M. Alimi,et al.  The design of beta basis function neural network and beta fuzzy systems by a hierarchical genetic algorithm , 2005, Fuzzy Sets Syst..

[25]  Werner von Seelen,et al.  Evaluating flexible fuzzy controllers via evolution strategies , 1999, Fuzzy Sets Syst..

[26]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[27]  H. P. Schwefel,et al.  Numerische Optimierung von Computermodellen mittels der Evo-lutionsstrategie , 1977 .

[28]  Ajith Abraham,et al.  Computational intelligence to model the export behavior of multinational corporation subsidiaries in Malaysia: Special Topic Section on Knowledge Management in Asia , 2005 .

[29]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[30]  Chi-Ming Lin,et al.  Multiobjective fuzzy competence set expansion problem by multistage decision-based hybrid genetic algorithms , 2006, Appl. Math. Comput..

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Xin Yao,et al.  Evolutionary design of artificial neural networks with different nodes , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[33]  Nian Zhang,et al.  Time series prediction with recurrent neural networks trained by a hybrid PSO-EA algorithm , 2004, Neurocomputing.

[34]  Witold Kosinski.  Evolutionary algorithm determining defuzzyfication operators , 2007, Eng. Appl. Artif. Intell..

[35]  Bo Yang,et al.  Automatic Design of Hierarchical Takagi–Sugeno Type Fuzzy Systems Using Evolutionary Algorithms , 2007, IEEE Transactions on Fuzzy Systems.

[36]  Pandian Vasant,et al.  Meta-Learning Evolutionary Artificial Neural Network for Selecting Flexible Manufacturing Systems , 2006, ISNN.

[37]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[38]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[39]  Araceli Sanchis,et al.  Evolutionary Cellular Configurations for Designing Feed-Forward Neural Networks Architectures , 2001, IWANN.

[40]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[41]  Jiwen Dong,et al.  Time-series forecasting using flexible neural tree model , 2005, Inf. Sci..

[42]  Masoud Mohammadian,et al.  Generating fuzzy rules by genetic algorithms , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[43]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[44]  Kenji Doya,et al.  Evolution of recurrent neural controllers using an extended parallel genetic algorithm , 2005, Robotics Auton. Syst..

[45]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[46]  Ranjan Ganguli,et al.  Genetic fuzzy system for online structural health monitoring of composite helicopter rotor blades , 2007 .

[47]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[48]  M. Sugeno,et al.  Derivation of Fuzzy Control Rules from Human Operator's Control Actions , 1983 .

[49]  Ajith Abraham,et al.  SEARCH OPTIMIZATION USING HYBRID PARTICLE SUB- SWARMS AND EVOLUTIONARY ALGORITHMS , 2005 .

[50]  Ginalber Luiz de Oliveira Serra,et al.  Multiobjective evolution based fuzzy PI controller design for nonlinear systems , 2006, Eng. Appl. Artif. Intell..

[51]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[52]  Frank Pettersson,et al.  A genetic algorithms based multi-objective neural net applied to noisy blast furnace data , 2007, Appl. Soft Comput..

[53]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[54]  Witold Pedrycz,et al.  Fuzzy evolutionary computation , 1997 .

[55]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[56]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[57]  Ron Meir,et al.  Evolving a learning algorithm for the binary perceptron , 1991 .

[58]  Daehie Hong,et al.  GA-based fuzzy controller design for tunnel ventilation systems , 2005 .

[59]  Rudolf F. Albrecht,et al.  Artificial Neural Nets and Genetic Algorithms , 1995, Springer Vienna.

[60]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[61]  Fabio Massimo Frattale Mascioli,et al.  A constructive algorithm for binary neural networks: the oil-spot algorithm , 1995, IEEE Trans. Neural Networks.

[62]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[63]  Antonio González Muñoz,et al.  Multi-stage genetic fuzzy systems based on the iterative rule learning approach , 1997 .

[64]  Tshilidzi Marwala,et al.  Bayesian Training of Neural Networks Using Genetic Programming , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[65]  H. Ishibuchi.  Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[66]  Seok-Beom Roh,et al.  Genetically optimized fuzzy polynomial neural networks with fuzzy set-based polynomial neurons , 2006, Inf. Sci..

[67]  Maria del Carmen Pegalajar Jiménez,et al.  A multiobjective genetic algorithm for obtaining the optimal size of a recurrent neural network for grammatical inference , 2005, Pattern Recognit..

[68]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[69]  Brad Fullmer and Risto Miikkulainen.  Using Marker-Based Genetic Encoding Of Neural Networks To Evolve Finite-State Behaviour , 1991 .

[70]  C. L. Giles,et al.  Pruning recurrent neural networks for improved generalization performance , 1994, Proceedings of IEEE Workshop on Neural Networks for Signal Processing.

[71]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[72]  Jacques Periaux,et al.  Genetic Algorithms in Engineering and Computer Science , 1996 .

[73]  Sung-Kwun Oh,et al.  Evolutionary design of hybrid self-organizing fuzzy polynomial neural networks with the aid of information granulation , 2007, Expert Syst. Appl..

[74]  César Hervás-Martínez,et al.  Multi-objective cooperative coevolution of artificial neural networks (multi-objective cooperative networks) , 2002, Neural Networks.

[75]  Ajith Abraham.  EvoNF: a framework for optimization of fuzzy inference systems using neural network learning and evolutionary computation , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[76]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[77]  Donald A. Waterman,et al.  Pattern-Directed Inference Systems , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[79]  Francisco Herrera,et al.  Tuning fuzzy logic controllers by genetic algorithms , 1995, Int. J. Approx. Reason..

[80]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[81]  John H. Holland,et al.  COGNITIVE SYSTEMS BASED ON ADAPTIVE ALGORITHMS1 , 1978 .