Intelligent Systems: Architectures and Perspectives

The integration of different learning and adaptation techniques to overcome individual limitations and to achieve synergetic effects through the hybridization or fusion of these techniques has, in recent years, contributed to a large number of new intelligent system designs. Computational intelligence is an innovative framework for constructing intelligent hybrid architectures involving Neural Networks (NN), Fuzzy Inference Systems (FIS), Probabilistic Reasoning (PR) and derivative free optimization techniques such as Evolutionary Computation (EC). Most of these hybridization approaches, however, follow an ad hoc design methodology, justified by success in certain application domains. Due to the lack of a common framework it often remains difficult to compare the various hybrid systems conceptually and to evaluate their performance comparatively. This chapter introduces the different generic architectures for integrating intelligent systems. The designing aspects and perspectives of different hybrid architectures like NN-FIS, EC-FIS, EC-NN, FIS-PR and NN-FIS-EC systems are presented. Some conclusions are also provided towards the end.

[1]  Oscar Cordón,et al.  On the combination of fuzzy logic and evolutionary computation: a short review and bibliography , 1997 .

[2]  Mathukumalli Vidyasagar,et al.  A Theory of Learning and Generalization , 1997 .

[3]  Andy J. Keane,et al.  Pruning backpropagation neural networks using modern stochastic optimisation techniques , 1997, Neural Computing & Applications.

[4]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[5]  Peter Auer,et al.  Exponentially many local minima for single neurons , 1995, NIPS.

[6]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[7]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[8]  Frank Hoffmann Soft Computing Techniques for the Design of Mobile Robot Behaviors , 2000, Inf. Sci..

[9]  Piero P. Bonissone,et al.  Approximate Reasoning Systems: A Personal Perspective , 1991, AAAI.

[10]  Lakhmi C. Jain,et al.  Neural Network Training Using Genetic Algorithms , 1996 .

[11]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control , 1994 .

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  Ajith Abraham,et al.  IT Impact on New Millennium Manufacturing , 2000 .

[14]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[15]  Ajith Abraham,et al.  Neuro Fuzzy Systems: Sate-of-the-Art Modeling Techniques , 2001, IWANN.

[16]  Kazuo Tanaka,et al.  Successive identification of a fuzzy model and its applications to prediction of a complex system , 1991 .

[17]  Okyay Kaynak,et al.  Computational Intelligence: Soft Computing and Fuzzy-Neuro Integration with Applications , 1998, NATO ASI Series.

[18]  Abraham Kandel,et al.  Hybrid Architectures for Intelligent Systems , 1992 .

[19]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[20]  Isao Hayashi,et al.  Construction of fuzzy inference rules by NDF and NDFL , 1992, Int. J. Approx. Reason..

[21]  Ajith Abraham EvoNF: a framework for optimization of fuzzy inference systems using neural network learning and evolutionary computation , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[22]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition , 1992 .

[23]  Ajith Abraham,et al.  Global Optimisation of Neural Networks Using a Deterministic Hybrid Approach , 2001, HIS.

[24]  Jerry M. Mendel,et al.  Back-propagation fuzzy system as nonlinear dynamic system identifiers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[25]  Shun'ichi Tano,et al.  Operator tuning in fuzzy production rules using neural networks , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[26]  Ebrahim H. Mamdani,et al.  A linguistic self-organizing process controller , 1979, Autom..

[27]  Larry R. Medsker,et al.  Hybrid Intelligent Systems , 1995, Springer US.

[28]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[29]  菅野 道夫,et al.  Industrial applications of fuzzy control , 1985 .

[30]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[31]  Araceli Sanchis,et al.  Evolutionary Cellular Configurations for Designing Feed-Forward Neural Networks Architectures , 2001, IWANN.

[32]  Nadine N. Tschichold-Gürman,et al.  FUN: optimization of fuzzy rule based systems using neural networks , 1993, IEEE International Conference on Neural Networks.

[33]  Nikola Kasabov,et al.  Evolving Connectionist and Fuzzy-Connectionist Systems for On-line Adaptive Decision Making and Control , 1999 .

[34]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[35]  Ajith Abraham,et al.  Optimization of evolutionary neural networks using hybrid learning algorithms , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[36]  Takanori Shibata,et al.  Genetic Algorithms And Fuzzy Logic Systems Soft Computing Perspectives , 1997 .

[37]  Shun'ichi Tano,et al.  FINEST: fuzzy inference environment software with tuning , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[38]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .

[39]  R. K. Jain,et al.  Hybrid Intelligent Engineering Systems , 1997 .

[40]  Nikola Kasabov,et al.  Looking for a new AI paradigm: Evolving connectionist and fuzzy connectionist systems—Theory and applications for adaptive, on-line intelligent systems , 1998 .

[41]  James J. Buckley,et al.  Approximations between fuzzy expert systems and neural networks , 1994, Int. J. Approx. Reason..

[42]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[43]  Nikola Kasabov,et al.  Neuro-Fuzzy Techniques for Intelligent Information Systems , 1999 .

[44]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition , 1999 .

[45]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[46]  Xin Yao,et al.  Making use of population information in evolutionary artificial neural networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[47]  D. Dasgupta Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[48]  V. Cherkassky Fuzzy Inference Systems: A Critical Review , 1998 .

[49]  Marco Russo,et al.  Fuzzy Learning and Applications , 2000 .

[50]  Ronald R. Yager,et al.  Adaptive defuzzification for fuzzy systems modeling , 1992 .

[51]  Paul J. Darwen,et al.  Co-Evolutionary Learning by Automatic Modularisation with Speciation , 1996 .

[52]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[53]  J. Stephen Judd,et al.  Neural network design and the complexity of learning , 1990, Neural network modeling and connectionism.

[54]  X. Yao Evolving Artificial Neural Networks , 1999 .

[55]  Jacek M. Leski,et al.  Fuzzy and Neuro-Fuzzy Intelligent Systems , 2000, Studies in Fuzziness and Soft Computing.

[56]  Philippe Smets,et al.  The degree of belief in a fuzzy event , 1981, Inf. Sci..

[57]  Witold Pedrycz,et al.  Fuzzy evolutionary computation , 1997 .

[58]  W. Pedrycz,et al.  Construction of fuzzy models through clustering techniques , 1993 .

[59]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[60]  Hans-Arno Jacobsen,et al.  A generic architecture for hybrid intelligent systems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[61]  Piero P. Bonissone,et al.  Genetic algorithms for automated tuning of fuzzy controllers: a transportation application , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[62]  Robert Fullér,et al.  Introduction to neuro-fuzzy systems , 1999, Advances in soft computing.

[63]  H. C. Card,et al.  Linguistic interpretation of self-organizing maps , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[64]  Marek J. Patyra,et al.  Book review: Fuzzy logic and Neuro Fuzzy Applications Explained by Constantin von Altrock (Prentice Hall 1995) , 1997, SGAR.

[65]  Robert G. Reynolds,et al.  Evolutionary computation: Towards a new philosophy of machine intelligence , 1997 .

[66]  Lotfi A. Zadeh,et al.  Roles of Soft Computing and Fuzzy Logic in the Conception, Design and Deployment of Information/Intelligent Systems , 1998 .

[67]  Ahmad Lofti Learning fuzzy inference systems , 1995 .

[68]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[69]  Ajith Abraham,et al.  Evolutionary Design of Neuro-Fuzzy Systems - A Generic Framework , 2000 .

[70]  Abraham Kandel,et al.  Neuro-Fuzzy Pattern Recognition , 2000 .

[71]  James J. Buckley,et al.  Fuzzy and Neural: Interactions and Applications , 1999 .

[72]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[73]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[74]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing , 1999 .

[75]  Jonathan Baxter The evolution of learning algorithms for artificial neural networks , 1993 .

[76]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[77]  James C. Bezdek,et al.  Computational Intelligence Defined - By Everyone ! , 1998 .

[78]  Michael Anthony Lee Automatic design and adaptation of fuzzy systems and genetic algorithms using soft computing techniques , 1994 .

[79]  Witold Pedrycz,et al.  Fuzzy sets engineering , 1995 .

[80]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[81]  A. Topchy,et al.  Neural network training by means of cooperative evolutionary search , 1997 .

[82]  Ajith Abraham,et al.  Optimal Design of Neural Nets Using Hybrid Algorithms , 2000, PRICAI.

[83]  B. M. Glover,et al.  Cutting angle methods in global optimization , 1999 .

[84]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[85]  Mandayam A. L. Thathachar,et al.  Local and Global Optimization Algorithms for Generalized Learning Automata , 1995, Neural Computation.

[86]  John M. Zelle,et al.  Growing layers of perceptrons: introducing the Extentron algorithm , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[87]  Terrence L. Fine,et al.  Feedforward Neural Network Methodology , 1999, Information Science and Statistics.

[88]  Antonio González Muñoz,et al.  Multi-stage genetic fuzzy systems based on the iterative rule learning approach , 1997 .

[89]  C. L. Philip Chen,et al.  The equivalence between fuzzy logic systems and feedforward neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[90]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[91]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[92]  N. Ioannidis,et al.  It is time to Fuzzify Neural Networks ! , 2022 .

[93]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[94]  Ajith Abraham,et al.  ALEC: An Adaptive Learning Framework for Optimizing Artificial Neural Networks , 2001, International Conference on Computational Science.

[95]  Ajith Abraham,et al.  FAILURE PREDICTION OF CRITICAL ELECTRONIC SYSTEMS IN POWER PLANTS USING ARTIFICIAL NEURAL NETWORKS , 1999 .

[96]  Shun'ichi Tano,et al.  Deep combination of fuzzy inference and neural network in fuzzy inference software - FINEST , 1996, Fuzzy Sets Syst..