Advances and Challenges on Intelligent Learning in Control Systems

Although there are many interesting and emerging technologies in the specialized area of intelligent learning in control systems, this chapter is devoted to four significant technical areas: reinforcement learning (RL), evolutionary learning control (ELC) using evolutionary algorithms (EAs), intelligent learning control, and learning via case-based reasoning (CBR). The resolving framework about reinforcement learning is well recognized as a machine learning paradigm especially well-suited to learning action policies for mobile robots. The chapter presents some experimental results from applying this framework to a mobile robot control task: behavior learning of soccer robots. The chapter discusses some stable intelligent learning approaches using Lyapunov stability theory for various fuzzy-neural-networks (FNN) control systems. CBR is a decision-making and learning method widely used in artificial intelligence. The purpose of using CBR is to provide a way to accumulate past experiences for future use, and CBR is sometimes considered as using analogy to solve problems.

[1]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[2]  Kalyanmoy Deb,et al.  Optimal path and gait generations simultaneously of a six-legged robot using a GA-fuzzy approach , 2002, Robotics Auton. Syst..

[3]  Chia-Feng Juang,et al.  Ant Colony Optimization Incorporated With Fuzzy Q-Learning for Reinforcement Fuzzy Control , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Chuan-Kai Lin,et al.  Adaptive critic autopilot design of Bank-to-turn missiles using fuzzy basis function networks , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Yang-Yin Lin,et al.  A Recurrent Self-Evolving Interval Type-2 Fuzzy Neural Network for Dynamic System Processing , 2009, IEEE Transactions on Fuzzy Systems.

[6]  C.-K. Lin,et al.  Nonsingular Terminal Sliding Mode Control of Robot Manipulators Using Fuzzy Wavelet Networks , 2006, IEEE Transactions on Fuzzy Systems.

[7]  Chi-Huang Lu,et al.  Design and Application of Stable Predictive Controller Using Recurrent Wavelet Neural Networks , 2009, IEEE Transactions on Industrial Electronics.

[8]  Kao-Shing Hwang,et al.  A Modular Agent Architecture for an Autonomous Robot , 2009, IEEE Transactions on Instrumentation and Measurement.

[9]  Minoru Asada,et al.  Efficient Behavior Learning Based on State Value Estimation of Self and Others , 2008, Adv. Robotics.

[10]  Anthony J. Calise,et al.  Adaptive output feedback control of uncertain nonlinear systems using single-hidden-layer neural networks , 2002, IEEE Trans. Neural Networks.

[11]  Juan M. Corchado,et al.  Reducing the Memory Size of a Fuzzy Case-Based Reasoning System Applying Rough Set Techniques , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[13]  Chia-Feng Juang,et al.  Reinforcement Ant Optimized Fuzzy Controller for Mobile-Robot Wall-Following Control , 2009, IEEE Transactions on Industrial Electronics.

[14]  Cristina Urdiales,et al.  Pure reactive behavior learning using Case Based Reasoning for a vision based 4-legged robot , 2009, Robotics Auton. Syst..

[15]  Chi-Huang Lu,et al.  Wavelet Fuzzy Neural Networks for Identification and Predictive Control of Dynamic Systems , 2011, IEEE Transactions on Industrial Electronics.

[16]  David E. Orin,et al.  Generating high-speed dynamic running gaits in a quadruped robot using an evolutionary search , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Magdalena D. Bugajska,et al.  An Architecture for Adaptive Algorithmic Hybrids , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Jorge Casillas,et al.  Quick Design of Fuzzy Controllers With Good Interpretability in Mobile Robotics , 2007, IEEE Transactions on Fuzzy Systems.

[19]  Chih-Min Lin,et al.  A Novel Adaptive Wavelet Fuzzy Cerebellar Model Articulation Control System Design for Voice Coil Motors , 2012, IEEE Transactions on Industrial Electronics.

[20]  Yaonan Wang,et al.  Recurrent Fuzzy Cerebellar Model Articulation Controller and Its Application on Robotic Tracking Control , 2009, 2009 WRI Global Congress on Intelligent Systems.

[21]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[22]  Huaguang Zhang,et al.  A fuzzy basis function vector-based multivariable adaptive controller for nonlinear systems , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Kok Kiong Tan,et al.  Adaptive backstepping control for a class of nonlinear systems using neural network approximations , 2004 .

[24]  Padraig Cunningham,et al.  Hierarchical Case-Based Reasoning Integrating Case-Based and Decompositional Problem-Solving Techniques for Plant-Control Software Design , 2001, IEEE Trans. Knowl. Data Eng..

[25]  Shinn-Ying Ho,et al.  Designing structure-specified mixed H/sub 2//H/sub /spl infin// optimal controllers using an intelligent genetic algorithm IGA , 2005, IEEE Transactions on Control Systems Technology.

[26]  Padraig Cunningham,et al.  A Taxonomy of Similarity Mechanisms for Case-Based Reasoning , 2009, IEEE Transactions on Knowledge and Data Engineering.

[27]  Xinghuo Yu,et al.  Sliding-Mode Control With Soft Computing: A Survey , 2009, IEEE Transactions on Industrial Electronics.

[28]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[30]  Feng Zhou,et al.  A Case-Driven Ambient Intelligence System for Elderly in-Home Assistance Applications , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Rong-Jong Wai,et al.  Hybrid control using recurrent fuzzy neural network for linear induction motor servo drive , 2001, IEEE Trans. Fuzzy Syst..

[32]  Ralph Bergmann,et al.  DOI: 10.1017/S000000000000000 Printed in the United Kingdom Representation in case-based reasoning , 2022 .

[33]  Kao-Shing Hwang,et al.  Smooth trajectory tracking of three-link robot: a self-organizing CMAC approach , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[34]  Manuela M. Veloso,et al.  A case-based approach for coordinated action selection in robot soccer , 2009, Artif. Intell..

[35]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[36]  Zwe-Lee Gaing,et al.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004 .

[37]  Fumio Harashima,et al.  State-of-the-Art Intelligent Mechatronics in Human–Machine Interaction [Guest Introduction] , 2010 .

[38]  Chia-Feng Juang,et al.  Designing Fuzzy-Rule-Based Systems Using Continuous Ant-Colony Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[39]  Chia-Feng Juang,et al.  Evolving Gaits of a Hexapod Robot by Recurrent Neural Networks With Symbiotic Species-Based Particle Swarm Optimization , 2011, IEEE Transactions on Industrial Electronics.

[40]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[41]  Renato A. Krohling,et al.  Design of optimal disturbance rejection PID controllers using genetic algorithms , 2001, IEEE Trans. Evol. Comput..

[42]  Chia-Feng Juang,et al.  Evolutionary-Group-Based Particle-Swarm-Optimized Fuzzy Controller With Application to Mobile-Robot Navigation in Unknown Environments , 2011, IEEE Transactions on Fuzzy Systems.

[43]  Alan Liu,et al.  A goal-driven approach for service request modeling , 2010 .

[44]  Ulises Cortés,et al.  Assistive technologies for the new generation of senior citizens: the SHARE-it approach , 2010, Int. J. Comput. Heal..