A robust learning algorithm based on support vector regression and robust fuzzy cerebellar model articulation controller

Abstract For real-world applications, the obtained data are always subject to noise or outliers. The learning mechanism of cerebellar model articulation controller (CMAC), a neurological model, is to imitate the cerebellum of human being. CMAC has an attractive property of learning speed in which a small subset addressed by the input space determines output instantaneously. For fuzzy cerebellar model articulation controller (FCMAC), the concept of fuzzy is incorporated into CMAC to improve the accuracy problem. However, the distributions of errors into the addressed hypercubes may cause unacceptable learning performance for input data with noise or outliers. For robust fuzzy cerebellar model articulation controller (RFCMAC), the robust learning of M-estimator can be embedded into FCMAC to degrade noise or outliers. Meanwhile, support vector machine (SVR) is a machine learning theory based algorithm which has been applied successfully to a number of regression problems when noise or outliers exist. Unfortunately, the practical application of SVR is limited to defining a set of parameters for obtaining admirable performance by the user. In this paper, a robust learning algorithm based on support SVR and RFCMAC is proposed. The proposed algorithm has both the advantage of SVR, the ability to avoid corruption effects, and the advantage of RFCMAC, the ability to obtain attractive properties of learning performance and to increase accurate approximation. Additionally, particle swarm optimization (PSO) is applied to obtain the best parameters setting for SVR. From simulation results, it shows that the proposed algorithm outperforms other algorithms.

[1]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[2]  Zne-Jung Lee,et al.  Robust and fast learning for fuzzy cerebellar model articulation controllers , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Shun-Feng Su,et al.  Credit assigned CMAC and its application to online learning robust controllers , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Jin-Tsong Jeng,et al.  Hybrid approach of selecting hyperparameters of support vector machine for regression , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Neil E. Cotter,et al.  The CMAC and a theorem of Kolmogorov , 1992, Neural Networks.

[8]  L. Buydens,et al.  Determination of optimal support vector regression parameters by genetic algorithms and simplex optimization , 2005 .

[9]  Youji Iiguni Hierarchical image coding via cerebellar model arithmetic computers , 1996, IEEE Trans. Image Process..

[10]  Patrick C. Parks,et al.  A comparison of five algorithms for the training of CMAC memories for learning control systems , 1992, Autom..

[11]  Petri Koistinen,et al.  Using additive noise in back-propagation training , 1992, IEEE Trans. Neural Networks.

[12]  G. Horvath,et al.  CMAC neural network as an SVM with B-spline kernel functions , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[13]  Zhiming Wu,et al.  An effective hybrid optimization approach for multi-objective flexible job-shop scheduling problems , 2005, Comput. Ind. Eng..

[14]  Chun-Shin Lin,et al.  Learning convergence of CMAC technique , 1997, IEEE Trans. Neural Networks.

[15]  Theodore B. Trafalis,et al.  Robust classification and regression using support vector machines , 2006, Eur. J. Oper. Res..

[16]  Chao-Ming Huang,et al.  A particle swarm optimization to identifying the ARMAX model for short-term load forecasting , 2005 .

[17]  Robert O. Shelton,et al.  Controlling a truck with an adaptive critic CMAC design , 1992, Simul..

[18]  Jerry E. Pratt,et al.  Stable adaptive control of a bipedal walking; robot with CMAC neural networks , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  K. M. Sim,et al.  Guest Editorial Special Issue on Game-Theoretic Analysis and Stochastic Simulation of Negotiation Agents , 2006 .

[20]  Cheng-Jian Lin,et al.  A self-constructing fuzzy CMAC model and its applications , 2007, Inf. Sci..

[21]  Zne-Jung Lee,et al.  A genetic algorithm based robust learning credit assignment cerebellar model articulation controller , 2004, Appl. Soft Comput..

[22]  Song-Shyong Chen,et al.  Robust TSK fuzzy modeling for function approximation with outliers , 2001, IEEE Trans. Fuzzy Syst..

[23]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[24]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[25]  A. Sideris,et al.  Learning convergence in the cerebellar model articulation controller , 1992, IEEE Trans. Neural Networks.

[26]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[27]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[28]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[29]  Kao-Shing Hwang,et al.  Smooth trajectory tracking of three-link robot: a self-organizing CMAC approach , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[30]  James S. Albus,et al.  Data Storage in the Cerebellar Model Articulation Controller (CMAC) , 1975 .

[31]  Se-Young Oh,et al.  Real-Time Dynamic Visual Tracking Using PSD Sensors and Extended Trapezoidal Motion Planning , 2004, Applied Intelligence.