Robust neurofuzzy rule base knowledge extraction and estimation using subspace decomposition combined with regularization and D-optimality

A new robust neurofuzzy model construction algorithm has been introduced for the modeling of a priori unknown dynamical systems from observed finite data sets in the form of a set of fuzzy rules. Based on a Takagi-Sugeno (T-S) inference mechanism a one to one mapping between a fuzzy rule base and a model matrix feature subspace is established. This link enables rule based knowledge to be extracted from matrix subspace to enhance model transparency. In order to achieve maximized model robustness and sparsity, a new robust extended Gram-Schmidt (G-S) method has been introduced via two effective and complementary approaches of regularization and D-optimality experimental design. Model rule bases are decomposed into orthogonal subspaces, so as to enhance model transparency with the capability of interpreting the derived rule base energy level. A locally regularized orthogonal least squares algorithm, combined with a D-optimality used for subspace based rule selection, has been extended for fuzzy rule regularization and subspace based information extraction. By using a weighting for the D-optimality cost function, the entire model construction procedure becomes automatic. Numerical examples are included to demonstrate the effectiveness of the proposed new algorithm.

[1]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[2]  Xia Hong,et al.  A neurofuzzy network knowledge extraction and extended Gram-Schmidt algorithm for model subspace decomposition , 2003, IEEE Trans. Fuzzy Syst..

[3]  Sheng Chen,et al.  Sparse kernel regression modeling using combined locally regularized orthogonal least squares and D-optimality experimental design , 2003, IEEE Trans. Autom. Control..

[4]  Xia Hong,et al.  Nonlinear model structure design and construction using orthogonal least squares and D-optimality design , 2002, IEEE Trans. Neural Networks.

[5]  H. Akaike A new look at the statistical model identification , 1974 .

[6]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[7]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[8]  Sheng Chen,et al.  Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks , 1999, IEEE Trans. Neural Networks.

[9]  Kevin Martin Bossley,et al.  Neurofuzzy modelling approaches in system identification , 1997 .

[10]  Sheng Chen,et al.  Local regularization assisted orthogonal least squares regression , 2006, Neurocomputing.

[11]  Magne Setnes,et al.  Compact and transparent fuzzy models and classifiers through iterative complexity reduction , 2001, IEEE Trans. Fuzzy Syst..

[12]  Mark J. L. Orr,et al.  Regularization in the Selection of Radial Basis Function Centers , 1995, Neural Computation.

[13]  C. Harris,et al.  Modelling and control of nonlinear, operating point dependent systems via associative memory networks , 1996 .

[14]  Martin Brown,et al.  Network Performance Assessment for Neurofuzzy Data Modelling , 1997, IDA.

[15]  M. Feng,et al.  Adaptive neurofuzzy control for a class of state-dependent nonlinear processes , 1998, Int. J. Syst. Sci..

[16]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[17]  Xia Hong,et al.  Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach , 2002, Advanced information processing.

[18]  Xia Hong,et al.  Nonlinear model structure detection using optimum experimental design and orthogonal least squares , 2001, IEEE Trans. Neural Networks.

[19]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[20]  W. Näther Optimum experimental designs , 1994 .

[21]  Kazuo Tanaka,et al.  Model construction, rule reduction, and robust compensation for generalized form of Takagi-Sugeno fuzzy systems , 2001, IEEE Trans. Fuzzy Syst..

[22]  Donald W. Marquaridt Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation , 1970 .

[23]  Xia Hong,et al.  Adaptive Modelling, Estimation and Fusion from Data , 2002, Advanced Information Processing.

[24]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Roderick Murray-Smith,et al.  Multiple Model Approaches to Modelling and Control , 1997 .

[26]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[27]  Paul Dierckx,et al.  Curve and surface fitting with splines , 1994, Monographs on numerical analysis.

[28]  C J Harris,et al.  Sparse Kernel Regression Modelling using combined locally regularised orthogonal least squares and D-Optimality , 2003 .

[29]  Martin Brown,et al.  Neurofuzzy adaptive modelling and control , 1994 .