A k-hyperplane-based neural network for non-linear regression

For the time series prediction problem, the relationship between the abstracted independent variables and the response variable is usually strong non-linear. We propose a neural network fusion model based on k-hyperplanes for non-linear regression. A k-hyperplane clustering algorithm is developed to split the data to several clusters. The experiments are done on an artificial time series, and the convergence of k-hyperplane clustering algorithm and neural network gradient training algorithm is examined. The dimension of inputs affect the clustering performance very much. Neural network fusion can get some compensation in performance. It is shown that the prediction performance of the model for the time series is very good. The model can be further exploited for many real applications.

[1]  Y. Takefuji,et al.  Design of parallel distributed Cauchy machines , 1989, International 1989 Joint Conference on Neural Networks.

[2]  Chiang Kao,et al.  A fuzzy linear regression model with better explanatory power , 2002, Fuzzy Sets Syst..

[3]  Sabyasachi Ghoshray,et al.  A linear regression model using triangular fuzzy number coefficients , 1999, Fuzzy Sets Syst..

[4]  Phil Diamond,et al.  Fuzzy least squares , 1988, Inf. Sci..

[5]  Hsien-Chung Wu Linear regression analysis for fuzzy input and output data using the extension principle , 2003 .

[6]  P. Diamond,et al.  Extended fuzzy linear models and least squares estimates , 1997 .

[7]  Masatoshi Sakawa,et al.  Multiobjective fuzzy linear regression analysis for fuzzy input-output data , 1992 .

[8]  Hideo Tanaka,et al.  Interval regression analysis by quadratic programming approach , 1998, IEEE Trans. Fuzzy Syst..

[9]  Ping-Teng Chang,et al.  A generalized fuzzy weighted least-squares regression , 1996, Fuzzy Sets Syst..

[10]  Abraham Kandel,et al.  General fuzzy least squares , 1997, Fuzzy Sets Syst..

[11]  Dug Hun Hong,et al.  Interval regression analysis using quadratic loss support vector machine , 2005, IEEE Transactions on Fuzzy Systems.

[12]  Witold Pedrycz,et al.  Evaluation of fuzzy linear regression models , 1991 .

[13]  Liang-Hsuan Chen,et al.  Fuzzy Regression Models Using the Least-Squares Method Based on the Concept of Distance , 2009, IEEE Transactions on Fuzzy Systems.

[14]  Miin-Shen Yang,et al.  On cluster-wise fuzzy regression analysis , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Wolfgang Näther,et al.  Linear Regression with Random Fuzzy Variables: Extended Classical Estimates, Best Linear Estimates, Least Squares Estimates , 1998, Inf. Sci..

[16]  J. Watada,et al.  Possibilistic linear systems and their application to the linear regression model , 1988 .

[17]  William H. Woodall,et al.  Properties of certain fuzzy linear regression methods , 1994 .

[18]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[19]  Jung-Hsien Chiang,et al.  Fuzzy Regression Analysis by Support Vector Learning Approach , 2008, IEEE Transactions on Fuzzy Systems.

[20]  Berlin Wu,et al.  A new approach to fuzzy regression models with application to business cycle analysis , 2002, Fuzzy Sets Syst..

[21]  Georg Peters Fuzzy linear regression with fuzzy intervals , 1994 .

[22]  Ram R. Bishu,et al.  Evaluation of fuzzy linear regression models by comparing membership functions , 1998, Fuzzy Sets Syst..

[23]  Chiang Kao,et al.  Least-squares estimates in fuzzy regression analysis , 2003, Eur. J. Oper. Res..

[24]  Y. Chen,et al.  The Hybrid Fuzzy Least-Squares Regression Approach to Modeling Manufacturing Processes , 2008, IEEE Transactions on Fuzzy Systems.

[25]  Ebrahim Nasrabadi,et al.  A mathematical-programming approach to fuzzy linear regression analysis , 2004, Appl. Math. Comput..

[26]  Kai-Yuan Cai,et al.  Fuzzy nonlinear regression with fuzzified radial basis function network , 2005, IEEE Transactions on Fuzzy Systems.