Alternative Fuzzy Switching Regression

paper present an alternative method for fuzzy switching regression analysis. The traditional fuzzy c-regression (FCR) is a method by embedding the fuzzy c-means (FCM) into switching regression. By defining an alternative residual measurement, we modified the fuzzy c-regression (FCR) and proposed an alternative fuzzy c-regression (AFCR). The proposed method is more robust to noise and outlier than the EM and FCR algorithms. Numerical examples show the robustness and superiority of our proposed method. I. INTRODUCTION Regression analysis is used to model the function relation between the independent and dependent variables. Usually, a single regression model is used for fitting a data set. However, the data set may contain more than one regression model, say c regression models. This kind of model fitting is called switching regressions. Quandt [1,2] and Chow [3] initiated the studies of switching regressions. Subsequently, Quandt [4], Quandt and Ramsey [5] and De Veaux [6] considered the mixture of regressions approach to estimating switching regressions that is widely studied and applied in psychology, economics, social science and music perception [7-10]. Hathaway and Bezdek [11] first combined switching regressions with FCM and referred to them as fuzzy c-regressions (FCR). To increase the speed of FCR, Wang et al. [12] combined the concept of Newton's law of gravity with FCR. However, these FCRs are sensitive to noise and outliers. To improve the robustness against noise and outliers, Leski

[1]  R. D. Veaux,et al.  Mixtures of linear regressions , 1989 .

[2]  Lung-fei Lee,et al.  Simulation estimation of dynamic switching regression and dynamic disequilibrium models -- some Monte Carlo results , 1997 .

[3]  J. B. Ramsey,et al.  Estimating Mixtures of Normal Distributions and Switching Regressions , 1978 .

[4]  Gert Cauwenberghs,et al.  Incremental and Decremental Support Vector Machine Learning , 2000, NIPS.

[5]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[6]  Simeon K. Ehui,et al.  Credit constraints and smallholder dairy production in the East African highlands: application of a switching regression model , 1998 .

[7]  R. Quandt Tests of the Hypothesis That a Linear Regression System Obeys Two Separate Regimes , 1960 .

[8]  Jacek M. Leski Epsiv-insensitive Fuzzy C-regression Models: Introduction to Epsiv-insensitive Fuzzy Modeling , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Miin-Shen Yang,et al.  Alternative c-means clustering algorithms , 2002, Pattern Recognit..

[10]  J. Deutsch,et al.  An application of a switching regimes regression to the study of urban structure , 2002 .

[11]  Miin-Shen Yang,et al.  Alternative learning vector quantization , 2006, Pattern Recognit..

[12]  R. Quandt A New Approach to Estimating Switching Regressions , 1972 .

[13]  Khaled Benkrid,et al.  Proceedings of the International MultiConference of Engineers and Computer Scientists, Vol II, IMECS 2009 , 2009 .

[14]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[15]  V. J. Rayward-Smith,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  Georg Peters A linear forecasting model and its application to economic data , 2001 .

[19]  Jongwoo Kim,et al.  A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms , 1999, IEEE Trans. Fuzzy Syst..

[20]  M Jacek -Insensitive Fuzzy -Regression Models: Introduction to -Insensitive Fuzzy Modeling , 2004 .

[21]  Miin-Shen Yang A survey of fuzzy clustering , 1993 .

[22]  Hongjun Lu,et al.  A New Integrated Clustering Algorithm GFC and Switching Regressions , 2002, Int. J. Pattern Recognit. Artif. Intell..

[23]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jian Yu,et al.  Alpha-Cut Implemented Fuzzy Clustering Algorithms and Switching Regressions , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Jian Yu,et al.  Optimality test for generalized FCM and its application to parameter selection , 2005, IEEE Transactions on Fuzzy Systems.

[26]  Palma Blonda,et al.  A survey of fuzzy clustering algorithms for pattern recognition. I , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[27]  R. Quandt The Estimation of the Parameters of a Linear Regression System Obeying Two Separate Regimes , 1958 .