Fuzzy Probability C-Regression Estimation Based on Least Squares Support Vector Machine

The problem of regression estimation for large data set is viewed as a problem of multiple models estimation. In this paper the method of fuzzy probability c-regression based on least squares support vector machine is proposed to classify the multiple models while estimating these models. The algorithm for solving it is also provided. The numerical example is used to illustrate that our approach can be used to fit nonlinear models for mixed data set. The simulation results demonstrate that the method of fuzzy probability c-regression based on least squares support vector machine can discriminate the multiple regression models with a fuzzy partition of data set while fitting perfectly these models and can overcome the problem of initialization that often makes termination occurring at local minima.

[1]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[2]  R. D. Veaux,et al.  Mixtures of linear regressions , 1989 .

[3]  M. Menard,et al.  Switching regression models using ambiguity and distance rejects: application to ionogram analysis , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  Yee Leung,et al.  A New Method for Mining Regression Classes in Large Data Sets , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[7]  Using support vector machines for mining regression classes in large data sets , 2002, 2002 IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering. TENCOM '02. Proceedings..

[8]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[9]  Steven B. Caudill,et al.  Maximum likelihood estimation of a mixture of normal regressions: starting values and singularities , 1998 .