Sequential Extraction of Fuzzy Regression Models: Least Squares and Least absolute Deviations

Fuzzy c-regression models are known to be useful in real applications, but there are two drawbacks: strong dependency on the predefined number of clusters and sensitiveness against outliers or noises. To avoid these drawbacks, we propose sequential fuzzy regression models based on least absolute deviations which we call SFCRMLAD. This algorithm sequentially extracts one cluster at a time using a method of noise-detection, enabling the automatic determination of clusters and having robustness to noises. We compare this method with the ordinary fuzzy c-regression models based on least squares, fuzzy c-regression models based on least absolute deviations, and moreover sequential fuzzy regression models based on least squares. For this purpose we use a two-dimensional illustrative example whereby characteristics of the four methods are made clear. Moreover a simpler and more efficient algorithm of SFCRMLAD can be used for scalar input and output variables, while a general algorithm of SFCRMLAD uses linear programming solutions for multivariable input. By using the above example, we compare efficiency of different algorithms.

[1]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[2]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  K. Jajuga L 1 -norm based fuzzy clustering , 1991 .

[5]  Boris Mirkin,et al.  The Iterative Extraction Approach to Clustering , 2008 .

[6]  Sadaaki Miyamoto,et al.  Algorithms for Sequential Extraction of Clusters by Possibilistic Method and Comparison with Mountain Clustering , 2008, J. Adv. Comput. Intell. Intell. Informatics.

[7]  Sadaaki Miyamoto,et al.  Different sequential clustering algorithms and sequential regression models , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[8]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[9]  W. Steiger,et al.  Least Absolute Deviations: Theory, Applications and Algorithms , 1984 .

[10]  Sadaaki Miyamoto,et al.  Algorithms for Fuzzy Clustering - Methods in c-Means Clustering with Applications , 2008, Studies in Fuzziness and Soft Computing.

[11]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[12]  Rajesh N. Davé,et al.  Characterization and detection of noise in clustering , 1991, Pattern Recognit. Lett..

[13]  R. Quandt A New Approach to Estimating Switching Regressions , 1972 .