Intuitionistic fuzzy C-regression by using least squares support vector regression

We developed a novel clustering algorithm for solving actual clustering problems.The novel clustering algorithm improves conventional fuzzy c-regression model.Empirical results indicate that the proposed clustering algorithm has superior performance. This paper proposes a novel intuitionistic fuzzy c-least squares support vector regression (IFC-LSSVR) with a Sammon mapping clustering algorithm. Sammon mapping effectively reduces the complexity of raw data, while intuitionistic fuzzy sets (IFSs) can effectively tune the membership of data points, and LSSVR improves the conventional fuzzy c-regression model. The proposed clustering algorithm combines the advantages of IFSs, LSSVR and Sammon mapping for solving actual clustering problems. Moreover, IFC-LSSVR with Sammon mapping adopts particle swarm optimization to obtain optimal parameters. Experiments conducted on a web-based adaptive learning environment and a dataset of wheat varieties demonstrate that the proposed algorithm is more efficient than conventional algorithms, such as the k-means (KM) and fuzzy c-means (FCM) clustering algorithms, in standard measurement indexes. This study thus demonstrates that the proposed model is a credible fuzzy clustering algorithm. The novel method contributes not only to the theoretical aspects of fuzzy clustering, but is also widely applicable in data mining, image systems, rule-based expert systems and prediction problems.

[1]  Jan Adamowski,et al.  Modeling of daily pan evaporation in sub tropical climates using ANN, LS-SVR, Fuzzy Logic, and ANFIS , 2014, Expert Syst. Appl..

[2]  Witold Pedrycz,et al.  The fuzzy C-means algorithm with fuzzy P-mode prototypes for clustering objects having mixed features , 2009, Fuzzy Sets Syst..

[3]  Roelof K. Brouwer,et al.  Modified fuzzy c-means for ordinal valued attributes with particle swarm for optimization , 2010, Fuzzy Sets Syst..

[4]  Kuo-Chen Hung,et al.  Long-term business cycle forecasting through a potential intuitionistic fuzzy least-squares support vector regression approach , 2013, Inf. Sci..

[5]  Tamalika Chaira,et al.  A novel intuitionistic fuzzy C means clustering algorithm and its application to medical images , 2011, Appl. Soft Comput..

[6]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[7]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[8]  Mita Nasipuri,et al.  Conditional spatial fuzzy C-means clustering algorithm for segmentation of MRI images , 2015, Appl. Soft Comput..

[9]  S. Askari,et al.  A high-order multi-variable Fuzzy Time Series forecasting algorithm based on fuzzy clustering , 2015, Expert Syst. Appl..

[10]  Xueguang Shao,et al.  A consensus least squares support vector regression (LS-SVR) for analysis of near-infrared spectra of plant samples. , 2007, Talanta.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Kuo Ping Lin Application of Least-Squares Support Vector Regression with PSO for CPU Performance Forecasting , 2012 .

[13]  Sadaaki Miyamoto,et al.  Fuzzy c-regression models combined with support vector regression , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[14]  Le Hoang Son,et al.  HIFCF: An effective hybrid model between picture fuzzy clustering and intuitionistic fuzzy recommender systems for medical diagnosis , 2015, Expert Syst. Appl..

[15]  Fuyu Zhao,et al.  Particle swarm optimization-based least squares support vector regression for critical heat flux prediction , 2013 .

[16]  Piotr A. Kowalski,et al.  Complete Gradient Clustering Algorithm for Features Analysis of X-Ray Images , 2010 .

[17]  Yifei Wang,et al.  A normal least squares support vector machine (NLS-SVM) and its learning algorithm , 2009, Neurocomputing.

[18]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[19]  Jun Wang,et al.  Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation , 2009, Pattern Recognit..

[20]  Pier Luca Lanzi,et al.  A novel intuitionistic fuzzy clustering method for geo-demographic analysis , 2012, Expert Syst. Appl..

[21]  Xiao-yun Chen,et al.  Relative Density Weights Based Fuzzy C-Means Clustering Algorithms , 2010 .

[22]  Zeshui Xu,et al.  Intuitionistic fuzzy C-means clustering algorithms , 2010 .

[23]  Xiao-Jun Zeng,et al.  Fuzzy C-means++: Fuzzy C-means with effective seeding initialization , 2015, Expert Syst. Appl..

[24]  Tran Manh Tuan,et al.  A cooperative semi-supervised fuzzy clustering framework for dental X-ray image segmentation , 2016, Expert Syst. Appl..

[25]  Marimuthu Palaniswami,et al.  Fuzzy c-Means Algorithms for Very Large Data , 2012, IEEE Transactions on Fuzzy Systems.

[26]  Baowei Fei,et al.  A modified fuzzy C-means classification method using a multiscale diffusion filtering scheme , 2009, Medical Image Anal..

[27]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[28]  Witold Pedrycz,et al.  Collaborative clustering with the use of Fuzzy C-Means and its quantification , 2008, Fuzzy Sets Syst..

[29]  Zonghai Sun Fuzzy Probability C-Regression Estimation Based on Least Squares Support Vector Machine , 2006, ICONIP.

[30]  Gang Xu,et al.  Particle Swarm Optimization-based LS-SVM for Building Cooling Load Prediction , 2010, J. Comput..

[31]  Humberto Bustince,et al.  Vague sets are intuitionistic fuzzy sets , 1996, Fuzzy Sets Syst..

[32]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[33]  Kuo-Ping Lin,et al.  A Novel Evolutionary Kernel Intuitionistic Fuzzy $C$ -means Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[34]  Nikos Pelekis,et al.  Intuitionistic Fuzzy Clustering with Applications in Computer Vision , 2008, ACIVS.

[35]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[36]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[37]  Ping-Feng Pai,et al.  Revenue forecasting using a least-squares support vector regression model in a fuzzy environment , 2013, Inf. Sci..

[38]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[39]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[40]  Seref Sagiroglu,et al.  The development of intuitive knowledge classifier and the modeling of domain dependent data , 2013, Knowl. Based Syst..

[41]  Ping-Feng Pai,et al.  Tourism demand forecasting using novel hybrid system , 2014, Expert Syst. Appl..

[42]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[43]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[44]  Xiao-Jun Zeng,et al.  Fuzzy C-means++: Fuzzy C-means with effective seeding initialization 42(21):7541-7548, 2015. , 2015 .

[45]  I. Burhan Türksen,et al.  Enhanced Fuzzy System Models With Improved Fuzzy Clustering Algorithm , 2008, IEEE Transactions on Fuzzy Systems.

[46]  Simon Fong,et al.  Accelerated Particle Swarm Optimization and Support Vector Machine for Business Optimization and Applications , 2011, NDT.