Spectral Clustering with Neighborhood Attribute Reduction Based on Information Entropy

Traditional rough set theory is only suitable for dealing with discrete variables and need data preprocessing. Neighborhood rough sets overcome these shortcomings with the ability to directly process numeric data. This paper modifies the attribute reduction method based on neighborhood rough sets, in which the attribute importance is combined with information entropy to select the appropriate attributes. When multiple attributes have the same importance degree, compare the information entropy of these attributes. Put the attribute having the minimal entropy into the reduction set, so that the reduced attribute set is better. Then we introduce this attribute reduction method to improve spectral clustering and propose NRSR-SC algorithm. It can highlight the differences between samples while maintaining the characteristics of data points to make the final clustering results closer to the real data classes. Experiments show that, NRSR-SC algorithm is superior to traditional spectral clustering algorithm and FCM algorithm. Its clustering accuracy is higher, and has strong robustness to the noise in high-dimensional data.

[1]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[2]  Sun Ji,et al.  Clustering Algorithms Research , 2008 .

[3]  Ming Dong,et al.  Multi-level Low-rank Approximation-based Spectral Clustering for image segmentation , 2012, Pattern Recognit. Lett..

[4]  Zhou Shuigeng,et al.  A survey of clustering algorithms based on spectra of graphs , 2011 .

[5]  Hui Li,et al.  Research and Development of Granular Neural Networks , 2013 .

[6]  Yijun Liu,et al.  Study of Clustering Algorithm based on Fuzzy C-Means and Immunological Partheno Genetic , 2013, J. Softw..

[7]  Huang Qinghua,et al.  Numerical Attribute Reduction Based on Neighborhood Granulation and Rough Approximation , 2008 .

[8]  Wang Guo,et al.  Decision Table Reduction based on Conditional Information Entropy , 2002 .

[9]  Yuan Wen-ju,et al.  Topology Generation Algorithm for P2P Network , 2011 .

[10]  Gou Ping-zhang.  Attribute Reduction Algorithm on Rough Set and Information Entropy and Its Application , 2011 .

[11]  Marc Van Barel,et al.  Sparse spectral clustering method based on the incomplete Cholesky decomposition , 2010, J. Comput. Appl. Math..

[12]  Wang Tingting,et al.  An Attribute Reduction Algorithm Based on Instance Selection , 2012 .

[13]  Xin-Ye Li,et al.  Constructing affinity matrix in spectral clustering based on neighbor propagation , 2012, Neurocomputing.

[14]  Bart De Moor,et al.  Multi-view spectral clustering and its chemical application , 2013, Int. J. Comput. Biol. Drug Des..

[15]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[16]  Xu Xin-Zheng,et al.  Factor Analysis Feature Extraction Algorithm Based on Shannon Entropy , 2011 .

[17]  Hu Qing,et al.  Numerical Attribute Reduction Based on Neighborhood Granulation and Rough Approximation , 2008 .

[18]  Qing-Hua Hu,et al.  Numerical Attribute Reduction Based on Neighborhood Granulation and Rough Approximation: Numerical Attribute Reduction Based on Neighborhood Granulation and Rough Approximation , 2008 .

[19]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Spectral methods for graph clustering - A survey , 2011, Eur. J. Oper. Res..

[20]  Isaac E. Lagaris,et al.  A Spectral Clustering Approach Based on Newton's Equations of Motion , 2013, Int. J. Intell. Syst..

[21]  Ding Shi.  Entropy-Based Fuzzy Information Measures , 2012 .

[22]  Xianchao Zhang,et al.  An improved spectral clustering algorithm based on random walk , 2011, Frontiers of Computer Science in China.

[23]  Han Zhao,et al.  Attribute Granulation Based on Attribute Discernibility and AP Algorithm , 2013, J. Softw..

[24]  Xinwu Li.  A New Text Clustering Algorithm Based on Improved K_means , 2012, J. Softw..

[25]  Tom Michoel,et al.  Alignment and integration of complex networks by hypergraph-based spectral clustering , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Lei Ding,et al.  Two-Step Spectral Clustering Controlled Islanding Algorithm , 2013, IEEE Transactions on Power Systems.

[27]  Hong Zhu,et al.  A Feature Weighted Spectral Clustering Algorithm Based on Knowledge Entropy , 2013, J. Softw..

[28]  Fei Wang,et al.  Fast semi-supervised clustering with enhanced spectral embedding , 2012, Pattern Recognit..

[29]  Wang Zheng,et al.  Wavelet moment based facial feature matching and detection method , 2007 .

[30]  Hu Qing,et al.  Efficient Symbolic and Numerical Attribute Reduction with Neighborhood Rough Sets , 2008 .

[31]  Ji-Gui Sun,et al.  Clustering Algorithms Research , 2008 .

[32]  Zhongzhi Shi,et al.  Entropy-Based Fuzzy Information Measures: Entropy-Based Fuzzy Information Measures , 2012 .