论文信息 - A Clustering Algorithm Based on Matrix over High Dimensional Data Stream

A Clustering Algorithm Based on Matrix over High Dimensional Data Stream

Clustering high-dimensional data stream is a difficult and important issue. In this paper, we propose MStream, a new clustering algorithm based on matrix over high dimensional data stream. MStream algorithm incorporates a synopsis structure, called GC (Grid Cell Structure), and grid matrix technique. The algorithm adopts the two-phased framework. In the online component, the GC is employed to monitor one-dimensional statistics data distribution of each dimension independently. Sparse GCs which need to be deleted are checked by predefined threshold. In the offline component, it is possible to tracing multi-dimensional clusters by dense GCs which are maintained in the online component. Grid matrix technique is introduced to generate the final multi-dimensional clusters in the whole data space. Experimental results show that our algorithm has the flexible scalability and higher clustering quality.

Jiadong Ren | Changzhen Hu | Guibin Hou | Ruixia Yao

[1] Gang Liu,et al. A Grid-Based Clustering Algorithm for High-Dimensional Data Streams , 2005, ADMA.

[2] Philip S. Yu,et al. A Framework for Clustering Evolving Data Streams , 2003, VLDB.

[3] Jennifer Widom,et al. Models and issues in data stream systems , 2002, PODS.

[4] Charu C. Aggarwal,et al. On High Dimensional Projected Clustering of Uncertain Data Streams , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[5] Won Suk Lee,et al. Efficiently tracing clusters over high-dimensional on-line data streams , 2009, Data Knowl. Eng..

[6] Philip S. Yu,et al. A Framework for Projected Clustering of High Dimensional Data Streams , 2004, VLDB.

[7] Li Tu,et al. Density-based clustering for real-time stream data , 2007, KDD '07.

[8] Aoying Zhou,et al. Density-Based Clustering over an Evolving Data Stream with Noise , 2006, SDM.

[9] Samuel Sambasivam,et al. Advanced Data Clustering Methods of Mining Web Documents , 2006 .

[10] Won Suk Lee,et al. Anomaly intrusion detection by clustering transactional audit streams in a host computer , 2010, Inf. Sci..

[11] Jiadong Ren,et al. A Weighted Subspace Clustering Algorithm in High-Dimensional Data Streams , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).