论文信息 - Micro-Batching Growing Neural Gas for Clustering Data Streams Using Spark Streaming

Micro-Batching Growing Neural Gas for Clustering Data Streams Using Spark Streaming

Abstract In recent years, the data stream clustering problem has gained considerable attention in the literature. Clustering data streams requires a process capable of partitioning observations continuously while taking into account restrictions of memory and time. In this paper we present MBG-Stream, a Micro-Batching version of the growing neural gas approach, aimed to clustering data streams by making one pass over the data. MBG-Stream allows us to discover clusters of arbitrary shapes without any assumptions on the number of clusters. The proposed algorithm is implemented on a “distributed” streaming platform, the Spark Streaming API, and its performance is evaluated on public data sets.

Mustapha Lebbah | Hanene Azzag | Mohammed Ghesmoune

[1] Joydeep Ghosh,et al. Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[2] Ira Assent,et al. The ClusTree: indexing micro-clusters for anytime stream mining , 2011, Knowledge and Information Systems.

[3] Adam Meyerson,et al. Fast and Accurate k-means For Large Datasets , 2011, NIPS.

[4] Rafail Ostrovsky,et al. Streaming k-means on well-clusterable data , 2011, SODA '11.

[5] André Carlos Ponce de Leon Ferreira de Carvalho,et al. Data stream clustering: A survey , 2013, CSUR.

[6] Teuvo Kohonen,et al. Self-Organizing Maps , 2010 .

[7] Mustapha Lebbah,et al. G-Stream: Growing Neural Gas over Data Stream , 2014, ICONIP.

[8] Aoying Zhou,et al. Density-Based Clustering over an Evolving Data Stream with Noise , 2006, SDM.

[9] Scott Shenker,et al. Discretized Streams: An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters , 2012, HotCloud.

[10] Philip S. Yu,et al. A Framework for Clustering Evolving Data Streams , 2003, VLDB.

[11] Michael Hahsler,et al. Infrastructure for Data Stream Mining , 2015 .