Scalable Varied Density Clustering Algorithm for Large Datasets

Finding clusters in data is a challenging problem especially when the clusters are being of widely varied shapes, sizes, and densities. Herein a new scalable clustering technique which addresses all these issues is proposed. In data mining, the purpose of data clustering is to identify useful patterns in the underlying dataset. Within the last several years, many clustering algorithms have been proposed in this area of research. Among all these proposed methods, density clustering methods are the most important due to their high ability to detect arbitrary shaped clusters. Moreover these methods often show good noise-handling capabilities, where clusters are defined as regions of typical densities separated by low or no density regions. In this paper, we aim at enhancing the well-known algorithm DBSCAN, to make it scalable and able to discover clusters from uneven datasets in which clusters are regions of homogenous densities. We achieved the scalability of the proposed algorithm by using the k-means algorithm to get initial partition of the dataset, applying the enhanced DBSCAN on each partition, and then using a merging process to get the actual natural number of clusters in the underlying dataset. This means the proposed algorithm consists of three stages. Experimental results using synthetic datasets show that the proposed clustering algorithm is faster and more scalable than the enhanced DBSCAN counterpart.

[1]  Cheng-Fa Tsai,et al.  KIDBSCAN: A New Efficient Data Clustering Algorithm , 2006, ICAISC.

[2]  Daniel A. Keim,et al.  An Efficient Approach to Clustering in Large Multimedia Databases with Noise , 1998, KDD.

[3]  Levent Ertoz,et al.  A New Shared Nearest Neighbor Clustering Algorithm and its Applications , 2002 .

[4]  Fawzy A. Torkey,et al.  An Enhanced Density Based Spatial clustering of Applications with Noise , 2009, DMIN.

[5]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[6]  Bogdan Crivat,et al.  Data Mining with Microsoft SQL Server 2008 , 2008 .

[7]  Mohamed A. Ismail,et al.  An efficient density based clustering algorithm for large databases , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[8]  Paulo Cortez,et al.  Data Mining with , 2005 .

[9]  Sudipto Guha,et al.  CURE: an efficient clustering algorithm for large databases , 1998, SIGMOD '98.

[10]  Sudipto Guha,et al.  CURE: an efficient clustering algorithm for large databases , 1998, SIGMOD '98.

[11]  Musa J. Jafar Data Mining with SQL Server 2008 Business Intelligence Development Studio A Hands-on Approach , 2010, AMCIS.

[12]  Abdel-Badeeh M. Salem,et al.  An efficient enhanced k-means clustering algorithm , 2006 .

[13]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[14]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[15]  M. Emre Celebi,et al.  Mining biomedical images with density-based clustering , 2005, International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume II.

[16]  Xin Rui,et al.  An Improved Clustering Algorithm , 2008, 2008 International Symposium on Computational Intelligence and Design.

[17]  Hans-Peter Kriegel,et al.  Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications , 1998, Data Mining and Knowledge Discovery.