Choosing DBSCAN Parameters Automatically using Differential Evolution

Over the last several years, DBSCAN (Density-Based Spatial Clustering of Applications with Noise) has been widely applied in many areas of science due to its simplicity, robustness against noise (outlier) and ability to discover clusters of arbitrary shapes. However, DBSCAN algorithm requires two initial input parameters, namely Eps (the radius of the cluster) and MinPts (the minimum data objects required inside the cluster) which both have a significant influence on the clustering results. Hence, DBSCAN is sensitive to its input parameters and it is hard to determine them a priori. This paper presents an efficient and effective hybrid clustering method, named BDE-DBSCAN, that combines Binary Differential Evolution and DBSCAN algorithm to simultaneously quickly and automatically specify appropriate parameter values for Eps and MinPts. Since the Eps parameter can largely degrades the efficiency of the DBSCAN algorithm, the combination of an analytical way for estimating Eps and Tournament Selection (TS) method is also employed. Experimental results indicate the proposed method is precise in determining appropriate input parameters of DBSCAN algorithm.

[1]  Elizabeth León Guzman,et al.  Web document clustering based on Global-Best Harmony Search, K-means, Frequent Term Sets and Bayesian Information Criterion , 2010, IEEE Congress on Evolutionary Computation.

[2]  Dervis Karaboga,et al.  Artificial Bee Colony based image clustering method , 2012, 2012 IEEE Congress on Evolutionary Computation.

[3]  Xingsheng Gu,et al.  A hybrid coevolutionary cultural algorithm based on particle swarm optimization for solving global optimization problems , 2012 .

[4]  Stanislaw Sieniutycz,et al.  Brief review of static optimization methods , 2013 .

[5]  Dit-Yan Yeung,et al.  Robust path-based spectral clustering , 2008, Pattern Recognit..

[6]  Amin Karami,et al.  Data Clustering for Anomaly Detection in Content-Centric Networks , 2013 .

[7]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[8]  Fabio Schoen,et al.  Differential evolution methods based on local searches , 2014, Comput. Oper. Res..

[9]  Yang Kai,et al.  Using DBSCAN clustering algorithm in spam identifying , 2010, 2010 2nd International Conference on Education Technology and Computer.

[10]  Rafael Sachetto Oliveira,et al.  G-DBSCAN: A GPU Accelerated Algorithm for Density-based Clustering , 2013, ICCS.

[11]  Stanislaw Sieniutycz.  Chapter 1 – Brief review of static optimization methods , 2009 .

[12]  D. Massart,et al.  Looking for natural patterns in data: Part 1. Density-based approach , 2001 .

[13]  Jianhua Wu,et al.  A modified differential evolution algorithm for unconstrained optimization problems , 2013, Neurocomputing.

[14]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[15]  Amin Karami,et al.  UTILIZATION AND COMPARISON OF MULTI ATTRIBUTE DECISION MAKING TECHNIQUES TO RANK BAYESIAN NETWORK OPTIONS Master Degree Project in Informatics One year Level ECTS 30 Spring term Year 2011 , 2011 .

[16]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jing Li,et al.  A new hybrid method based on partitioning-based DBSCAN and ant clustering , 2011, Expert Syst. Appl..

[18]  Yongsheng Wang,et al.  A Binary-Differential Evolution algorithm based on Ordering of individuals , 2010, 2010 Sixth International Conference on Natural Computation.

[19]  Jiawei Han,et al.  Data Mining: Concepts and Techniques, Second Edition , 2006, The Morgan Kaufmann series in data management systems.

[20]  Magdalene Marinaki,et al.  A hybrid discrete Artificial Bee Colony - GRASP algorithm for clustering , 2009, 2009 International Conference on Computers & Industrial Engineering.

[21]  Manel Guerrero Zapata,et al.  A fuzzy anomaly detection system based on hybrid PSO-Kmeans algorithm in content-centric networks , 2015, Neurocomputing.

[22]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[23]  Gp Babu,et al.  Simulated annealing for selecting optimal initial seeds in the K-means algorithm , 1994 .

[24]  Minrui Fei,et al.  A novel modified binary differential evolution algorithm and its applications , 2012, Neurocomputing.

[25]  Marco Furini,et al.  International Journal of Computer and Applications , 2010 .

[26]  Yangyang Li,et al.  A spectral clustering-based adaptive hybrid multi-objective harmony search algorithm for community detection , 2012, 2012 IEEE Congress on Evolutionary Computation.

[27]  Wang Peng,et al.  Grid-based DBSCAN Algorithm with Referential Parameters , 2012 .

[28]  Z. Elouedi,et al.  DBSCAN-GM: An improved clustering method based on Gaussian Means and DBSCAN techniques , 2012, 2012 IEEE 16th International Conference on Intelligent Engineering Systems (INES).

[29]  Lin Li,et al.  Wheat Cultivar Classifications Based on Tabu Search and Fuzzy C-means Clustering Algorithm , 2012 .

[30]  Youyun Ao,et al.  Experimental Study on Differential Evolution Strategies , 2009, 2009 WRI Global Congress on Intelligent Systems.

[31]  Lingbo Zhang,et al.  A hybrid co-evolutionary cultural algorithm based on particle swarm optimization for solving global optimization problems , 2012, Neurocomputing.

[32]  Sanjay Ranka,et al.  An effic ient k-means clustering algorithm , 1997 .

[33]  Hou-Jun Wang,et al.  Fuzzy tabu search method for the clustering problem , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[34]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[35]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[36]  Zong Woo Geem,et al.  An analysis of selection methods in memory consideration for harmony search , 2013, Appl. Math. Comput..

[37]  Jian Pei,et al.  Data Mining: Concepts and Techniques, 3rd edition , 2006 .

[38]  Li Xue-yong,et al.  A New Intrusion Detection Method Based on Improved DBSCAN , 2010, 2010 WASE International Conference on Information Engineering.

[39]  Jinfeng Han,et al.  The Clustering Algorithm Based on Particle Swarm Optimization Algorithm , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[40]  Bo Zhao,et al.  Image Segmentation Based on Ant Colony Optimization and K-Means Clustering , 2007, 2007 IEEE International Conference on Automation and Logistics.

[41]  S.A. Salem,et al.  New Assessment Criteria for Clustering Algorithms , 2005, 2005 IEEE Workshop on Machine Learning for Signal Processing.

[42]  Juntae Kim,et al.  The Anomaly Detection by Using DBSCAN Clustering with Multiple Parameters , 2011, 2011 International Conference on Information Science and Applications.

[43]  George E. Tsekouras.  A simple and effective algorithm for implementing particle swarm optimization in RBF network's design using input-output fuzzy clustering , 2013, Neurocomputing.

[44]  Glory H. Shah.  An improved DBSCAN, a density based clustering algorithm with parameter selection for high dimensional data sets , 2012, 2012 Nirma University International Conference on Engineering (NUiCONE).

[45]  Michal Daszykowski,et al.  Revised DBSCAN algorithm to cluster data with dense adjacent clusters , 2013 .

[46]  Pengfei Shi,et al.  An improved ant colony algorithm for fuzzy clustering in image segmentation , 2007, Neurocomputing.

[47]  Aristides Gionis,et al.  Clustering aggregation , 2005, 21st International Conference on Data Engineering (ICDE'05).

[48]  Sohail Asghar,et al.  Critical analysis of DBSCAN variations , 2010, 2010 International Conference on Information and Emerging Technologies.

[49]  Songrit Maneewongvatana,et al.  U-DBSCAN : A density-based clustering algorithm for uncertain objects , 2010, 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010).

[50]  Wang Peng,et al.  Research on Adaptive Parameters Determination in DBSCAN Algorithm , 2012 .

[51]  Peter Kulchyski.  and , 2015 .

[52]  J. Dunn.  Well-Separated Clusters and Optimal Fuzzy Partitions , 1974 .

[53]  Liu Suhua,et al.  Wheat Cultivar Classifications Based on Tabu Search and Fuzzy C-means Clustering Algorithm , 2012, 2012 Fourth International Conference on Computational and Information Sciences.

[54]  Ronnie Johansson,et al.  Utilization of Multi Attribute Decision Making Techniques to Integrate Automatic and Manual Ranking of Options , 2014, J. Inf. Sci. Eng..

[55]  Prasanta K. Jana,et al.  A Prototype-Based Modified DBSCAN for Gene Clustering , 2012 .

[56]  P. Viswanath,et al.  Rough-DBSCAN: A fast hybrid density based clustering method for large data sets , 2009, Pattern Recognit. Lett..

[57]  Selcuk Okdem,et al.  Cluster based wireless sensor network routing using artificial bee colony algorithm , 2010, Wireless Networks.

[58]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[59]  Liang Li,et al.  A Combinatorial Search Method Based on Harmony Search Algorithm and Particle Swarm Optimization in Slope Stability Analysis , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[60]  Junyan Chen,et al.  HYBRID CLUSTERING ALGORITHM BASED ON PSO WITH THE MULTIDIMENSIONAL ASYNCHRONISM AND STOCHASTIC DISTURBANCE METHOD , 2012 .