Hybrid Clustering using Elitist Teaching Learning-Based Optimization: An Improved Hybrid Approach of TLBO

Data clustering is a key field of research in the pattern recognition arena. Although clustering is an unsupervised learning technique, numerous efforts have been made in both hard and soft clustering. In hard clustering, K-means is the most popular method and is being used in diversified application areas. In this paper, an effort has been made with a recently developed population based metaheuristic called Elitist based teaching learning based optimization ETLBO for data clustering. The ETLBO has been hybridized with K-means algorithm ETLBO-K-means to get the optimal cluster centers and effective fitness values. The performance of the proposed method has been compared with other techniques by considering standard benchmark real life datasets as well as some synthetic datasets. Simulation and comparison results demonstrate the effectiveness and efficiency of the proposed method.

[1]  Martijn A Spruit,et al.  Clusters of comorbidities based on validated objective measurements and systemic inflammation in patients with chronic obstructive pulmonary disease. , 2013, American journal of respiratory and critical care medicine.

[2]  Di Zhou,et al.  Adaptive particle swarm optimization for medical image registration , 2011, 2011 International Conference on Electrical and Control Engineering.

[3]  nbspMr. Pruthviraj Parmar,et al.  Performance Analysis and Augmentation of K-means Clustering, based approach for Human Detection in Videos , 2015 .

[4]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Clustering , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Vedat Toğan,et al.  Design of planar steel frames using Teaching–Learning Based Optimization , 2012 .

[6]  Gabriela Serban Czibula,et al.  A New k-means Based Clustering Algorithm in Aspect Mining , 2006, 2006 Eighth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[7]  Humayun Kabir,et al.  Comparative Studies on Some Metrics for External Validation of QSPR Models , 2012, J. Chem. Inf. Model..

[8]  Pravat Kumar Rout,et al.  Application of Multi-Objective Teaching Learning based Optimization Algorithm to Optimal Power Flow Problem☆ , 2012 .

[9]  R. Venkata Rao,et al.  A comparative study of a teaching-learning-based optimization algorithm on multi-objective unconstrained and constrained functions , 2014, J. King Saud Univ. Comput. Inf. Sci..

[10]  Provas Kumar Roy,et al.  Optimal capacitor placement in radial distribution systems using teaching learning based optimization , 2014 .

[11]  Jing Wang,et al.  Fast approximate k-means via cluster closures , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  S.Ravi,et al.  Brain Tumor Segmentation Using K-MeansClustering And Fuzzy C-Means AlgorithmsAnd Its Area Calculation , 2014 .

[13]  Nilanjan Dey,et al.  Optimisation of scaling factors in electrocardiogram signal watermarking using cuckoo search , 2013, Int. J. Bio Inspired Comput..

[14]  Dimple Malik,et al.  Evolving limitations in K-means algorithm in data mining and their removal , 2011 .

[15]  Provas Kumar Roy,et al.  Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem , 2013 .

[16]  Ajith Abraham,et al.  A Harmony Search Based Gradient Descent Learning-FLANN (HS-GDL-FLANN) for Classification , 2015 .

[17]  Vivek Patel,et al.  A multi-objective improved teaching-learning based optimization algorithm for unconstrained and constrained optimization problems , 2014 .

[18]  Feng Zou,et al.  An improved teaching-learning-based optimization algorithm for solving global optimization problem , 2015, Inf. Sci..

[19]  M. Surya Kalavathi,et al.  Optimal capacitor placement in radial distribution system using Gravitational Search Algorithm , 2015 .

[20]  Na Chen,et al.  Hierarchical hesitant fuzzy K-means clustering algorithm , 2014, Applied Mathematics-A Journal of Chinese Universities.

[21]  M. Emre Celebi,et al.  Improving the performance of k-means for color quantization , 2011, Image Vis. Comput..

[22]  Li Ma,et al.  An Improved K-means Algorithm based on Mapreduce and Grid , 2015 .

[23]  Fang-Xiang Wu,et al.  Genetic weighted k-means algorithm for clustering large-scale gene expression data , 2008, BMC Bioinformatics.

[24]  A. Komali,et al.  An Efficient Content Based Image Retrieval System for Color and Shape Using Optimized K-Means Algorithm , 2013 .

[25]  Nilanjan Dey,et al.  Computed Tomography Image Enhancement Using Cuckoo Search: A Log Transform Based Approach , 2015 .

[26]  Himansu Sekhar Behera,et al.  A novel Chemical Reaction Optimization based Higher order Neural Network (CRO-HONN) for nonlinear classification , 2015 .

[27]  Thomas Schreiber,et al.  A Voronoi Diagram Based Adaptive K-Means-Type Clustering Algorithm for Multidimenstional Weighted Data , 1991, Workshop on Computational Geometry.

[28]  H. Modares,et al.  Combining PSO and k-means to enhance data clustering , 2008, 2008 International Symposium on Telecommunications.

[29]  Himansu Sekhar Behera,et al.  Evolutionary Improved Swarm-Based Hybrid K-Means Algorithm for Cluster Analysis , 2016 .

[30]  A. Routray,et al.  Bird Mating Optimization Based Multilayer Perceptron for Diseases Classification , 2015 .

[31]  Sunil Kumar Nahak,et al.  A Study On Predicting K In The K-Means Algorithm Using Visualization Tool , 2015 .

[32]  Ajith Abraham,et al.  Particle Swarm Optimization Based Higher Order Neural Network for Classification , 2015 .

[33]  Provas Kumar Roy,et al.  Teaching learning based optimization for short-term hydrothermal scheduling problem considering valve point effect and prohibited discharge constraint , 2013 .

[34]  T. Tarpey.  Linear Transformations and the k-Means Clustering Algorithm , 2007, American Statistician.

[35]  Rehab Duwairi,et al.  A novel approach for initializing the spherical K-means clustering algorithm , 2015, Simul. Model. Pract. Theory.

[36]  R. Venkata Rao,et al.  An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems , 2012, Sci. Iran..

[37]  Kang Li,et al.  An improved TLBO with elite strategy for parameters identification of PEM fuel cell and solar cell models , 2014 .

[38]  Dimitrios Charalampidis,et al.  A modified k-means algorithm for circular invariant clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Nor Ashidi Mat Isa,et al.  Teaching and peer-learning particle swarm optimization , 2014, Appl. Soft Comput..

[40]  P. Bork,et al.  Enterotypes of the human gut microbiome , 2011, Nature.

[41]  Himansu Sekhar Behera,et al.  An Improved Swarm Based Hybrid K-Means Clustering for Optimal Cluster Centers , 2015 .

[42]  Yanyan Li,et al.  K-means Algorithm Based on Particle Swarm Optimization for the Identification of Rock Discontinuity Sets , 2014, Rock Mechanics and Rock Engineering.

[43]  Rabindra Kumar Sahu,et al.  Load frequency control of power system under deregulated environment using optimal firefly algorithm , 2016 .

[44]  J. D. Bregman,et al.  PROPERTIES OF POLYCYCLIC AROMATIC HYDROCARBONS IN THE NORTHWEST PHOTON DOMINATED REGION OF NGC 7023. II. TRADITIONAL PAH ANALYSIS USING k-MEANS AS A VISUALIZATION TOOL , 2014 .

[45]  Sivakumar Ramakrishnan,et al.  A survey: hybrid evolutionary algorithms for cluster analysis , 2011, Artificial Intelligence Review.

[46]  Taher Niknam,et al.  Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm , 2014 .

[47]  Provas Kumar Roy,et al.  Optimal reactive power dispatch using quasi-oppositional teaching learning based optimization , 2013 .

[48]  C. Abraham,et al.  The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions , 2013, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[49]  Nilanjan Dey,et al.  Parallel image segmentation using multi-threading and k-means algorithm , 2013, 2013 IEEE International Conference on Computational Intelligence and Computing Research.

[50]  Shunxiang Wu,et al.  cDNA microarray image segmentation with an improved moving k-means clustering method , 2015, Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015).

[51]  Zhe Zhang,et al.  Improved K-Means Clustering Algorithm , 2008, 2008 Congress on Image and Signal Processing.

[52]  Xiangyu Yang,et al.  Prediction of chemotherapeutic response in bladder cancer using K‐means clustering of dynamic contrast‐enhanced (DCE)‐MRI pharmacokinetic parameters , 2015, Journal of magnetic resonance imaging : JMRI.

[53]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[54]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[55]  Jiajie Zhang,et al.  A general species delimitation method with applications to phylogenetic placements , 2013, Bioinform..

[56]  Yiu-ming Cheung,et al.  k*-Means: A new generalized k-means clustering algorithm , 2003, Pattern Recognit. Lett..

[57]  H. S. Behera,et al.  A hybrid PSO-GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[58]  D. W. Lamb,et al.  Risk mapping of redheaded cockchafer (Adoryphorus couloni) (Burmeister) infestations using a combination of novel k-means clustering and on-the-go plant and soil sensing technologies , 2015, Precision Agriculture.

[59]  Grant Harvey McTainsh,et al.  The Soils of the Agricultural Research Station at Myall Vale', near Narrabri, NSW, with Data Analysis by Fuzzy K-means , 1999 .

[60]  Himansu Sekhar Behera,et al.  A novel nature inspired firefly algorithm with higher order neural network: Performance analysis , 2016 .

[61]  Himansu Das,et al.  A Novel PSO Based Back Propagation Learning-MLP (PSO-BP-MLP) for Classification , 2015 .

[62]  Ajit Kumar Barisal,et al.  Comparative performance analysis of teaching learning based optimization for automatic load frequency control of multi-source power systems , 2015 .

[63]  Olatz Arbelaitz,et al.  An extensive comparative study of cluster validity indices , 2013, Pattern Recognit..

[64]  Bin Wang,et al.  Multi-objective optimization using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..

[65]  Mohammad Reza Khalghani,et al.  A novel self-tuning control method based on regulated bi-objective emotional learning controller's structure with TLBO algorithm to control DVR compensator , 2014, Appl. Soft Comput..

[66]  Rabindra Kumar Sahu,et al.  Automatic generation control of multi-area power systems with diverse energy sources using Teaching Learning Based Optimization algorithm , 2016 .

[67]  Feng Zou,et al.  Teaching-learning-based optimization with learning experience of other learners and its application , 2015, Appl. Soft Comput..

[68]  Zhe Liu,et al.  Medical Image Clustering Based on Improved Particle Swarm Optimization and Expectation Maximization Algorithm , 2014, CCPR.

[69]  Himansu Sekhar Behera,et al.  A Honey Bee Mating Optimization Based Gradient Descent Learning – FLANN (HBMO-GDL-FLANN) for Classification , 2015 .

[70]  Anima Naik,et al.  Data Clustering Based on Teaching-Learning-Based Optimization , 2011, SEMCCO.

[71]  Xu Zhou,et al.  A Hybrid Clustering Algorithm Combining Cloud Model IWO and k-Means , 2014, Int. J. Pattern Recognit. Artif. Intell..

[72]  Rabindra Kumar Sahu,et al.  Application of Firefly Algorithm for AGC Under Deregulated Power System , 2015 .

[73]  R. Venkata Rao,et al.  Parameter optimization of modern machining processes using teaching-learning-based optimization algorithm , 2013, Eng. Appl. Artif. Intell..