Unsupervised and stable LBG algorithm for data classification: application to aerial multicomponent images

In this paper a stable and unsupervised Linde-Buzo-Gray (LBG) algorithm named LBGO is presented. The originality of the proposed algorithm relies: i) on the utilization of an adaptive incremental technique to initialize the class centres that calls into question the intermediate initializations; this technique makes the algorithm stable and deterministic, and the classification results do not vary from a run to another, and ii) on the unsupervised evaluation criteria of the intermediate classification result to estimate the optimal number of classes; this makes the algorithm unsupervised. The efficiency of this optimized version of LBG is shown through some experimental results on synthetic and real aerial hyperspectral data. More precisely we have tested our proposed classification approach regarding three aspects: firstly for its stability, secondly for its correct classification rate, and thirdly for the correct estimation of number of classes.

[1]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[2]  Giuseppe Patanè,et al.  The enhanced LBG algorithm , 2001, Neural Networks.

[3]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[4]  Saylee Gharge,et al.  Tumor Demarcation in Mammography Images using LBG on Probability Image , 2010 .

[5]  Christophe Rosenberger,et al.  Unsupervised clustering method with optimal estimation of the number of clusters: application to image segmentation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[6]  Ulrike von Luxburg,et al.  How the initialization affects the stability of the $k$-means algorithm , 2009, 0907.5494.

[7]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[8]  F Shen,et al.  An adaptive incremental LBG for vector quantization. , 2006, Neural networks : the official journal of the International Neural Network Society.

[9]  Christophe Rosenberger,et al.  Genetic fusion: application to multi-components image segmentation , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[10]  Peng Gao,et al.  Application of fuzzy c-means clustering in data analysis of metabolomics. , 2009, Analytical chemistry.

[11]  Bor-Chen Kuo,et al.  A New Weighted Fuzzy C-Means Clustering Algorithm for Remotely Sensed Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[12]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[13]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  Mohamad M. Awad,et al.  Multicomponent Image Segmentation Using a Genetic Algorithm and Artificial Neural Network , 2007, IEEE Geoscience and Remote Sensing Letters.

[18]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[19]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[20]  T. Moon.  The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[21]  Bernd Fritzke,et al.  The LBG-U Method for Vector Quantization – an Improvement over LBG Inspired from Neural Networks , 1997, Neural Processing Letters.

[22]  Chu-Sing Yang,et al.  A fast VQ codebook generation algorithm via pattern reduction , 2009, Pattern Recognit. Lett..

[23]  Christophe Rosenberger,et al.  Adaptive segmentation system , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[24]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[25]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[26]  Linbo Xie,et al.  An improved LBG algorithm for image vector quantization , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[27]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.