The Growing Hierarchical Neural Gas Self-Organizing Neural Network

The growing neural gas (GNG) self-organizing neural network stands as one of the most successful examples of unsupervised learning of a graph of processing units. Despite its success, little attention has been devoted to its extension to a hierarchical model, unlike other models such as the self-organizing map, which has many hierarchical versions. Here, a hierarchical GNG is presented, which is designed to learn a tree of graphs. Moreover, the original GNG algorithm is improved by a distinction between a growth phase where more units are added until no significant improvement in the quantization error is obtained, and a convergence phase where no unit creation is allowed. This means that a principled mechanism is established to control the growth of the structure. Experiments are reported, which demonstrate the self-organization and hierarchy learning abilities of our approach and its performance for vector quantization applications.

[1]  Hervé Frezza-Buet.  Online computing of non-stationary distributions velocity fields by an accuracy controlled growing neural gas , 2014, Neural Networks.

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  Klaus Nordhausen,et al.  Signed-rank tests for location in the symmetric independent component model , 2009, J. Multivar. Anal..

[4]  Chip-Hong Chang,et al.  Self organizing topological tree for skin color detection , 2004, The 2004 IEEE Asia-Pacific Conference on Circuits and Systems, 2004. Proceedings..

[5]  Discriminant procedures based on efficient robust discriminant coordinates , 2007 .

[6]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[7]  Igor T. Podolak,et al.  Density Invariant Detection of Osteoporosis Using Growing Neural Gas , 2013, CORES.

[8]  Alessio Micheli,et al.  A general framework for unsupervised processing of structured data , 2004, Neurocomputing.

[9]  Neil Davey,et al.  TreeGNG - hierarchical topological clustering , 2005, ESANN.

[10]  Anthony H. Dekker,et al.  Kohonen neural networks for optimal colour quantization , 1994 .

[11]  Naoyuki Kubota,et al.  Feature extraction based on hierarchical growing neural gas for informationally structured space , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[12]  Marc M. Van Hulle.  Joint Entropy Maximization in Kernel-Based Topographic Maps , 2002, Neural Computation.

[13]  Diego Viejo,et al.  Combining visual features and Growing Neural Gas networks for robotic 3D SLAM , 2014, Inf. Sci..

[14]  Marc M. Van Hulle,et al.  Maximum Likelihood Topographic Map Formation , 2005, Neural Computation.

[15]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[16]  Matteda Deepa,et al.  A Gesture Learning Interface for Simulated Robot Path Shaping With a Human Teacher , 2015 .

[17]  Antonio Martínez-Álvarez,et al.  Feature selection by multi-objective optimisation: Application to network anomaly detection by hierarchical self-organising maps , 2014, Knowl. Based Syst..

[18]  Ezequiel López-Rubio,et al.  Growing Hierarchical Probabilistic Self-Organizing Graphs , 2011, IEEE Transactions on Neural Networks.

[19]  Andrew Chi-Sing Leung,et al.  Self-organizing map-based color palette for high-dynamic range texture compression , 2011, Neural Computing and Applications.

[20]  Francesc J. Ferri,et al.  Reverse engineering expert visual observations: From fixations to the learning of spatial filters with a neural-gas algorithm , 2013, Expert Syst. Appl..

[21]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[22]  Ben J. A. Kröse,et al.  Self-organizing mixture models , 2005, Neurocomputing.

[23]  Esteban J. Palomo,et al.  Application of growing hierarchical SOM for visualisation of network forensics traffic data , 2012, Neural Networks.

[24]  Charalambos Strouthopoulos,et al.  Adaptive color reduction , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  B. Chakraborty.  On Affine Equivariant Multivariate Quantiles , 2001 .

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  R. Serfling,et al.  Nonparametric depth-based multivariate outlier identifiers, and masking robustness properties , 2010 .

[28]  Esteban J. Palomo,et al.  Hierarchical Color Quantization Based on Self-organization , 2013, Journal of Mathematical Imaging and Vision.

[29]  Nikos Papamarkos,et al.  Color reduction using local features and a kohonen self-organized feature map neural network , 1999, Int. J. Imaging Syst. Technol..

[30]  Teuvo Kohonen,et al.  Essentials of the self-organizing map , 2013, Neural Networks.

[31]  José Alfredo Ferreira Costa,et al.  Hierarchical SOM applied to image compression , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[32]  Jouko Lampinen,et al.  Clustering properties of hierarchical self-organizing maps , 1992, Journal of Mathematical Imaging and Vision.

[33]  Robert Serfling,et al.  Multivariate spatial U-quantiles: A Bahadur–Kiefer representation, a Theil–Sen estimator for multiple regression, and a robust dispersion estimator , 2008 .

[34]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[35]  Andrés Ortiz,et al.  Improving MRI segmentation with probabilistic GHSOM and multiobjective optimization , 2013, Neurocomputing.

[36]  Aluizio F. R. Araújo,et al.  A Taxonomy for Spatiotemporal Connectionist Networks Revisited: The Unsupervised Case , 2003, Neural Computation.

[37]  An-Pin Chen,et al.  A clustering time series model for the optimal hedge ratio decision making , 2014, Neurocomputing.

[38]  Rua-Huan Tsaih,et al.  Topological pattern discovery and feature extraction for fraudulent financial reporting , 2014, Expert Syst. Appl..

[39]  Manojit Chattopadhyay,et al.  Comparison of visualization of optimal clustering using self-organizing map and growing hierarchical self-organizing map in cellular manufacturing system , 2014, Appl. Soft Comput..

[40]  Gianpaolo Vitale,et al.  Intelligent power conversion system management for photovoltaic generation , 2013 .

[41]  Andreas Rauber,et al.  The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data , 2002, IEEE Trans. Neural Networks.