Learning Topologies with the Growing Neural Forest

In this work, a novel self-organizing model called growing neural forest (GNF) is presented. It is based on the growing neural gas (GNG), which learns a general graph with no special provisions for datasets with separated clusters. On the contrary, the proposed GNF learns a set of trees so that each tree represents a connected cluster of data. High dimensional datasets often contain large empty regions among clusters, so this proposal is better suited to them than other self-organizing models because it represents these separated clusters as connected components made of neurons. Experimental results are reported which show the self-organization capabilities of the model. Moreover, its suitability for unsupervised clustering and foreground detection applications is demonstrated. In particular, the GNF is shown to correctly discover the connected component structure of some datasets. Moreover, it outperforms some well-known foreground detectors both in quantitative and qualitative terms.

[1]  Ezequiel López-Rubio,et al.  Bregman Divergences for Growing Hierarchical Self-Organizing Networks , 2014, Int. J. Neural Syst..

[2]  Ezequiel López-Rubio,et al.  Growing Hierarchical Probabilistic Self-Organizing Graphs , 2011, IEEE Transactions on Neural Networks.

[3]  Luca Scrucca,et al.  Identifying connected components in Gaussian finite mixture models for clustering , 2016, Comput. Stat. Data Anal..

[4]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[5]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[6]  Ezequiel López-Rubio,et al.  Local color transformation analysis for sudden illumination change detection , 2015, Image Vis. Comput..

[7]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[8]  E. Oja,et al.  Clustering Properties of Hierarchical Self-Organizing Maps , 1992 .

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  Joost N. Kok,et al.  TreeSOM: Cluster analysis in the self-organizing map , 2006, Neural Networks.

[11]  Christian Komusiewicz,et al.  Partitioning Biological Networks into Highly Connected Clusters with Maximum Edge Coverage , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[12]  Christian Hennig,et al.  Recovering the number of clusters in data sets with noise features using feature rescaling factors , 2015, Inf. Sci..

[13]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[14]  Kostadin Koroutchev,et al.  Discovering Data Set Nature through Algorithmic Clustering Based on String Compression , 2015, IEEE Transactions on Knowledge and Data Engineering.

[15]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jürgen Rahmel,et al.  SplitNet: learning of tree structured Kohonen chains , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[17]  Minho Lee,et al.  Action-perception cycle learning for incremental emotion recognition in a movie clip using 3D fuzzy GIST based on visual and EEG signals , 2014, Integr. Comput. Aided Eng..

[18]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[19]  Petros Daras,et al.  Large-scale spectral clustering based on pairwise constraints , 2015, Inf. Process. Manag..

[20]  Lynne Billard,et al.  A polythetic clustering process and cluster validity indexes for histogram-valued objects , 2011, Comput. Stat. Data Anal..

[21]  Erkki Oja,et al.  The Evolving Tree—A Novel Self-Organizing Network for Data Analysis , 2004, Neural Processing Letters.

[22]  Yang Gao,et al.  Multi-Instance Dictionary Learning for Detecting Abnormal Events in Surveillance Videos , 2014, Int. J. Neural Syst..

[23]  Ezequiel López-Rubio,et al.  Features for stochastic approximation based foreground detection , 2015, Comput. Vis. Image Underst..

[24]  Wei-Chung Lin,et al.  Dynamic hierarchical self-organizing neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[25]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[26]  Giovanna Menardi,et al.  An advancement in clustering via nonparametric density estimation , 2014, Stat. Comput..

[27]  Andreas Rauber,et al.  The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data , 2002, IEEE Trans. Neural Networks.

[28]  J. Kruskal On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[29]  Hojjat Adeli,et al.  Improved spiking neural networks for EEG classification and epilepsy and seizure detection , 2007, Integr. Comput. Aided Eng..

[30]  Ezequiel López-Rubio,et al.  Foreground Detection in Video Sequences with Probabilistic Self-Organizing Maps , 2011, Int. J. Neural Syst..

[31]  José Muñoz,et al.  Image Compression and Video Segmentation Using Hierarchical Self-Organization , 2012, Neural Processing Letters.

[32]  Alejandro León,et al.  Unsupervised Markerless 3-DOF Motion Tracking in Real Time using a Single Low-Budget Camera , 2012, Int. J. Neural Syst..

[33]  Werner Stuetzle,et al.  Estimating the Cluster Tree of a Density by Analyzing the Minimal Spanning Tree of a Sample , 2003, J. Classif..

[34]  Yang Gao,et al.  Structurally Enhanced Incremental Neural Learning for Image Classification with Subgraph Extraction , 2014, Int. J. Neural Syst..

[35]  Tom Heskes,et al.  Probabilistic Clustering of the Human Connectome Identifies Communities and Hubs , 2015, PloS one.

[36]  Hojjat Adeli,et al.  A parallel genetic/neural network learning algorithm for MIMD shared memory machines , 1994, IEEE Trans. Neural Networks.

[37]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[38]  Edgar N. Sánchez,et al.  A Neural observer with Time-varying Learning rate: Analysis and Applications , 2014, Int. J. Neural Syst..

[39]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[40]  Teuvo Kohonen,et al.  Essentials of the self-organizing map , 2013, Neural Networks.

[41]  Juan Miguel Ortiz-de-Lazcano-Lobato,et al.  Dynamic topology learning with the probabilistic self-organizing graph , 2011, Neurocomputing.

[42]  B. John Oommen,et al.  Self-organizing maps whose topologies can be learned with adaptive binary search trees using conditional rotations , 2015, Pattern Recognit..

[43]  Hojjat Adeli,et al.  Enhanced probabilistic neural network with local decision circles: A robust classifier , 2010, Integr. Comput. Aided Eng..

[44]  Hojjat Adeli,et al.  Machine Learning: Neural Networks, Genetic Algorithms, and Fuzzy Systems , 1994 .