Exploratory Data Analysis and Foreground Detection with the Growing Hierarchical Neural Forest

In this paper, a new self-organizing artificial neural network called growing hierarchical neural forest (GHNF) is proposed. The GHNF is a hierarchical model based on the growing neural forest, which is a tree-based model that learns a set of trees (forest) instead of a general graph so that the forest can grow in size. This way, the GHNF faces three important limitations regarding the self-organizing map: fixed size, fixed topology, and lack of hierarchical representation for input data. Hence, the GHNF is especially amenable to datasets containing clusters where each cluster has a hierarchical structure since each tree of the GHNF forest can adapt to one of the clusters. Experimental results show the goodness of our proposal in terms of self-organization and clustering capabilities. In particular, it has been applied to text mining of tweets as a typical exploratory data analysis application, where a hierarchical representation of concepts present in tweets has been obtained. Moreover, it has been applied to foreground detection in video sequences, outperforming several methods specialized in foreground detection.

[1]  Stefano Ramat,et al.  A Hierarchical SOM to Identify and Recognize Objects in Sequences of Stereo Images , 2007 .

[2]  Akiko Aizawa,et al.  An information-theoretic perspective of tf-idf measures , 2003, Inf. Process. Manag..

[3]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Luis Rueda,et al.  iSOM-GSN: An Integrative Approach for Transforming Multi-omic Data into Gene Similarity Networks via Self-organizing Maps , 2020, Bioinform..

[5]  B. John Oommen,et al.  Self-organizing maps whose topologies can be learned with adaptive binary search trees using conditional rotations , 2015, Pattern Recognit..

[6]  Erkki Oja,et al.  The Evolving Tree—A Novel Self-Organizing Network for Data Analysis , 2004, Neural Processing Letters.

[7]  Yi Liu,et al.  Interactive Hierarchical SOM for Image Retrieval Visualization , 2009, ICONIP.

[8]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[9]  Lynne Billard,et al.  A polythetic clustering process and cluster validity indexes for histogram-valued objects , 2011, Comput. Stat. Data Anal..

[10]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[11]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[12]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[13]  Ezequiel López-Rubio,et al.  The Growing Hierarchical Neural Gas Self-Organizing Neural Network , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[15]  Teuvo Kohonen,et al.  Essentials of the self-organizing map , 2013, Neural Networks.

[16]  José Alfredo Ferreira Costa,et al.  Hierarchical SOM applied to image compression , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[17]  Fei Liu,et al.  Influence of mining activities on groundwater hydrochemistry and heavy metal migration using a self-organizing map (SOM) , 2020, Journal of Cleaner Production.

[18]  Kostadin Koroutchev,et al.  Discovering Data Set Nature through Algorithmic Clustering Based on String Compression , 2015, IEEE Transactions on Knowledge and Data Engineering.

[19]  Tao Jin,et al.  Improving reconstruction of sound speed profiles using a self-organizing map method with multi-source observations , 2020 .

[20]  Andreas Rauber,et al.  The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data , 2002, IEEE Trans. Neural Networks.

[21]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[22]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[24]  Suchendra M. Bhandarkar,et al.  Multiscale image segmentation using a hierarchical self-organizing map , 1997, Neurocomputing.

[25]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[26]  Christian Hennig,et al.  Recovering the number of clusters in data sets with noise features using feature rescaling factors , 2015, Inf. Sci..

[27]  Ezequiel López-Rubio,et al.  Features for stochastic approximation based foreground detection , 2015, Comput. Vis. Image Underst..

[28]  Alessandro Rozza,et al.  A Robust Approach for the Background Subtraction Based on Multi-Layered Self-Organizing Maps , 2016, IEEE Transactions on Image Processing.

[29]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[30]  Risto Miikkulainen,et al.  Script Recognition with Hierarchical Feature Maps , 1992 .

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[33]  E. Oja,et al.  Clustering Properties of Hierarchical Self-Organizing Maps , 1992 .

[34]  Joost N. Kok,et al.  TreeSOM: Cluster analysis in the self-organizing map , 2006, Neural Networks.

[35]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[36]  Saman K. Halgamuge,et al.  A self-growing cluster development approach to data mining , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[37]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[38]  Ezequiel López-Rubio,et al.  Learning Topologies with the Growing Neural Forest , 2016, Int. J. Neural Syst..

[39]  J. Kruskal.  On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[40]  Risto Mukkulainen,et al.  Script Recognition with Hierarchical Feature Maps , 1990 .

[41]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[42]  Jürgen Rahmel,et al.  SplitNet: learning of tree structured Kohonen chains , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[43]  E. Elayaraja,et al.  Fuzzy based clustering method on yeast dataset with different fuzzification methods , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[44]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.