Review of current Online Dynamic Unsupervised Feed Forward Neural Network classification

Online Dynamic Unsupervised Feed Forward Neural Network (ODUFFNN) classification is suitable to be applied in different research areas and environments such as email logs, networks, credit card transactions, astronomy and satellite communications. Currently, there are a few strong methods as ODUFFNN classification, although they have general problems. The goal of this research is an investigation of the critical problems and comparison of current ODUFFNN classification. For experimental results, Evolving Self-Organizing Map (ESOM) and Dynamic Self-Organizing Map (DSOM) as strong related methods are considered; and also they applied some difficult datasets for clustering from the UCI Dataset Repository. The results of the ESOM and the DSOM methods are compared with the results of some related clustering methods. The clustering time is measured by the number of epochs and CPU time usage. The clustering accuracies of methods are measured by employing F-measure through an average of three times performances of clustering methods. The memory usage and complexity are measured by the number of input values, training iterations, clusters; and densities of clusters. (Abstract) Keywords—Neural Network (NN) model, Feed Forward Unsupervised Classification, Training, Epoch, Online Dynamic Unsupervised Feed Forward Neural Network (ODUFFNN) (key words)

[1]  Bogdan Gabrys,et al.  Overview of Some Incremental Learning Algorithms , 2007, 2007 IEEE International Fuzzy Systems Conference.

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[4]  Edward A. Fox,et al.  Recent Developments in Document Clustering , 2007 .

[5]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[6]  Boris Kovalerchuk,et al.  Neural networks for data mining: constrains and open problems , 2004, ESANN.

[7]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[8]  Francesco Camastra,et al.  A Novel Kernel Method for Clustering , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Andrew W. Moore,et al.  Very Fast EM-Based Mixture Model Clustering Using Multiresolution Kd-Trees , 1998, NIPS.

[10]  Yann Boniface,et al.  Dynamic self-organising map , 2011, Neurocomputing.

[11]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[12]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[13]  Nikola K. Kasabov,et al.  ECOS: Evolving Connectionist Systems and the ECO Learning Paradigm , 1998, ICONIP.

[14]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[15]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[16]  Andreas Daffertshofer,et al.  PCA in studying coordination and variability: a tutorial. , 2004, Clinical biomechanics.

[17]  Sankar K. Pal,et al.  Data mining in soft computing framework: a survey , 2002, IEEE Trans. Neural Networks.

[18]  Shen Furao,et al.  An enhanced self-organizing incremental neural network for online unsupervised learning , 2007, Neural Networks.

[19]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[20]  Nikola K. Kasabov,et al.  On-line pattern analysis by evolving self-organizing maps , 2003, Neurocomputing.

[21]  I. Jolliffe.  Principal Component Analysis , 2002 .

[22]  José Alfredo Ferreira Costa,et al.  Cluster Analysis using Growing Neural Gas and Graph Partitioning , 2007, 2007 International Joint Conference on Neural Networks.

[23]  Le Gruenwald,et al.  A survey of data mining and knowledge discovery software tools , 1999, SKDD.

[24]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[25]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[26]  D. P. Mercer,et al.  Clustering large datasets , 2003 .

[27]  Fred Henrik Hamker,et al.  Life-long learning Cell Structures--continuously learning without catastrophic interference , 2001, Neural Networks.

[28]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[29]  Amel Hebboul,et al.  An incremental parallel neural network for unsupervised classification , 2011, International Workshop on Systems, Signal Processing and their Applications, WOSSPA.