Extension neural network-type 2 and its applications

A supervised learning pattern classifier, called the extension neural network (ENN), has been described in a recent paper. In this sequel, the unsupervised learning pattern clustering sibling called the extension neural network type 2 (ENN-2) is proposed. This new neural network uses an extension distance (ED) to measure the similarity between data and the cluster center. It does not require an initial guess of the cluster center coordinates, nor of the initial number of clusters. The clustering process is controlled by a distanced parameter and by a novel extension distance. It shows the same capability as human memory systems to keep stability and plasticity characteristics at the same time, and it can produce meaningful weights after learning. Moreover, the structure of the proposed ENN-2 is simpler and the learning time is shorter than traditional neural networks. Experimental results from five different examples, including three benchmark data sets and two practical applications, verify the effectiveness and applicability of the proposed work.

[1]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[2]  Hong-Chan Chang,et al.  Novel clustering method for coherency identification using an artificial neural network , 1994 .

[3]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[4]  Zekeriya Uykan,et al.  Analysis of augmented-input-Layer RBFNN , 2005, IEEE Transactions on Neural Networks.

[5]  Stephen Grossberg,et al.  ART 2-A: An adaptive resonance algorithm for rapid category learning and recognition , 1991, Neural Networks.

[6]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[7]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Jianping Zhang,et al.  Selecting Typical Instances in Instance-Based Learning , 1992, ML.

[9]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[10]  Vassilios Petridis,et al.  Fuzzy lattice neural network (FLNN): a hybrid model for learning , 1998, IEEE Trans. Neural Networks.

[11]  Donald F. Specht,et al.  Probabilistic neural networks and the polynomial Adaline as complementary techniques for classification , 1990, IEEE Trans. Neural Networks.

[12]  Kay Chen Tan,et al.  New dynamical optimal learning for linear multilayer FNN , 2004, IEEE Transactions on Neural Networks.

[13]  Guanrong Chen,et al.  Reproducing chaos by variable structure recurrent neural networks , 2004, IEEE Transactions on Neural Networks.

[14]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[16]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[17]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[18]  Vassilios Petridis,et al.  Fuzzy Lattice Neurocomputing (FLN) models , 2000, Neural Networks.

[19]  Ethem Alpaydin,et al.  Constructive Feedforward ART Clustering Networks — Part I , 2001 .

[20]  M. H. Wang,et al.  Extension neural network and its applications , 2003, Neural Networks.

[21]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[22]  Ethem Alpaydin,et al.  Constructive feedforward ART clustering networks. I , 2002, IEEE Trans. Neural Networks.

[23]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[24]  Li Hua.  Improved BP Algorithm in Vibration Failure Diagosis of Steam Turbine-Generator Set , 1999 .

[25]  Jenlong Moh,et al.  A new art-based neural architecture for pattern classification and image enhancement without prior knowledge , 1992, Pattern Recognit..

[26]  Guy M. Wallis,et al.  Stability criteria for unsupervised temporal association networks , 2005, IEEE Transactions on Neural Networks.