Fuzzy lattice neural network (FLNN): a hybrid model for learning

This paper proposes two hierarchical schemes for learning, one for clustering and the other for classification problems. Both schemes can be implemented on a fuzzy lattice neural network (FLNN) architecture, to be introduced herein. The corresponding two learning models draw on adaptive resonance theory (ART) and min-max neurocomputing principles but their application domain is a mathematical lattice. Therefore they can handle more general types of data in addition to N-dimensional vectors. The FLNN neural model stems from a cross-fertilization of lattice theory and fuzzy set theory. Hence a novel theoretical foundation is introduced in this paper, that is the framework of fuzzy lattices or FL-framework, based on the concepts fuzzy lattice and inclusion measure. Sufficient conditions for the existence of an inclusion measure in a mathematical lattice are shown. The performance of the two FLNN schemes, that is for clustering and for classification, compares quite well with other methods and it is demonstrated by examples on various data sets including several benchmark data sets.

[1]  J. Goguen.  L-fuzzy sets , 1967 .

[2]  Shun-ichi Amari,et al.  Dualistic geometry of the manifold of higher-order neurons , 1991, Neural Networks.

[3]  Vassilis G. Kaburlasos.  Adaptive resonance theory with supervised learning and large database applications , 1992 .

[4]  Sankar K. Pal,et al.  Fuzzy self-organization, inferencing, and rule generation , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[6]  Donald F. Specht,et al.  Probabilistic neural networks and the polynomial Adaline as complementary techniques for classification , 1990, IEEE Trans. Neural Networks.

[7]  Elias N. Houstis,et al.  On neurobiological, neuro-fuzzy, machine learning, and statistical pattern recognition techniques , 1997, IEEE Trans. Neural Networks.

[8]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[9]  Don R. Hush,et al.  Network constraints and multi-objective optimization for one-class classification , 1996, Neural Networks.

[10]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[11]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[12]  H. Dickhaus,et al.  Classifying biosignals with wavelet networks [a method for noninvasive diagnosis] , 1996 .

[13]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[14]  Brian C. Lovell,et al.  The Multiscale Classifier , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Masumi Ishikawa,et al.  Structural learning with forgetting , 1996, Neural Networks.

[16]  Takeo Watanabe,et al.  Neural networks for vision and image processing , 1993 .

[17]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[18]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Anil Nerode,et al.  Hybrid Knowledge Bases , 1996, IEEE Trans. Knowl. Data Eng..

[20]  C. Lee Giles,et al.  Extraction of rules from discrete-time recurrent neural networks , 1996, Neural Networks.

[21]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[22]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[24]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[25]  Ah-Hwee Tan,et al.  Adaptive resonance associative map , 1995, Neural Networks.

[26]  P. K. Simpson.  Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[27]  S. Grossberg.  The Attentive Brain , 1995 .

[28]  Chuen-Tsai Sun,et al.  Rule-base structure identification in an adaptive-network-based fuzzy inference system , 1994, IEEE Trans. Fuzzy Syst..

[29]  V. Garg,et al.  Supervisory control of real-time discrete-event systems using lattice theory , 1996, IEEE Trans. Autom. Control..

[30]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[31]  R. Parasuraman.  The attentive brain , 1998 .