A General Reflex Fuzzy Min-Max Neural Network

A General Reflex Fuzzy Min-Max Neural Network" (GRFMN) is presented. GRFMN is capable to extract the underlying structure of the data by means of supervised, unsupervised and partially supervised learning. Learning under partial supervision is of high importance for the practical implementation of pattern recognition systems, as it may not be always feasible to get a fully labeled dataset for training or cost of labeling all samples is not affordable. GRFMN applies the acquired knowledge to learn a mixture of labeled and unlabeled data. It uses aggregation of hyperbox fuzzy sets to represent a class or cluster. A novel reflex mechanism inspired from human brain is used to solve the problem of class overlaps. The reflex mechanism consists of compensatory neurons which become active if the test data belongs to an overlap region of two or more hyperboxes representing different classes. These neurons help to approximate the complex topology of data in a better way. The proposed new learning approach to deal with partially labeled data and inclusion of compensatory neurons, has improved the performance of GRFMN significantly. The advantages of GRFMN are its ability to learn the data in a single pass through and no requirement of retraining while adding a new class or deleting an existing class. The performance of GRFMN is compared with "General Fuzzy Min-Max Neural Network" proposed by Gabrys and Bargiela. The experimental results on real datasets show a better performance of GRFMN.

[1]  Prabir Kumar Biswas,et al.  A fuzzy min-max neural network classifier with compensatory neuron architecture , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Prabir Kumar Biswas,et al.  A General Fuzzy Min Max Neural Network with Compensatory Neuron Architecture , 2005, KES.

[4]  P. K. Simpson Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[5]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[6]  Chen Xi,et al.  Recursive training for multi-resolution fuzzy min-max neural network classifier , 2001, 2001 6th International Conference on Solid-State and Integrated Circuit Technology. Proceedings (Cat. No.01EX443).

[7]  Massih-Reza Amini,et al.  The use of unlabeled data to improve supervised learning for text summarization , 2002, SIGIR '02.

[8]  Shigeo Abe,et al.  A method for fuzzy rules extraction directly from numerical data and its application to pattern classification , 1995, IEEE Trans. Fuzzy Syst..

[9]  A Hittmair,et al.  Human Biology , 1963, Nature.

[10]  James C. Bezdek,et al.  Partially supervised clustering for image segmentation , 1996, Pattern Recognit..

[11]  S. Grossberg,et al.  Fuzzy ART: an adaptive resonance algorithm for rapid, stable classification of analog patterns , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[12]  Bogdan Gabrys,et al.  Combining labelled and unlabelled data in the design of pattern classification systems , 2004, Int. J. Approx. Reason..

[13]  Andrzej Bargiela,et al.  An inclusion/exclusion fuzzy hyperbox classifier , 2004, Int. J. Knowl. Based Intell. Eng. Syst..

[14]  Bowen Alpern,et al.  The hyperbox , 1991, Proceeding Visualization '91.

[15]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[16]  Fabio Massimo Frattale Mascioli,et al.  A constructive approach to neuro-fuzzy networks , 1998, Signal Process..

[17]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Antonello Rizzi,et al.  Adaptive resolution min-max classifiers , 2002, IEEE Trans. Neural Networks.

[20]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[21]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[22]  Rayid Ghani,et al.  Combining Labeled and Unlabeled Data for MultiClass Text Categorization , 2002, ICML.

[23]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition , 1992 .

[24]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.