Uncertainty of data, fuzzy membership functions, and multilayer perceptrons

Probability that a crisp logical rule applied to imprecise input data is true may be computed using fuzzy membership function (MF). All reasonable assumptions about input uncertainty distributions lead to MFs of sigmoidal shape. Convolution of several inputs with uniform uncertainty leads to bell-shaped Gaussian-like uncertainty functions. Relations between input uncertainties and fuzzy rules are systematically explored and several new types of MFs discovered. Multilayered perceptron (MLP) networks are shown to be a particular implementation of hierarchical sets of fuzzy threshold logic rules based on sigmoidal MFs. They are equivalent to crisp logical networks applied to input data with uncertainty. Leaving fuzziness on the input side makes the networks or the rule systems easier to understand. Practical applications of these ideas are presented for analysis of questionnaire data and gene expression data.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[3]  Janusz Kacprzyk,et al.  The Ordered Weighted Averaging Operators , 1997 .

[4]  Abraham Kandel,et al.  Neuro-Fuzzy Pattern Recognition , 2000 .

[5]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[6]  Kevin M. Passino,et al.  Avoiding exponential parameter growth in fuzzy systems , 2001, IEEE Trans. Fuzzy Syst..

[7]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[8]  Tarun Khanna,et al.  Foundations of neural networks , 1990 .

[9]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[10]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[11]  Krzysztof Grabczewski,et al.  Extraction of logical rules from backpropagation networks , 1998 .

[12]  Norbert Jankowski,et al.  Survey of Neural Transfer Functions , 1999 .

[13]  Nikola Kasabov,et al.  Foundations Of Neural Networks, Fuzzy Systems, And Knowledge Engineering [Books in Brief] , 1996, IEEE Transactions on Neural Networks.

[14]  Norbert Jankowski,et al.  New developments in the Feature Space Mapping model , 2000 .

[15]  Norbert Jankowski Approximation and Classification in Medicine with IncNet Neural Networks1 , 1999 .

[16]  K. Gr,et al.  A general purpose separability criterion for classification systems , 1999 .

[17]  Wlodzislaw Duch,et al.  Feature space mapping as a universal adaptive system , 1995 .

[18]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[19]  James E. Andrews,et al.  Combinatorial rule explosion eliminated by a fuzzy rule configuration , 1998, IEEE Trans. Fuzzy Syst..

[20]  J. Mesirov,et al.  Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. , 1999, Science.

[21]  George J. Klir,et al.  Uncertainty-Based Information , 1999 .

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Li-Xin Wang,et al.  Analysis and design of hierarchical fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[24]  Ming-Ling Lee,et al.  Modeling of hierarchical fuzzy systems , 2003, Fuzzy Sets Syst..

[25]  Wlodzislaw Duch,et al.  Extraction of Logical Rules from Neural Networks , 1998, Neural Processing Letters.

[26]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[27]  J. Butcher,et al.  Personality: individual differences and clinical assessment. , 1996, Annual review of psychology.

[28]  Claudio Moraga,et al.  Functional equivalence between S-neural networks and fuzzy models , 2002 .