A generic fuzzy aggregation operator: rules extraction from and insertion into artificial neural networks

Multilayered feedforward artificial neural networks (ANNs) are black boxes. Several methods have been published to extract a fuzzy system from a network, where the input–output mapping of the fuzzy system is equivalent to the mapping of the ANN. These methods are generalized by means of a new fuzzy aggregation operator. It is defined by using the activation function of a network. This fact lets to choose among several standard aggregation operators. A method to extract fuzzy rules from ANNs is presented by using this new operator. The insertion of fuzzy knowledge with linguistic hedges into an ANN is also defined thanks to this operator.

[1]  Robert M. Farber,et al.  How Neural Nets Work , 1987, NIPS.

[2]  Shlomo Geva,et al.  Local cluster neural net: Architecture, training and applications , 1998, Neurocomputing.

[3]  Leonardo Maria Reyneri.  Unification of neural and wavelet networks and fuzzy systems , 1999, IEEE Trans. Neural Networks.

[4]  W. Silvert.  Symmetric Summation: A Class of Operations on Fuzzy Sets , 1979 .

[5]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[6]  José Manuel Benítez,et al.  Interpretation of artificial neural networks by means of fuzzy rules , 2002, IEEE Trans. Neural Networks.

[7]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[8]  Frédéric Maire,et al.  Rule-extraction by backpropagation of polyhedra , 1999, Neural Networks.

[9]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[11]  Michael C. Mozer,et al.  Template-based procedures for neural network interpretation , 1999, Neural Networks.

[12]  Jacek M. Zurada,et al.  Computational intelligence methods for rule-based data understanding , 2004, Proceedings of the IEEE.

[13]  Ronald R. Yager,et al.  Full reinforcement operators in aggregation techniques , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Hiroshi Tsukimoto,et al.  Extracting rules from trained neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[15]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[16]  Bin-Da Liu.  Linguistic hedges and fuzzy rule base systems , 2003 .

[17]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[18]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[19]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[20]  Richard S. Johannes,et al.  Using the ADAP Learning Algorithm to Forecast the Onset of Diabetes Mellitus , 1988 .

[21]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[22]  Ronald R. Yager,et al.  Uninorm aggregation operators , 1996, Fuzzy Sets Syst..

[23]  Rudy Setiono.  Extracting M-of-N rules from trained neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[24]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[25]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[26]  Joydeep Ghosh,et al.  Symbolic Interpretation of Artificial Neural Networks , 1999, IEEE Trans. Knowl. Data Eng..

[27]  Michael Margaliot,et al.  Are artificial neural networks white boxes? , 2005, IEEE Transactions on Neural Networks.

[28]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[29]  Henrik Jacobsson,et al.  Rule Extraction from Recurrent Neural Networks: ATaxonomy and Review , 2005, Neural Computation.

[30]  Joachim Diederich,et al.  The truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks , 1998, IEEE Trans. Neural Networks.

[31]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[32]  Radko Mesiar,et al.  On the Relationship of Associative Compensatory operators to triangular Norms and Conorms , 1996, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[33]  H. Zimmermann,et al.  Latent connectives in human decision making , 1980 .