Symbolic Knowledge Extraction using Łukasiewicz Logics

This work describes a methodology that combines logic-based systems and connectionist systems. Our approach uses finite truth-valued {\L}ukasiewicz logic, wherein every connective can be defined by a neuron in an artificial network. This allowed the injection of first-order formulas into a network architecture, and also simplified symbolic rule extraction. For that we trained a neural networks using the Levenderg-Marquardt algorithm, where we restricted the knowledge dissemination in the network structure. This procedure reduces neural network plasticity without drastically damaging the learning performance, thus making the descriptive power of produced neural networks similar to the descriptive power of {\L}ukasiewicz logic language and simplifying the translation between symbolic and connectionist structures. We used this method for reverse engineering truth table and in extraction of formulas from real data sets.

[1]  Juan Luis Castro Peña,et al.  The logic of neural networks , 1998 .

[2]  Jude W. Shavlik,et al.  Knowledge-Based Artificial Neural Networks , 1994, Artif. Intell..

[3]  P. Amato,et al.  Neural Networks and Rational ÃLukasiewicz Logic , 2002 .

[4]  Martin T. Hagan,et al.  Neural network design , 1995 .

[5]  Petr Hájek,et al.  Fuzzy Logic From The Logical Point of View , 1995, SOFSEM.

[6]  Li-Min Fu,et al.  Knowledge-based connectionism for revising domain theories , 1993, IEEE Trans. Syst. Man Cybern..

[7]  Jude W. Shavlik,et al.  Extracting Refined Rules from Knowledge-Based Neural Networks , 1993, Machine Learning.

[8]  Stephen I. Gallant,et al.  Neural network learning and expert systems , 1993 .

[9]  B. Wilamowski,et al.  A MODIFIED REGRESSION ALGORITHM FOR FAST ONE LAYER NEURAL NETWORK TRAINING by , 2000 .

[10]  Stephen I. Gallant,et al.  Connectionist expert systems , 1988, CACM.

[11]  Steffen Hölldobler Challenge problems for the integration of logic and connectionist systems , 2000, WLP.

[12]  José Luiz Fiadeiro,et al.  Semantics of Architectural Connectors , 1997, TAPSOFT.

[13]  Gregory J. Wolff,et al.  Optimal Brain Surgeon and general network pruning , 1993, IEEE International Conference on Neural Networks.

[14]  Wan Ahmad Tajuddin Wan Abdullah,et al.  The Logic of Neural Networks , 1993 .

[15]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[16]  Pascal Hitzler,et al.  Logic programs and connectionist networks , 2004, J. Appl. Log..