A Novel Neural Network Model Specified for Representing Logical Relations

With computers to handle more and more complicated things in variable environments, it becomes an urgent requirement that the artificial intelligence has the ability of automatic judging and deciding according to numerous specific conditions so as to deal with the complicated and variable cases. ANNs inspired by brain is a good candidate. However, most of current numeric ANNs are not good at representing logical relations because these models still try to represent logical relations in the form of ratio based on functional approximation. On the other hand, researchers have been trying to design novel neural network models to make neural network model represent logical relations. In this work, a novel neural network model specified for representing logical relations is proposed and applied. New neurons and multiple kinds of links are defined. Inhibitory links are introduced besides exciting links. Different from current numeric ANNs, one end of an inhibitory link connects an exciting link rather than a neuron. Inhibitory links inhibit the connected exciting links conditionally to make this neural network model represent logical relations correctly. This model can simulate the operations of Boolean logic gates, and construct complex logical relations with the advantages of simpler neural network structures than recent works in this area. This work provides some ideas to make neural networks represent logical relations more directly and efficiently, and the model could be used as the complement to current numeric ANN to deal with logical issues and expand the application areas of ANN.

[1]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[2]  Wonkyum Lee,et al.  Modular combination of deep neural networks for acoustic modeling , 2013, INTERSPEECH.

[3]  Nancy Y. Ip,et al.  China Brain Project: Basic Neuroscience, Brain Diseases, and Brain-Inspired Computing , 2016, Neuron.

[4]  San Cristóbal Mateo,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996 .

[5]  François Chollet,et al.  Deep Learning with Python , 2017 .

[6]  Xun Wang,et al.  Design of logic gates using spiking neural P systems with homogeneous neurons and astrocytes-like control , 2016, Inf. Sci..

[7]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[8]  Dov M. Gabbay,et al.  Neural-Symbolic Cognitive Reasoning , 2008, Cognitive Technologies.

[9]  Gary M. Scott Knowledge-based artificial neural networks for process modelling and control , 1993 .

[10]  Michael Negnevitsky,et al.  Artificial Intelligence: A Guide to Intelligent Systems , 2001 .

[11]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  Kai-Uwe Kühnberger,et al.  Towards integrated neural–symbolic systems for human-level AI: Two research programs helping to bridge the gaps , 2015, BICA 2015.

[13]  Leslie G. Valiant,et al.  Knowledge Infusion , 2006, AAAI.

[14]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[15]  George Luger,et al.  Artificial Intelligence: Structures and Strategies for Complex Problem Solving (5th Edition) , 2004 .

[16]  Jacek Mańdziuk,et al.  A Neural Network Performing Boolean Logic Operations , 2003 .

[17]  Mihai Ionescu,et al.  Several Applications of Spiking Neural P Systems , 2007 .

[18]  Kaile Su,et al.  Learning of Human-like Algebraic Reasoning Using Deep Feedforward Neural Networks , 2017, Biologically Inspired Cognitive Architectures.

[19]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[20]  Christopher Potts,et al.  Recursive Neural Networks Can Learn Logical Semantics , 2014, CVSC.

[21]  Gang Wang,et al.  Leaf Classification Utilizing a Convolutional Neural Network with a Structure of Single Connected Layer , 2016, ICIC.

[22]  Luc De Raedt,et al.  Neural-Symbolic Learning and Reasoning: Contributions and Challenges , 2015, AAAI Spring Symposia.

[23]  Artur S. d'Avila Garcez,et al.  A Neural-Symbolic Cognitive Agent for Online Learning and Reasoning , 2011, IJCAI.

[24]  Cornelia I Bargmann,et al.  The Brain Research Through Advancing Innovative Neurotechnologies (BRAIN) initiative and neurology. , 2014, JAMA neurology.

[25]  Gang Wang,et al.  Automatical Knowledge Representation of Logical Relations by Dynamical Neural Network , 2017, J. Intell. Syst..

[26]  Gheorghe Paun Spiking Neural P Systems: A Tutorial , 2007, Bull. EATCS.