Nonmonotonic Inferences in Neural Networks

We show that by introducing an appropriate schema concept and exploiting the higher-level features of a resonance function in a neural network it is possible to define a form of nonmonotonic inference relation between the input and the output of the network. This inference relation satisfies some of the most fundamental postulates for nonmonotonic logics. The construction presented in the paper is an example of how symbolic features can emerge from the subsymbolic level of a neural network.

[1]  Peter Gärdenfors.  Nonmonotonic Inferences Based on Expectations: A Preliminary Report , 1991, KR.

[2]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[3]  Michael A. Arbib,et al.  From Schema Theory To Language , 1987 .

[4]  M. Arbib,et al.  Vision, brain, and cooperative computation , 1990 .

[5]  Mark Derthick,et al.  Mundane Reasoning by Settling on a Plausible Model , 1990, Artif. Intell..

[6]  J. L. Hemmen,et al.  Nonlinear neural networks. , 1986, Physical review letters.

[7]  David Makinson,et al.  General Theory of Cumulative Inference , 1988, NMR.

[8]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[9]  Drew McDermott,et al.  Introduction to artificial intelligence , 1986, Addison-Wesley series in computer science.

[10]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[12]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[13]  Bart Kosko.  Constructing an associative memory , 1987 .

[14]  Geoffrey E. Hinton,et al.  Schemata and Sequential Thought Processes in PDP Models , 1986 .

[15]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[16]  Peter Gärdenfors,et al.  The Dynamics of Belief as a Basis for Logic , 1984, The British Journal for the Philosophy of Science.

[17]  W. Hardy.  The Conduction of the Nervous Impulse , 1918, Nature.

[18]  G. Reeke.  Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[19]  Dov M. Gabbay,et al.  Theoretical Foundations for Non-Monotonic Reasoning in Expert Systems , 1989, Logics and Models of Concurrent Systems.

[20]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Andrew Woodfield,et al.  The reality of the symbolic and subsymbolic systems , 1988, Behavioral and Brain Sciences.

[22]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[23]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[24]  J. Nicholls.  From neuron to brain , 1976 .

[25]  Sarit Kraus,et al.  Nonmonotonic Reasoning, Preferential Models and Cumulative Logics , 1990, Artif. Intell..

[26]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[27]  Christian Balkenius,et al.  NEURAL MECHANISMS FOR SELF-ORGANIZATION OF EMERGENT SCHEMATA, DYNAMICAL SCHEMA PROCESSING, AND SEMANTIC CONSTRAINT SATISFACTION , 1993 .

[28]  S. Pinker,et al.  Connections and symbols , 1988 .

[29]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[30]  Peter Gärdenfors,et al.  Relations between the logic of theory change and nonmonotonic logic , 1989, The Logic of Theory Change.

[31]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[32]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[33]  Geoffrey E. Hinton.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[34]  R. A. Davidoff.  From Neuron to Brain , 1977, Neurology.

[35]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[36]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[37]  F Lhermitte.  [Memory and intelligence]. , 1975, Revista de neuro-psiquiatria.