From Simple Associations to Systemic Reasoning: A Connectionist Representation of Rules, Variables and Dynamic Bindings

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency as though these inferences are a reflex response of their cognitive apparatus. The work presented in this paper is a step toward a computational account of this remarkable reasoning ability. We describe how a connectionist system made up of simple and slow neuron-like elements can encode millions of facts and rules involving n-ary predicates and variables, and yet perform a variety of inferences within hundreds of milliseconds. We observe that an efficient reasoning system must represent and propagate, dynamically, a large number of variable bindings. The proposed system does so by propagating rhythmic patterns of activity wherein dynamic bindings are represented as the in-phase, i.e., synchronous, firing of appropriate nodes. The mechanisms for representing and propagating dynamic bindings are biologically plausible. Neurophysiological evidence suggests that similar mechanisms may in fact be used by the brain to represent and process sensorimotor information. Comments University of Pennsylvania Department of Computer and Information Science Technical Report No. MSCIS-90-05. This technical report is available at ScholarlyCommons: https://repository.upenn.edu/cis_reports/819 FROM SI'MPLE ASSOCIATIONS TO SYSTEMATIC REASONING: A CONNECTIONIST REPRESENTATION OF RULES, VARIABLES AND DYNAMIC BINDINGS Lokendra Shastri Venkat Ajjanagadde MS-CIS-90-05 LINC LAB 162 Department of Computer and Information Science School of Engineering and Applied Science University of Pennsylvania Philadelphia, PA 191 04

[1]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[2]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[3]  R. Llinás,et al.  Electrotonic coupling between neurons in cat inferior olive. , 1974, Journal of neurophysiology.

[4]  F. Dudek,et al.  Dye-coupling between CA3 pyramidal cells in slices of rat hippocampus , 1980, Brain Research.

[5]  K. Tanaka,et al.  Cross-Correlation Analysis of Interneuronal Connectivity in cat visual cortex. , 1981, Journal of neurophysiology.

[6]  Tj Sejnowski,et al.  Skeleton filters in the brain , 2014 .

[7]  James F. Allen,et al.  Knowledge Retrieval as Limited Inference , 1982, CADE.

[8]  F. Crick Function of the thalamic reticular complex: the searchlight hypothesis. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[9]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[10]  P. Smolensky On variable binding and the representation of symbolic structures in connectionist systems , 1987 .

[11]  G. Gillett Neurophilosophy: Toward a Unified Science of the Mind-Brain , 1987 .

[12]  C. P. Dolan,et al.  Parallel retrieval and application to conceptual knowledge , 1987 .

[13]  Gray Clossman,et al.  A model of categorization and learning in a connectionist broadcast system , 1988 .

[14]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[15]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[16]  Lokendra Shastri,et al.  A Connectionist Approach to Knowledge Representation and Limited Inference , 1988, Cogn. Sci..

[17]  Keith Stenning,et al.  On the construction of representations for individuals from descriptions in text , 1988 .

[18]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[19]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[20]  Mark Alan Fanty Learning in structured connectionist networks , 1988 .

[21]  L. Shastri,et al.  A Connectionist System for Rule Based Reasoning With Multi-Place Predicates and Variables , 1989 .

[22]  Chung Hee Hwang,et al.  An Episodic Knowledge Representation for Narrative Texts , 1989, KR.

[23]  Lokendra Shastri,et al.  The Relevance of Connectionism to AI: A Representation and Reasoning Perspective , 1989 .

[24]  G. W. Strong,et al.  A solution to the tag-assignment problem for neural networks , 1989, Behavioral and Brain Sciences.

[25]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[26]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[27]  S. H. Weber A structured connectionist approach to direct inferences and figurative adjective-noun combinations , 1990 .

[28]  LOKENDRA SHASTRI,et al.  CONNECTIONISM AND THE COMPUTATIONAL EFFECTIVENESS OF REASONING , 1990 .