Can Connectionist Models Exhibit Non-Classical Structure Sensitivity?

Several connectionist models have been supplying non-classical explanations to the challenge of explaining systematicity, i.e., structure sensitive processes, without merely being implementations of classical architectures. However, lately the challenge has been extended to include learning related issues. It has been claimed that when these issues are taken into account, only a restricted form of systematicity could be claimed by the connectionist models put forward so far. In this paper we investigate this issue further, and supply a model and results that satisfies even the revised challenge.

[1]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[2]  Daniel Bonevac.  The Art And Science Of Logic , 1990 .

[3]  J. Fodor,et al.  Connectionism and the problem of systematicity: Why Smolensky's solution doesn't work , 1990, Cognition.

[4]  Tim van Gelder,et al.  Compositionality: A Connectionist Variation on a Classical Theme , 1990, Cogn. Sci..

[5]  Lonnie Chrisman,et al.  Learning Recursive Distributed Representations for Holistic Computation , 1991 .

[6]  Lars Niklasson,et al.  Structure Sensitivity in Connectionist Models , 1993 .

[7]  O. Brousse.  Generativity and systematicity in neural network combinatorial learning , 1992 .

[8]  Jordan B. Pollack,et al.  Recursive Distributed Representations , 1990, Artif. Intell..

[9]  Mikael Bodén,et al.  A Representational Architecture for Nonmonotonic Inheritance Structures , 1993 .

[10]  Robert F. Hadley.  Systematicity in Connectionist Language Learning , 1994 .

[11]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[12]  Paul Smolensky,et al.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1990, Artif. Intell..

[13]  Steven Phillips,et al.  Connectionism and the problem of systematicity , 1995 .

[14]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[15]  T. Gelder,et al.  Classical Questions, Radical Answers: Connectionism and the Structure of Mental Representations , 1991 .

[16]  Geoffrey E. Hinton.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[17]  Ashwin Ram,et al.  Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society , 2019 .

[18]  Lars Niklasson,et al.  Systematicity and Generalisation in Connectionist Compositional Representations , 1993 .