The (Non)Necessity of Recursion in Natural Language Processing

The prima facie unbounded nature of natural language, contrasted with the finite character of our memory and computational resources, is often taken to warrant a recursive language processing mechanism. The widely held distinction between an idealized infinite grammatical competence and the actual finite natural language performance provides further support for a recursive processor. In this paper, I argue that it is only necessary to postulate a recursive language mechanism insofar as the competence/performance distinction is upheld. However, I provide reasons for eschewing the latter and suggest that only data regarding observable linguistic behaviour ought to be used when modelling the human language mechanism. A connectionist model of language processing—the simple recurrent network proposed by Elman—is discussed as an example of a non-recursive alternative and I conclude that the computational power of such models promises to be sufficient to account for natural language behaviour.

[1]  Elisabet Engdahl,et al.  Readings on unbounded dependencies in Scandinavian languages , 1982 .

[2]  Zenon W. Pylyshyn,et al.  Connectionism and cognitive architecture , 1993 .

[3]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[4]  J. Elman Distributed Representations, Simple Recurrent Networks, And Grammatical Structure , 1991 .

[5]  Stephen Pulman,et al.  Grammars, parsers, and memory limitations , 1986 .

[6]  Robert F. Port,et al.  Representing Aspects of Language , 1991 .

[7]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[8]  J. Kimball Seven principles of surface structure parsing in natural language , 1973 .

[9]  E. Wanner The ATN and the sausage machine: Which one is baloney? , 1980, Cognition.

[10]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[11]  James L. McClelland,et al.  Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences , 1986 .

[12]  P. A. Reich The Finiteness of Natural Language , 1969 .

[13]  M Bates,et al.  Generative Grammar , 2022 .

[14]  James L. McClelland,et al.  Graded state machines: The representation of temporal contingencies in simple recurrent networks , 1991, Machine Learning.

[15]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[16]  Nick Chater,et al.  BOOTSTRAPPING SYNTACTIC CATEGORIES , 1992 .

[17]  Geoffrey K. Pullum,et al.  Generalized Phrase Structure Grammar , 1985 .

[18]  Tim van Gelder Connectionism and Language Processing , 1990, ÖGAI.

[19]  Noam Chomsky Knowledge of Language , 1986 .

[20]  Tim van Gelder,et al.  Compositionality: A Connectionist Variation on a Classical Theme , 1990, Cogn. Sci..

[21]  Janet D. Fodor,et al.  The sausage machine: A new two-stage parsing model , 1978, Cognition.