On the computational basis of learning and cognition: Arguments from LSA

Publisher Summary This chapter discusses the computational basis of learning and cognition. To deal with a continuously changing environment, living things have three choices: (1) evolve unvarying processes that usually succeed, (2) evolve genetically fixed effector, perceptual, and computational functions that are contingent on the environment, and (3) learn adaptive functions during their lifetimes. The theme of this chapter is the relation between (2) and (3): the nature of evolutionarily determined computational processes that support learning. The principal goal of this chapter has been to suggest that high-dimensional vector space computations based on empirical associations among very large numbers of components could be a close model of a fundamental computational basis of most learning in both verbal and perceptual domains. More powerful representational effects can be brought about by linear inductive combinations of the elements of very large vocabularies than has often been realized. Success of one such model to demonstrate many natural properties of language commonly assumed to be essentially more complex, nonlinear, and/or unlearned, along with evidence and argument that similar computations may serve similar roles in object recognition, are taken to reaffirm the possibility that a single underlying associational mechanism lies behind many more special and complex appearing cognitive phenomena.

[1]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[2]  J. Sachs Recognition memory for syntactic and semantic aspects of connected discourse , 1967 .

[3]  John D. Bransford,et al.  The abstraction of linguistic ideas , 1971 .

[4]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[5]  Shimon Edelman,et al.  Representation and recognition in vision , 1999 .

[6]  David J. Goodman,et al.  Personal Communications , 1994, Mobile Communications.

[7]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[8]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999, Cogn. Sci..

[9]  Nick Chater,et al.  Connectionist natural language processing: the state of the art , 1999, Cogn. Sci..

[10]  Charles A. Perfetti,et al.  The limits of co‐occurrence: Tools and theories in language research , 1998 .

[11]  N. Goodman Problems and projects , 1979 .

[12]  Susan T. Dumais,et al.  Latent Semantic Indexing (LSI) and TREC-2 , 1993, TREC.

[13]  Curt Burgess,et al.  Explorations in context space: Words, sentences, discourse , 1998 .

[14]  Thomas K. Landauer,et al.  How Much do People Remember? Some Estimates of the Quantity of Learned Information in Long-Term Memory , 1986, Cogn. Sci..

[15]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[16]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[17]  D S Rae,et al.  Limitations of diagnostic criteria and assessment instruments for mental disorders. Implications for research and policy. , 1998, Archives of general psychiatry.

[18]  S Edelman,et al.  Representation is representation of similarities , 1996, Behavioral and Brain Sciences.

[19]  Susan T. Dumais,et al.  Improving the retrieval of information from external sources , 1991 .

[20]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[21]  Susan T. Dumais,et al.  How come you know so much? From practical problem to theory , 1996 .

[22]  L. Gleitman,et al.  Language and Experience: Evidence from the Blind Child , 1988 .

[23]  Mark S. Seidenberg,et al.  Language Acquisition and Use: Learning and Applying Probabilistic Constraints , 1997, Science.

[24]  S. Pinker The Language Instinct , 1994 .

[25]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[26]  Bob Rehder,et al.  Using latent semantic analysis to assess knowledge: Some technical considerations , 1998 .

[27]  Peter W. Foltz,et al.  Analysis of text coherence using Latent Semantic Analysis , 1998 .

[28]  Ronald Rosenfeld,et al.  A maximum entropy approach to adaptive statistical language modelling , 1996, Comput. Speech Lang..

[29]  Gerry Stahl,et al.  Developing Summarization Skills through the Use of LSA-Based Feedback , 2000, Interact. Learn. Environ..

[30]  Alice J. O'Toole,et al.  CATEGORIZATION AND IDENTIFICATION OF HUMAN FACE IMAGES BY NEURAL NETWORKS: A REVIEW OF THE LINEAR AUTOASSOCIATIVE AND PRINCIPAL COMPONENT APPROACHES , 1994 .

[31]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[32]  Marcia K. Johnson,et al.  Contextual prerequisites for understanding: Some investigations of comprehension and recall , 1972 .

[33]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[34]  A. L. MACKAY,et al.  Optimization of the Genetic Code , 1967, Nature.

[35]  Thomas K. Landauer,et al.  Single representations of multiple meanings in latent semantic analysis. , 2001 .

[36]  M. Tomasello Do young children have adult syntactic competence? , 2000, Cognition.

[37]  J. M. Anglin Vocabulary Development: A Morphological Analysis , 1994 .

[38]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[39]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[40]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[41]  Peter W. Foltz,et al.  Learning from text: Matching readers and texts by latent semantic analysis , 1998 .

[42]  Peter W. Foltz,et al.  An analysis of textual coherence using latent semantic indexing , 1993 .

[43]  Peter W. Foltz,et al.  The Measurement of Textual Coherence with Latent Semantic Analysis. , 1998 .

[44]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[45]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[46]  D. Osherson,et al.  Learning theory and natural language , 1984, Cognition.

[47]  Asa Kasher,et al.  The Chomskyan Turn , 1993 .

[48]  A. Glenberg,et al.  Symbol Grounding and Meaning: A Comparison of High-Dimensional and Embodied Theories of Meaning , 2000 .