Methodologies for the Computer Modeling of Human Cognitive Processes

Researchers interested in human cognitive processes have long used computer simulations to try to identify the principles of cognition. The strategy has been to build computational models that embody a set of principles and then the examine how well the models capture human performance in cognitive tasks. Computational modeling has both strengths and weaknesses in its usefulness in facilitating the development of cognitive theories. Perhaps its most important strength is that, in developing mechanistic theories of cognitive processes, it is critical to have a language or formalism for describing dynamic information processing in detail. Developing a working implementation of a model makes it possible both to verify the completeness and internal coherence of its underlying theoretical principles, and to generate detailed, quantitative predictions of the model when tested in novel circumstances. More generally, computational modeling can lead to new theoretical discoveries by providing a means of exploring the implications of a set of ideas or principles. There are, however, a number of potential pitfalls in the application of computational modeling to cognitive processes that must be kept in mind. First, developing an explicit implementation always involves augmenting core theoretical claims with less central, ancillary assumptions, and it can be difficult to evaluate the extent to which the behavior of the model depends on the latter instead of the former. Moreover, models may be underconstrained and are applied to modeling data post hoc without a sufficient consideration of whether there are patterns of data that the model could not produce (see Roberts & Pashler, 2000). Finally, models are often put forward as theories in an of themselves, without sufficient analysis and explanation of why the model accounts for the data (see McCloskey, 1991). In general, computational modeling would seem to be most productive when it is carried out in the service of clarifying theoretical claims and when it it tightly integrated with corresponding empirical studies. A number of formalisms have been applied to modeling cognitive processes, including production systems, discrimination nets, exemplar-based models, and connectionist models. The current chapter presents a brief summary of each of these approaches along with some illustrati ve examples. Particular emphasis is place on connectionist modeling as this is the framework that has been most widely applied to simulating neuropsychological phenomena.

[1]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[2]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory, Third Edition , 1989, Springer Series in Information Sciences.

[3]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[4]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[5]  M. McCloskey Networks and Theories: The Place of Connectionism in Cognitive Science , 1991 .

[6]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[7]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[8]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[9]  Mark S. Seidenberg,et al.  Impairments in verb morphology after brain injury: a connectionist model. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[11]  M. Farah,et al.  A unified account of cognitive impairments following frontal lobe damage: the role of working memory in complex, organized behavior. , 1993, Journal of experimental psychology. General.

[12]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[13]  Douglas L. T. Rohde,et al.  Language acquisition in the absence of explicit negative evidence: how important is starting small? , 1999, Cognition.

[14]  J. Elman Distributed representations, simple recurrent networks, and grammatical structure , 1991, Machine Learning.

[15]  John R. Anderson The Adaptive Character of Thought , 1990 .

[16]  Michael J. Spivey,et al.  Syntactic ambiguity resolution in discourse: modeling the effects of referential context and lexical frequency. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[17]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[18]  B. MacWhinney,et al.  Implementations are not conceptualizations: Revising the verb learning model , 1991, Cognition.

[19]  H B Richman,et al.  Simulation of expert memory using EPAM IV. , 1995, Psychological review.

[20]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[21]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[22]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[23]  S. Pinker,et al.  A Neural Dissociation within Language: Evidence that the Mental Dictionary Is Part of Declarative Memory, and that Grammatical Rules Are Processed by the Procedural System , 1997, Journal of Cognitive Neuroscience.

[24]  A. Newell Unified Theories of Cognition , 1990 .

[25]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[26]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[27]  M. Mozer,et al.  On the Interaction of Selective Attention and Lexical Knowledge: A Connectionist Account of Neglect Dyslexia , 1990, Journal of Cognitive Neuroscience.

[28]  Charles X. Ling,et al.  Learning the Past Tense of English Verbs: The Symbolic Pattern Associator vs. Connectionist Models , 1993, J. Artif. Intell. Res..

[29]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[30]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[31]  P. Thagard,et al.  Explanatory coherence , 1993 .

[32]  John E. Hummel,et al.  Distributed representations of structure: A theory of analogical access and mapping. , 1997 .

[33]  S Pinker,et al.  Rules of language. , 1991, Science.

[34]  V. Marchman,et al.  From rote learning to system building: acquiring verb morphology in children and connectionist nets , 1993, Cognition.

[35]  Philippe G. Schyns A Modular Neural Network Model of Concept Acquisition , 1991 .

[36]  Tim van Gelder,et al.  Compositionality: A Connectionist Variation on a Classical Theme , 1990, Cogn. Sci..

[37]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[38]  A. Young,et al.  Understanding covert recognition , 1991, Cognition.

[39]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[40]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[41]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[42]  G. M. Reicher Perceptual recognition as a function of meaninfulness of stimulus material. , 1969, Journal of experimental psychology.

[43]  S. Tipper,et al.  Inhibitory Mechanisms of Neural and Cognitive Control: Applications to Selective Attention and Sequential Action , 1996, Brain and Cognition.

[44]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[45]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[46]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[47]  Eric L. Schwartz,et al.  Computational Neuroscience , 1993, Neuromethods.

[48]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[49]  Edmund T. Rolls,et al.  Introduction to Connectionist Modelling of Cognitive Processes , 1998 .

[50]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[51]  David C. Plaut,et al.  Structure and Function in the Lexical System: Insights from Distributed Models of Word Reading and Lexical Decision , 1997 .

[52]  Ken N. Seergobin,et al.  On the association between connectionism and data: Are a few words necessary? , 1990 .

[53]  R. Miikkulainen Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[54]  Geoffrey E. Hinton Connectionist Symbol Processing , 1991 .

[55]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[56]  D. Plaut Relearning after Damage in Connectionist Networks: Toward a Theory of Rehabilitation , 1996, Brain and Language.

[57]  C. Ling,et al.  Answering the connectionist challenge: a symbolic model of learning the past tenses of English verbs , 1993, Cognition.

[58]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[59]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[60]  Daniel S. Levine,et al.  Modeling some effects of frontal lobe damage--Novelty and perseveration , 1989, Neural Networks.

[61]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[62]  Philip T. Quinlan,et al.  Connectionsim and psychology - a psychological perspective on new connectionist research , 1991 .

[63]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[64]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[65]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[66]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[67]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[68]  V. Marchman,et al.  Learning from a connectionist model of the acquisition of the English past tense , 1996, Cognition.

[69]  James L. McClelland,et al.  Learning and Applying Contextual Constraints in Sentence Comprehension , 1990, Artif. Intell..

[70]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[71]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[72]  James L. McClelland,et al.  Sentence comprehension: A parallel distributed processing approach , 1989, Language and Cognitive Processes.

[73]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[74]  M. Page,et al.  Connectionist modelling in psychology: A localist manifesto , 2000, Behavioral and Brain Sciences.