Relearning after Damage in Connectionist Networks: Toward a Theory of Rehabilitation

Connectionist modeling offers a useful computational framework for exploring the nature of normal and impaired cognitive processes. The current work extends the relevance of connectionist modeling in neuropsychology to address issues in cognitive rehabilitation: the degree and speed of recovery through retraining, the extent to which improvement on treated items generalizes to untreated items, and how treated items are selected to maximize this generalization. A network previously used to model impairments in mapping orthography to semantics is retrained after damage. The degree of relearning and generalization varies considerably for different lesion locations, and has interesting implications for understanding the nature and variability of recovery in patients. In a second simulation, retraining on words whose semantics are atypical of their category yields more generalization than retraining on more typical words, suggesting a counterintuitive strategy for selecting items in patient therapy to maximize recovery. In a final simulation, changes in the pattern of errors produced by the network over the course of recovery is used to constrain explanations of the nature of recovery of analogous brain-damaged patients. Taken together, the findings demonstrate that the nature of relearning in damaged connectionist networks can make important contributions to a theory of rehabilitation in patients.

[1]  James L. McClelland,et al.  Impaired Oral Reading in Surface Dyslexia: Detailed Comparison of a Patient and a Connectionist Model , 1998 .

[2]  Brendan S. Weekes,et al.  Surface Dyslexia and Surface Dysgraphia: Treatment Studies and Their Theoretical Implications , 1996 .

[3]  G. Dell,et al.  Recovery in Deep Dysphasia: Evidence for a Relation between Auditory–Verbal STM Capacity and Lexical Errors in Repetition , 1996, Brain and Language.

[4]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[5]  G. Ratcliff,et al.  Cognitive Neuropsychology and Cognitive Rehabilitation , 1995 .

[6]  Tim Shallice,et al.  Single and multiple component central dyslexic syndromes , 1995 .

[7]  David Glasspool,et al.  Can neuropsychological evidence inform connectionist modelling? Analyses of spelling , 1995 .

[8]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[9]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[10]  G. Dell,et al.  Origins of Paraphasias in Deep Dysphasia: Testing the Consequences of a Decay Impairment to an Interactive Spreading Activation Model of Lexical Retrieval , 1994, Brain and Language.

[11]  D. Klein The evolution of deep dyslexia: evidence for the spontaneous recovery of the semantic reading route , 1994 .

[12]  M. Farah Neuropsychological inference with an interactive brain: A critique of the "locality" assumption. , 1994 .

[13]  L. Schauble,et al.  Beyond Modularity: A Developmental Perspective on Cognitive Science. , 1994 .

[14]  Nick C. Ellis,et al.  Handbook of spelling : theory, process, and intervention , 1994 .

[15]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[16]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[17]  Randall C. O'Reilly,et al.  Dissociated overt and covert recognition as an emergent property of a lesioned neural network. , 1993, Psychological review.

[18]  Marius Usher,et al.  Neural Network Modeling of Memory Deterioration in Alzheimer's Disease , 1993, Neural Computation.

[19]  D. Geldmacher Cognitive Neuropsychology in Clinical Practice , 1993, Neurology.

[20]  D. Besner,et al.  Reading Aloud: Evidence for the Use of a Whole Word Nonsemantic Pathway , 1993 .

[21]  Argye E. Hillis,et al.  The role of models of language processing in rehabilitation of language impairments , 1993 .

[22]  T. Shallice,et al.  Perseverative and Semantic Influences on Visual Object Naming Errors in Optic Aphasia: A Connectionist Account , 1993, Journal of Cognitive Neuroscience.

[23]  James L. McClelland,et al.  Generalization with Componential Attractors: Word and Nonword Reading in an Attractor Network , 1993 .

[24]  Glyn W. Humphreys,et al.  Lesioning a connectionist model of visual search: selective effects on distractor grouping. , 1992, Canadian journal of psychology.

[25]  M. Behrmann,et al.  Surface dyslexia and dysgraphia: dual routes, single lexicon , 1992 .

[26]  David C. Plaut,et al.  Connectionist neuropsychology: the breakdown and recovery of behavior in lesioned attractor networks , 1992 .

[27]  J. Cohen,et al.  Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. , 1992, Psychological review.

[28]  Trevor A. Harley,et al.  Modelling Paraphasias in Normal and Aphasic Speech , 1992 .

[29]  C. C. Mitchum,et al.  Diagnosis and treatment of the non-lexical route in acquired dyslexia: an illustration of the cognitive neuropsychological approach , 1991, Journal of Neurolinguistics.

[30]  A. Caramazza,et al.  Category-specific naming and comprehension impairment: a double dissociation. , 1991, Brain : a journal of neurology.

[31]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[32]  A. Young,et al.  Understanding covert recognition , 1991, Cognition.

[33]  K. Paap,et al.  Dual-route models of print to sound: Still a good horse race , 1991 .

[34]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia. , 1991, Psychological review.

[35]  A. Hillis Effects of Separate Treatments for Distinct Impairments Within the Naming Process , 1991 .

[36]  Philip T. Quinlan,et al.  Connectionsim and psychology - a psychological perspective on new connectionist research , 1991 .

[37]  Matti Laine,et al.  Changing error patterns during reading recovery: A case study , 1990, Journal of Neurolinguistics.

[38]  Jing Peng,et al.  An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories , 1990, Neural Computation.

[39]  Bruce F. Pennington,et al.  Word identification in reading and the promise of subsymbolic psycholinguistics. , 1990, Psychological review.

[40]  R. Friedman,et al.  The Continuum of Deep/Phonological Alexia , 1990, Cortex.

[41]  K. Patterson,et al.  Rehabilitation for cognitive impairment: Does cognitive psychology apply? , 1990 .

[42]  Raju S. Bapi,et al.  Networks modeling the involvement of the frontal lobes in learning and performance of flexible movement sequences , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[43]  M. Mozer,et al.  On the Interaction of Selective Attention and Lexical Knowledge: A Connectionist Account of Neglect Dyslexia , 1990, Journal of Cognitive Neuroscience.

[44]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[45]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[46]  M Behrmann,et al.  Category-specific treatment of a lexical-semantic deficit: a single case study of global aphasia. , 1998, The British journal of disorders of communication.

[47]  David S. Touretzky,et al.  Advances in neural information processing systems 2 , 1989 .

[48]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[49]  Sally Byng,et al.  Computer assisted remediation of a homophone comprehension disorder in surface dyslexia , 1989 .

[50]  Daniel S. Levine,et al.  Modeling some effects of frontal lobe damage--Novelty and perseveration , 1989, Neural Networks.

[51]  Sally Byng,et al.  A treatment for surface dyslexia , 1989 .

[52]  A. Caramazza Cognitive neuropsychology and rehabilitation: An unfulfilled promise? , 1989 .

[53]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[54]  James L. McClelland,et al.  Connections and disconnections: Acquired dyslexia in a computational model of reading processes. , 1989 .

[55]  Hervé Bourlard,et al.  Generalization and Parameter Estimation in Feedforward Netws: Some Experiments , 1989, NIPS.

[56]  Sally Byng,et al.  Sentence processing deficits: Theory and therapy , 1988 .

[57]  James A. Reggia,et al.  Competitive Dynamics in a Dual-route Connectionist Model of Print-to-sound Transformation , 1988, Complex Syst..

[58]  Mark S. Seidenberg,et al.  Cognitive neuropsychology and language: The state of the art , 1988 .

[59]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[60]  E. Funnell,et al.  Morphological errors in acquired dyslexia: a case of mistaken identity. , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[61]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[62]  M. Coltheart,et al.  Attention and Performance XII: The Psychology of Reading , 1987 .

[63]  Marlene Behrmann,et al.  The rites of righting writing: Homophone remediation in acquired dysgraphia , 1987 .

[64]  James L. McClelland The Case for Interactionism in Language Processing. , 1987 .

[65]  Geoffrey E. Hinton Using fast weights to deblur old memories , 1987 .

[66]  M. Coltheart,et al.  The cognitive neuropsychology of language , 1987 .

[67]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[68]  D. Neary,et al.  Deep Dyslexia , 1986 .

[69]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[70]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[71]  Mp. Departz Reeducation of a Deep Dyslexic Patient - Rationale of the Method and Results , 1986 .

[72]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[73]  James L. McClelland,et al.  Amnesia and distributed memory , 1986 .

[74]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[75]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[76]  Sally Byng,et al.  Aphasia Therapy Research: Methodological Requirements and Illustrative Results , 1986 .

[77]  P. Eling Current perspectives in dysphasia, Stanton Newman, Ruth Epstein (Eds.). Churchill Livingstone, Edinburgh, London, Melbourne and New York (1985), 236, ISBN: 0 443 03039 1 , 1986 .

[78]  G. E. MacKinnon,et al.  Reading Research Advances in Theory and Practice , 1985 .

[79]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[80]  M. Coltheart,et al.  Surface dyslexia. , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[81]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[82]  Michael A. Arbib,et al.  Neural Models of Language Processes , 1982 .

[83]  Barry Gordon,et al.  24 – Confrontation Naming: Computational Model and Disconnection Simulation , 1982 .

[84]  Janice Kay,et al.  One Process, Not Two, in Reading Aloud: Lexical Analogies Do the Work of Non-Lexical Rules , 1981 .

[85]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[86]  M. Beauvois,et al.  Phonological alexia: three dissociations. , 1979, Journal of neurology, neurosurgery, and psychiatry.

[87]  M. Coltheart Lexical access in simple reading tasks , 1978 .

[88]  E. Rosch Cognitive Representations of Semantic Categories. , 1975 .

[89]  J. Marshall,et al.  Patterns of paralexia: a psycholinguistic approach. , 1995, Journal of psycholinguistic research.

[90]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[91]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[92]  J. Marshall,et al.  Syntactic and semantic errors in paralexia , 1966 .