Modelling direct perceptual constraints on action selection: The Naming and Action Model (NAM)

There is increasing experimental and neuropsychological evidence that action selection is directly constrained by perceptual information from objects as well as by more abstract semantic knowledge. To capture this evidence, we develop a new connectionist model of action and name selection from objects — NAM (Naming and Action Model), based on the idea that action selection is determined by convergent input from both visual structural descriptions and abstract semantic knowledge. We show that NAM is able to simulate evidence for a direct route to action selection from both normal subjects (Experiments 1 and 2) and neuropsychological patients (Experiments 3-6). The model provides a useful framework for understanding how perceptual knowledge influences action selection.

[1]  F. Lhermitte,et al.  A visual-speech disconnexion syndrome. Report of a case with optic aphasia, agnosic alexia and colour agnosia. , 1973, Brain : a journal of neurology.

[2]  M. Potter,et al.  Time to understand pictures and words , 1975, Nature.

[3]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[4]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[5]  E. Renzi,et al.  Modality-specific and supramodal mechanisms of apraxia. , 1982, Brain : a journal of neurology.

[6]  M. Beauvois,et al.  Optic aphasia: a process of interaction between vision and language. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[7]  F. Lhermitte 'Utilization behaviour' and its relation to lesions of the frontal lobes. , 1983, Brain : a journal of neurology.

[8]  E. Roy,et al.  Common Considerations In The Study of Limb, Verbal And Oral Apraxia , 1985 .

[9]  G. V. van Orden A ROWS is a ROSE: spelling, sound, and reading. , 1987, Memory & cognition.

[10]  G. Humphreys,et al.  Visual object processing in optic aphasia: a case of semantic access agnosia , 1987 .

[11]  A. Ellis,et al.  A cognitive neuropsychological case study of anomia. Implications for psychological models of word retrieval. , 1987, Brain : a journal of neurology.

[12]  G. Humphreys,et al.  Routes to action: Evidence from apraxia , 1989 .

[13]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[14]  Eric Mjolsness,et al.  Algebraic transformations of objective functions , 1990, Neural Networks.

[15]  Alfonso Caramazza,et al.  The multiple semantics hypothesis: Multiple confusions? , 1990 .

[16]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[17]  M Poncet,et al.  The role of sensorimotor experience in object recognition. A case of multimodal agnosia. , 1991, Brain : a journal of neurology.

[18]  A. Sirigu,et al.  The role of sensorimotor experience in object recognition. A case of multimodal agnosia. , 1991, Brain : a journal of neurology.

[19]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia. , 1991, Psychological review.

[20]  D. Salmon,et al.  The nature of the naming deficit in Alzheimer's and Huntington's disease. , 1991, Brain : a journal of neurology.

[21]  Glyn W. Humphreys,et al.  Perseverant responding in speeded naming of pictures: It's in the links. , 1991 .

[22]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[23]  E. E. Cooper,et al.  Object recognition and laterality: Null effects , 1991, Neuropsychologia.

[24]  Glyn W. Humphreys,et al.  Impairment of Action to Visual Objects in a Case of Ideomotor Apraxia , 1991 .

[25]  W. Glaser Picture naming , 1992, Cognition.

[26]  R Job,et al.  The picture superiority effect in categorization: visual or semantic? , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[27]  T. Shallice,et al.  Perseverative and Semantic Influences on Visual Object Naming Errors in Optic Aphasia: A Connectionist Account , 1993, Journal of Cognitive Neuroscience.

[28]  J. Davidoff,et al.  Optic aphasia: A review of past studies and reappraisal , 1993 .

[29]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[30]  Glyn W. Humphreys,et al.  On Naming a Giraffe a Zebra: Picture Naming Errors Across Different Object Categories , 1993 .

[31]  M. Jeannerod,et al.  Impairment of grasping movements following a bilateral posterior parietal lesion , 1994, Neuropsychologia.

[32]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[33]  Alfonso Caramazza,et al.  Cognitive and Neural Mechanisms Underlying Visual and Semantic Processing: Implications from Optic Aphasia , 1995, Journal of Cognitive Neuroscience.

[34]  Leslie G. Ungerleider,et al.  Discrete Cortical Regions Associated with Knowledge of Color and Knowledge of Action , 1995, Science.

[35]  M. Goodale,et al.  The visual brain in action , 1995 .

[36]  Alfonso Caramazza,et al.  Constraining claims about theories of semantic memory: More on unitary versus multiple semantics , 1995 .

[37]  G. Humphreys,et al.  An interactive activation approach to object processing: effects of structural similarity, name frequency, and task in normality and pathology. , 1995, Memory.

[38]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[39]  E. Procyk,et al.  Brain activity during observation of actions. Influence of action content and subject's strategy. , 1997, Brain : a journal of neurology.

[40]  Scott T. Grafton,et al.  Premotor Cortex Activation during Observation and Naming of Familiar Tools , 1997, NeuroImage.

[41]  M. Jeannerod The cognitive neuroscience of action , 1997, Trends in Cognitive Sciences.

[42]  T. Shallice,et al.  Modality-Specific Operations in Semantic Dementia , 1997, Cortex.

[43]  Glyn W. Humphreys Dietmar Heinke,et al.  Spatial Representation and Selection in the Brain: Neuropsychological and Computational Constraints , 1998 .

[44]  G. Humphreys,et al.  Recognition by action: dissociating visual and semantic routes to action in normal observers. , 1998, Journal of experimental psychology. Human perception and performance.

[45]  Hanna Damasio,et al.  Premotor and Prefrontal Correlates of Category-Related Lexical Retrieval , 1998, NeuroImage.

[46]  K Tsutsui,et al.  Neural coding of 3D features of objects for hand action in the parietal cortex of the monkey. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[47]  G. Humphreys,et al.  Visual affordances direct action: neuropsychological evidence from manual interference. , 1998, Cognitive neuropsychology.

[48]  R. Ellis,et al.  On the relations between seen objects and components of potential actions. , 1998, Journal of experimental psychology. Human perception and performance.

[49]  J R Hodges,et al.  "What" and "how": evidence for the dissociation of object knowledge and mechanical problem-solving skills in the human brain. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[50]  J. Haxby,et al.  Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects , 1999, Nature Neuroscience.

[51]  Glyn W. Humphreys,et al.  From objects to names: A cognitive neuroscience approach , 1999, Psychological research.

[52]  A. Young,et al.  SIMULATING FACE RECOGNITION: IMPLICATIONS FOR MODELLING COGNITION , 1999 .

[53]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[54]  Glyn W. Humphreys,et al.  The neural substrates of action retrieval: An examination of semantic and visual routes to action , 2002 .

[55]  M. Desmurget,et al.  An ‘automatic pilot’ for the hand in human posterior parietal cortex: toward reinterpreting optic ataxia , 2000, Nature Neuroscience.

[56]  R. Ellis,et al.  The potentiation of grasp types during visual object categorization , 2001 .

[57]  Luciano Fadiga,et al.  Visuomotor Priming , 2001 .

[58]  Refractor Vision , 2000, The Lancet.

[59]  G. Humphreys,et al.  Cognitive neuropsychology and functional brain imaging: implications for functional and anatomical models of cognition. , 2001, Acta psychologica.

[60]  J. Riddoch,et al.  Visual affordances and object selection , 2001 .

[61]  Glyn W Humphreys,et al.  Dissociations between Object Knowledge and Everyday Action , 2002, Neurocase.

[62]  Glyn W Humphreys,et al.  Privileged access to action for objects relative to words , 2002, Psychonomic bulletin & review.

[63]  A. Georgopoulos,et al.  Parietal cortex neurons of the monkey related to the visual guidance of hand movement , 1990, Experimental Brain Research.