The neural mechanisms of visual selection: the view from neuropsychology

In this review, we discuss how neuropsychological impairments in visual selection can inform us about how selection normally operates. Using neuroanatomical and behavioral evidence on the disorders of neglect, extinction, and simultanagnosia, we propose functional and anatomical links between different aspects of visual selection and distinct sites in the posterior parietal cortex (PPC). This includes linking: (i) bottom‐up attentional capture and the right temporo‐parietal junction (TPJ); (ii) top‐down segmentation of displays and the medial PPC; (iii) grouping, individuation and identification, and the inferior intra‐parietal sulcus (IPS) bilaterally; and (iv) the suppression of saliency and the left IPS. In addition, when neuropsychological studies are combined with fMRI, there is evidence that these regions of the PPC interact with striate and extra‐striate cortical areas, which respond to specific properties of stimuli. Selection should be viewed as an emergent property of a network of areas involving both ventral and dorsal cortex.

[1]  Chris Rorden,et al.  Damage to white matter fiber tracts in acute spatial neglect. , 2009, Cerebral cortex.

[2]  Glyn W. Humphreys,et al.  The Special Effect of Case Mixing on Word Identification: Neuropsychological and Transcranial Magnetic Stimulation Studies Dissociating Case Mixing from Contrast Reduction , 2006, Journal of Cognitive Neuroscience.

[3]  J. Driver,et al.  Can Visual Neglect Operate in Object-centred Co-ordinates? An Affirmative Single-case Study , 1991 .

[4]  Lynn C. Robertson,et al.  Visual Search Performance in the Neglect Syndrome , 1989, Journal of Cognitive Neuroscience.

[5]  K. Heilman,et al.  Auditory neglect in man. , 1972, Archives of neurology.

[6]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[7]  Dietmar Heinke,et al.  A computational model of visual marking using an inter-connected network of spiking neurons: The spiking search over time & space model (sSoTS) , 2006, Journal of Physiology-Paris.

[8]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[9]  Gordon C. Baylis,et al.  Visual extinction and awareness: The importance of binding dorsal and ventral pathways , 2001 .

[10]  Glyn W. Humphreys,et al.  A tale of two agnosias: Distinctions between form and integrative agnosia , 2008, Cognitive neuropsychology.

[11]  G Holmes,et al.  DISTURBANCES OF VISUAL ORIENTATION , 1918, The British journal of ophthalmology.

[12]  E. Warrington,et al.  Failure of object recognition due to a breakdown of figure-ground discrimination in a patient with normal acuity , 1991, Neuropsychologia.

[13]  Andrew B. Leber,et al.  Coordination of Voluntary and Stimulus-Driven Attentional Control in Human Cortex , 2005, Psychological science.

[14]  Peter B Barker,et al.  Anatomy of Spatial Attention: Insights from Perfusion Imaging and Hemispatial Neglect in Acute Stroke , 2005, The Journal of Neuroscience.

[15]  Derrick G. Watson,et al.  Fractionating the preview benefit in search: dual-task decomposition of visual marking by timing and modality. , 2002, Journal of experimental psychology. Human perception and performance.

[16]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[17]  P M Matthews,et al.  Altered Hemodynamic Responses in Patients After Subcortical Stroke Measured by Functional MRI , 2002, Stroke.

[18]  E Làdavas,et al.  Selective spatial attention in patients with visual extinction. , 1990, Brain : a journal of neurology.

[19]  anonymous,et al.  Visual agnosia , 2012, BMJ : British Medical Journal.

[20]  Glyn W. Humphreys,et al.  Visual feature discrimination in simultanagnosia: A study of two cases , 1994 .

[21]  Iain D. Gilchrist,et al.  Categorisation of ‘perceptual’ and ‘premotor’ neglect patients across different tasks: is there strong evidence for a dichotomy? , 2002, Neuropsychologia.

[22]  Vijay Kannan,et al.  Neural Substrates of Visuospatial Processing in Distinct Reference Frames: Evidence from Unilateral Spatial Neglect , 2009, Journal of Cognitive Neuroscience.

[23]  J. Mattingley,et al.  Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness , 1998, Nature.

[24]  D. Plaut,et al.  A LITERATURE REVIEW AND NEW DATA SUPPORTING AN INTERACTIVE ACCOUNT OF LETTER-BY-LETTER READING. , 1998, Cognitive neuropsychology.

[25]  G W Humphreys,et al.  Neural representation of objects in space: a dual coding account. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Dietmar Heinke,et al.  The Spiking Search over Time and Space Model (sSoTS): Simulating Dual Task Experiments and the Temporal Dynamics of Preview Search , 2007, WAPCV.

[27]  Glyn W. Humphreys,et al.  Effects of saliency, not global dominance, in patients with left parietal damage , 2006, Neuropsychologia.

[28]  A. Berti,et al.  When Far Becomes Near: Remapping of Space by Tool Use , 2000, Journal of Cognitive Neuroscience.

[29]  M. Corbetta,et al.  A PET study of visuospatial attention , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[31]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[32]  Stephen Smith,et al.  Prioritizing new over old: An fMRI study of the preview search task , 2005, Human brain mapping.

[33]  Lilach Shalev,et al.  Implicit Location Encoding Via Stored Representations Of Familiar Objects: Neuropsychological Evidence , 2002, Cognitive neuropsychology.

[34]  Nele Demeyere,et al.  Distributed and focused attention: neuropsychological evidence for separate attentional mechanisms when counting and estimating. , 2007, Journal of experimental psychology. Human perception and performance.

[35]  E. Rolls,et al.  Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons. , 2005, Journal of neurophysiology.

[36]  Chris Rorden,et al.  The anatomy of spatial neglect based on voxelwise statistical analysis: a study of 140 patients. , 2004, Cerebral cortex.

[37]  Glyn W. Humphreys,et al.  Grouping and Extinction: Evidence for Low-level Modulation of Visual Selection , 1996 .

[38]  J. Gore,et al.  A Stimulus-Driven Approach to Object Identity and Location Processing in the Human Brain , 2000, Neuron.

[39]  R. Bálint Seelenlähmung des “Schauens”, optische Ataxie, räumliche Störung der Aufmerksamkeit. pp. 51–66 , 1909 .

[40]  Gordon C. Baylis,et al.  Visual Neglect can be Object-Based or Scene-Based Depending on Task Representation , 2004, Cortex.

[41]  Z. Pylyshyn,et al.  Why are small and large numbers enumerated differently? A limited-capacity preattentive stage in vision. , 1994, Psychological review.

[42]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[43]  Dietmar Heinke,et al.  Suppressive effects in visual search: A neurocomputational analysis of preview search , 2007, Neurocomputing.

[44]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[45]  M. Behrmann,et al.  Competition between simultaneous stimuli modulated by location probability in hemispatial neglect , 2006, Neuropsychologia.

[46]  G W Humphreys,et al.  Neuropsychological Evidence for Case-Specific Reading: Multi-Letter Units in Visual Word Recognition , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[47]  A. Young,et al.  Neglect and visual recognition. , 1992, Brain : a journal of neurology.

[48]  W. R. Brain VISUAL DISORIENTATION WITH SPECIAL REFERENCE TO LESIONS OF THE RIGHT CEREBRAL HEMISPHERE , 1941 .

[49]  Hans-Otto Karnath,et al.  Incidence of Visual Extinction After Left Versus Right Hemisphere Stroke , 2007, Stroke.

[50]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[51]  H. Karnath,et al.  Disturbed line bisection is associated with posterior brain lesions , 2006, Brain Research.

[52]  J. Downar,et al.  The Effect of Task Relevance on the Cortical Response to Changes in Visual and Auditory Stimuli: An Event-Related fMRI Study , 2001, NeuroImage.

[53]  Árni Kristjánsson,et al.  Priming of Color and Position during Visual Search in Unilateral Spatial Neglect , 2005, Journal of Cognitive Neuroscience.

[54]  Wilhelm Küker,et al.  The cortical substrate of visual extinction , 2003, Neuroreport.

[55]  L. Buxbaum,et al.  Neglect of chimeric figures: Two halves are better than a whole , 1994, Neuropsychologia.

[56]  J. Mattingley,et al.  The cognitive and neural bases of spatial neglect , 2004 .

[57]  Glyn W. Humphreys,et al.  Non-spatial extinction following lesions of the parietal lobe in humans , 1994, Nature.

[58]  P. Bartolomeo,et al.  White matter (dis)connections and gray matter (dys)functions in visual neglect: Gaining insights into the brain networks of spatial awareness , 2008, Cortex.

[59]  G. Humphreys,et al.  Automatic statistical processing of visual properties in simultanagnosia , 2008, Neuropsychologia.

[60]  G A Orban,et al.  Attentional responses to unattended stimuli in human parietal cortex. , 2005, Brain : a journal of neurology.

[61]  G. Humphreys,et al.  An analysis of the time course of attention in preview search , 2004, Perception & psychophysics.

[62]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[63]  Michael Erb,et al.  Brain activation during immediate and delayed reaching in optic ataxia , 2009, Neuropsychologia.

[64]  G. Humphreys,et al.  Lexical recovery from extinction: Interactions between visual form and stored knowledge modulate visual selection , 2001, Cognitive neuropsychology.

[65]  P. Goldman-Rakic,et al.  Prefrontal Activation Evoked by Infrequent Target and Novel Stimuli in a Visual Target Detection Task: An Event-Related Functional Magnetic Resonance Imaging Study , 2000, The Journal of Neuroscience.

[66]  Glyn W. Humphreys,et al.  An Onset Advantage without a Preview Benefit: Neuropsychological Evidence Separating Onset and Preview Effects in Search , 2006, Journal of Cognitive Neuroscience.

[67]  M. Mesulam Functional Anatomy of Attention and Neglect , 2002 .

[68]  S. Dehaene,et al.  Dissociable mechanisms of subitizing and counting: neuropsychological evidence from simultanagnosic patients. , 1994, Journal of experimental psychology. Human perception and performance.

[69]  Glyn W. Humphreys Dietmar Heinke,et al.  Spatial Representation and Selection in the Brain: Neuropsychological and Computational Constraints , 1998 .

[70]  Glyn W. Humphreys,et al.  Perceptual and Action Systems in Unilateral Visual Neglect , 1987 .

[71]  John Duncan,et al.  Attentional Functions in Dorsal and Ventral Simultanagnosia , 2003, Cognitive neuropsychology.

[72]  Glyn W. Humphreys,et al.  Reflexive and Preparatory Selection and Suppression of Salient Information in the Right and Left Posterior Parietal Cortex , 2009, Journal of Cognitive Neuroscience.

[73]  Kevin Dent,et al.  Deficits in visual search for conjunctions of motion and form after parietal damage but with spared hMT+/V5 , 2010, Cognitive neuropsychology.

[74]  Jon Driver,et al.  Grouping reduces visual extinction: Neuropsychological evidence for weight-linkage in visual selection , 1994 .

[75]  G. Humphreys,et al.  Dividing the mind: The necessary role of the frontal lobes in separating memory from search , 2006, Neuropsychologia.

[76]  G. Humphreys,et al.  Transient binding by time: Neuropsychological evidence from anti-extinction , 2002, Cognitive neuropsychology.

[77]  Árni Kristjánsson,et al.  Repetition of distractor sets improves visual search performance in hemispatial neglect , 2008, Neuropsychologia.

[78]  J. de Ajuriaguerra,et al.  Balint's syndrome (psychic paralysis of visual fixation) and its minor forms. , 1954, Brain : a journal of neurology.

[79]  F. J. Friedrich,et al.  Effects of parietal injury on covert orienting of attention , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[80]  Yaoda Xu,et al.  Visual grouping in human parietal cortex , 2007, Proceedings of the National Academy of Sciences.

[81]  Glyn W. Humphreys,et al.  Color-based grouping and inhibition in visual search: Evidence from a probe detection analysis of preview search , 2005, Perception & psychophysics.

[82]  K. Heilman,et al.  Mechanisms underlying hemispatial neglect , 1979, Annals of neurology.

[83]  A. Yamadori,et al.  Dissociation of body-centered and stimulus-centered representations in unilateral neglect , 2001, Neurology.

[84]  A. Luria,et al.  Disorders of "simultaneous perception" in a case of bilateral occipito-parietal brain injury. , 1959, Brain : a journal of neurology.

[85]  J. Marshall,et al.  Left neglect for near but not far space in man , 1991, Nature.

[86]  G. Humphreys,et al.  Object identification in simultanagnosia: When wholes are not the sum of their parts , 2004, Cognitive Neuropsychology.

[87]  G. Deco,et al.  Top-down selective visual attention: A neurodynamical approach , 2001 .

[88]  R. Bruyer,et al.  Ipsilateral influences on contralateral processing in neglect patients , 1989 .

[89]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[90]  Olaf B. Paulson,et al.  Parieto–Occipital Areas Involved in Efficient Filtering in Search: A Time Course Analysis of Visual Marking using Behavioural and Functional Imaging Procedures , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[91]  M. Husain,et al.  Noradrenergic modulation of space exploration in visual neglect , 2006, Annals of neurology.

[92]  Glyn W. Humphreys,et al.  Relationship between uniform connectedness and proximity in perceptual grouping , 2003, Science in China Series C: Life Sciences.

[93]  S. Ferber,et al.  Spatial awareness is a function of the temporal not the posterior parietal lobe , 2001, Nature.

[94]  M. Kinsbourne Hemi-neglect and hemisphere rivalry. , 1977, Advances in neurology.

[95]  S. Fairhall,et al.  The brain network underlying serial visual search: comparing overt and covert spatial orienting, for activations and for effective connectivity. , 2009, Cerebral cortex.

[96]  G. Vallar,et al.  Neglect syndromes: the role of the parietal cortex. , 2003, Advances in neurology.

[97]  Carmel Mevorach,et al.  Opposite biases in salience-based selection for the left and right posterior parietal cortex , 2006, Nature Neuroscience.

[98]  G. Humphreys,et al.  Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. , 1997, Psychological review.

[99]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[100]  Glyn W Humphreys,et al.  Widening the Sphere of Influence: Using a Tool to Extend Extrapersonal Visual Space in a Patient with Severe Neglect , 2002, Neurocase.

[101]  N. Kanwisher Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[102]  C. Kennard,et al.  The anatomy of visual neglect. , 2003, Brain : a journal of neurology.

[103]  M. Critchleey [Parietal lobes]. , 1953, Giornale di psichiatria e di neuropatologia.

[104]  Kathrin Finke,et al.  Preattentive surface and contour grouping in Kanizsa figures: Evidence from parietal extinction , 2009, Neuropsychologia.

[105]  Glyn W. Humphreys,et al.  Visual marking: using time in visual selection , 2003, Trends in Cognitive Sciences.

[106]  C. Kennard,et al.  Distinguishing sensory and motor biases in parietal and frontal neglect. , 2000, Brain : a journal of neurology.

[107]  P. Halligan,et al.  The incidence of neglect phenomena and related disorders in patients with an acute right or left hemisphere stroke. , 1993, Age and ageing.

[108]  M Behrmann,et al.  Attention accesses multiple reference frames: evidence from visual neglect. , 1999, Journal of experimental psychology. Human perception and performance.

[109]  G. Humphreys,et al.  Attention, spatial representation, and visual neglect: simulating emergent attention and spatial memory in the selective attention for identification model (SAIM). , 2003, Psychological review.

[110]  J. Mattingley,et al.  Preattentive Filling-in of Visual Surfaces in Parietal Extinction , 1997, Science.

[111]  Jon Driver,et al.  Spatial working memory deficit in unilateral neglect , 2001, Neuropsychologia.

[112]  A. Cowey,et al.  Left visuo-spatial neglect can be worse in far than in near space , 1994, Neuropsychologia.

[113]  M. Kinsbourne Mechanisms of Unilateral Neglect , 1987 .

[114]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[115]  P. Matthews,et al.  A neural marker of content-specific active ignoring. , 2008, Journal of experimental psychology. Human perception and performance.

[116]  H. Coslett,et al.  Simultanagnosia. To see but not two see. , 1991, Brain : a journal of neurology.

[117]  Stanislas Dehaene,et al.  Dissociable mechanisms of subitizing and counting: Neuropsychological evidence from simultanagnosic patients. , 1994 .

[118]  Glyn W. Humphreys,et al.  The effect of cueing on unilateral neglect , 1983, Neuropsychologia.

[119]  Glyn W. Humphreys,et al.  Separating distractor rejection and target detection in posterior parietal cortex—an event-related fMRI study of visual marking , 2003, NeuroImage.

[120]  E. Warrington,et al.  A disorder of simultaneous form perception. , 1962, Brain : a journal of neurology.

[121]  R. Tallis,et al.  Reasons for variability in the reported rate of occurrence of unilateral spatial neglect after stroke. , 1999, Stroke.

[122]  R. Rafal,et al.  Visual Extinction and Stimulus Repetition , 1993, Journal of Cognitive Neuroscience.

[123]  A. Milner,et al.  An Investigation of Hemispatial Neglect Using the Landmark Task , 1995, Brain and Cognition.

[124]  Richard S. J. Frackowiak,et al.  Where in the brain does visual attention select the forest and the trees? , 1996, Nature.

[125]  G W Humphreys,et al.  From both sides now: crossover effects influence navigation in patients with unilateral neglect , 2007, Journal of Neurology, Neurosurgery, and Psychiatry.

[126]  G. Vallar Extrapersonal Visual Unilateral Spatial Neglect and Its Neuroanatomy , 2001, NeuroImage.

[127]  C. Frith,et al.  Unconscious activation of visual cortex in the damaged right hemisphere of a parietal patient with extinction. , 2000, Brain : a journal of neurology.

[128]  Patrik Vuilleumier,et al.  Abnormal Attentional Modulation of Retinotopic Cortex in Parietal Patients with Spatial Neglect , 2008, Current Biology.

[129]  G. Humphreys,et al.  The ‘ special effect ’ of case mixing on word identification : Neuropsychological and TMS studies dissociating case mixing from contrast reduction , 2008 .

[130]  Christian N L Olivers,et al.  Spatiotemporal segregation in visual search: evidence from parietal lesions. , 2004, Journal of experimental psychology. Human perception and performance.

[131]  C. J. Price Letter-by-letter reading? Functional deficits and compensatory strategies , 1995 .

[132]  Giuseppe Di Pellegrino,et al.  Spatial extinction on double asynchronous stimulation , 1997, Neuropsychologia.

[133]  Glyn W. Humphreys,et al.  Visual marking : prioritising selection for new objects by top-down attentional inhibition , 1994 .

[134]  G. Humphreys,et al.  Long-term effects of prism adaptation in chronic visual neglect: A single case study , 2006, Cognitive neuropsychology.

[135]  Carmel Mevorach,et al.  Driven to less distraction: rTMS of the right parietal cortex reduces attentional capture in visual search. , 2009, Cerebral cortex.

[136]  Michael Erb,et al.  fMRI of global visual perception in simultanagnosia , 2009, Neuropsychologia.

[137]  E. Pessa,et al.  Object-centred neglect: Simulation with head-centred coding based on Gaussian gaze-dependent units , 2007, Neuropsychologia.

[138]  K. Heilman,et al.  Neglect of near peripersonal space. Evidence for multidirectional attentional systems in humans. , 1992, Brain : a journal of neurology.

[139]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.