Grasping with the eyes: The role of elongation in visual recognition of manipulable objects

Processing within the dorsal visual stream subserves object-directed action, whereas visual object recognition is mediated by the ventral visual stream. Recent findings suggest that the computations performed by the dorsal stream can nevertheless influence object recognition. Little is known, however, about the type of dorsal stream information that is available to assist in object recognition. Here, we present a series of experiments that explored different psychophysical manipulations known to bias the processing of a stimulus toward the dorsal visual stream in order to isolate its contribution to object recognition. We show that elongated-shaped stimuli, regardless of their semantic category and familiarity, when processed by the dorsal stream, elicit visuomotor grasp-related information that affects how we categorize manipulable objects. Elongated stimuli may reduce ambiguity during grasp preparation by providing a coarse cue to hand shaping and orientation that is sufficient to support action planning. We propose that this dorsal-stream-based analysis of elongation along a principal axis is the basis for how the dorsal visual object processing stream can affect categorization of manipulable objects.

[1]  H. Kennedy,et al.  Two Cortical Systems for Reaching in Central and Peripheral Vision , 2005, Neuron.

[2]  H. Heuer,et al.  Generation and modulation of action patterns , 1986 .

[3]  David J. Freedman,et al.  Neural correlates of categories and concepts , 2003, Current Opinion in Neurobiology.

[4]  Richard A. Andersen,et al.  FMRI evidence for a 'parietal reach region' in the human brain , 2003, Experimental Brain Research.

[5]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[6]  C. Büchel,et al.  Surface orientation discrimination activates caudal and anterior intraparietal sulcus in humans: an event-related fMRI study. , 2001, Journal of neurophysiology.

[7]  Randolph Blake,et al.  Deconstructing continuous flash suppression. , 2012, Journal of vision.

[8]  H. Bülthoff,et al.  Separate neural pathways for the visual analysis of object shape in perception and prehension , 1994, Current Biology.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  JamesW. Lewis.  Cortical Networks Related to Human Use of Tools , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[11]  G. Goldenberg,et al.  The neural basis of tool use. , 2009, Brain : a journal of neurology.

[12]  M. Koivisto,et al.  Semantic priming by pictures and words in the cerebral hemispheres. , 2000, Brain research. Cognitive brain research.

[13]  Bradford Z. Mahon,et al.  The Role of the Dorsal Visual Processing Stream in Tool Identification , 2010, Psychological science.

[14]  R. Malach,et al.  The link between fMRI-BOLD activation and perceptual awareness is "stream-invariant" in the human visual system. , 2011, Cerebral cortex.

[15]  C. Prablanc,et al.  Large adjustments in visually guided reaching do not depend on vision of the hand or perception of target displacement , 1986, Nature.

[16]  Eileen Kowler,et al.  Anticipatory smooth eye movements with random-dot kinematograms. , 2012, Journal of vision.

[17]  Alfonso Caramazza,et al.  Affect of the unconscious: Visually suppressed angry faces modulate our decisions , 2012, Cognitive, Affective, & Behavioral Neuroscience.

[18]  A. Sirigu,et al.  The role of sensorimotor experience in object recognition. A case of multimodal agnosia. , 1991, Brain : a journal of neurology.

[19]  L. Buxbaum,et al.  Distinctions between manipulation and function knowledge of objects: evidence from functional magnetic resonance imaging. , 2005, Brain research. Cognitive brain research.

[20]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[21]  R T Knight,et al.  Neural representations of skilled movement. , 2000, Brain : a journal of neurology.

[22]  Bradford Z. Mahon,et al.  Action-Related Properties Shape Object Representations in the Ventral Stream , 2007, Neuron.

[23]  Bradford Z. Mahon,et al.  A right visual field advantage for visual processing of manipulable objects , 2012, Cognitive, affective & behavioral neuroscience.

[24]  Sheng He,et al.  Cortical Responses to Invisible Faces: Dissociating Subsystems for Facial-Information Processing , 2006, Current Biology.

[25]  M. Abernethy,et al.  Associative priming in the hemispheres as a function of SOA , 1993, Neuropsychologia.

[26]  H. Sakata,et al.  Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. , 2000, Journal of neurophysiology.

[27]  F. Fang,et al.  Cortical responses to invisible objects in the human dorsal and ventral pathways , 2005, Nature Neuroscience.

[28]  Alfonso Caramazza,et al.  The orchestration of the sensory-motor systems: Clues from Neuropsychology , 2005, Cognitive neuropsychology.

[29]  Scott T. Grafton,et al.  Role of the posterior parietal cortex in updating reaching movements to a visual target , 1999, Nature Neuroscience.

[30]  Scott T. Grafton,et al.  A distributed left hemisphere network active during planning of everyday tool use skills. , 2004, Cerebral cortex.

[31]  Markus Graf,et al.  The role of action representations in visual object recognition , 2006, Experimental Brain Research.

[32]  B. Breitmeyer,et al.  Recent models and findings in visual backward masking: A comparison, review, and update , 2000, Perception & psychophysics.

[33]  A. Wing,et al.  Perceptual judgement, grasp point selection and object symmetry , 2003, Experimental Brain Research.

[34]  K. Nakayama,et al.  Binocular Rivalry and Visual Awareness in Human Extrastriate Cortex , 1998, Neuron.

[35]  Bradford Z. Mahon,et al.  Cognitive Penetration of the Dorsal Visual Stream , 2015 .

[36]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[37]  R. Adolphs,et al.  Neural systems behind word and concept retrieval , 2004, Cognition.

[38]  Andrew Blake,et al.  Computational modelling of hand-eye coordination , 1992 .

[39]  Scott H. Johnson-Frey.  The neural bases of complex tool use in humans , 2004, Trends in Cognitive Sciences.

[40]  Bradford Z. Mahon,et al.  Spatial Frequency Tuning Reveals Interactions between the Dorsal and Ventral Visual Systems , 2013, Journal of Cognitive Neuroscience.

[41]  Joseph S. Gati,et al.  Visually-guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2010 .

[42]  Brian N. Pasley,et al.  Subcortical Discrimination of Unperceived Objects during Binocular Rivalry , 2004, Neuron.

[43]  M. Brett,et al.  Actions Speak Louder Than Functions: The Importance of Manipulability and Action in Tool Representation , 2003, Journal of Cognitive Neuroscience.

[44]  Scott T. Grafton,et al.  Graspable objects grab attention when the potential for action is recognized , 2003, Nature Neuroscience.

[45]  J. Culham,et al.  The role of parietal cortex in visuomotor control: What have we learned from neuroimaging? , 2006, Neuropsychologia.

[46]  J. Friedman,et al.  The Flexibility of Nonconsciously Deployed Cognitive Processes: Evidence from Masked Congruence Priming , 2011, PloS one.

[47]  A. Damasio,et al.  A neural basis for the retrieval of conceptual knowledge , 1997, Neuropsychologia.

[48]  A. Caramazza,et al.  Letter identification processes in reading: Distractor interference reveals an automatically engaged, domain-specific mechanism , 2006, Cognitive neuropsychology.

[49]  B. P. McCloskey,et al.  Knowledge about hand shaping and knowledge about objects. , 1987, Journal of motor behavior.

[50]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[51]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[52]  A. Milner,et al.  Visuomotor sensitivity for shape and orientation in a patient with visual form agnosia , 1996, Neuropsychologia.

[53]  A. Caramazza,et al.  The dissociation of color from form and function knowledge , 2001, Nature Neuroscience.

[54]  N. Logothetis,et al.  Neuronal correlates of subjective visual perception. , 1989, Science.

[55]  Alfonso Caramazza,et al.  Unconscious processing dissociates along categorical lines , 2008, Proceedings of the National Academy of Sciences.

[56]  R. Atchley,et al.  Examining lateralized semantic access using pictures , 2010, Brain and Cognition.

[57]  Bradford Z. Mahon,et al.  Action-related properties of objects shape object representations in the ventral stream , 2007 .

[58]  Alex Martin,et al.  Representation of Manipulable Man-Made Objects in the Dorsal Stream , 2000, NeuroImage.

[59]  M. Perenin,et al.  Optic ataxia: a specific disruption in visuomotor mechanisms. I. Different aspects of the deficit in reaching for objects. , 1988, Brain : a journal of neurology.

[60]  M Poncet,et al.  The role of sensorimotor experience in object recognition. A case of multimodal agnosia. , 1991, Brain : a journal of neurology.

[61]  D. Perrett,et al.  The Nature and Limits of Orientation and Pattern Processing Supporting Visuomotor Control in a Visual Form Agnosic , 1994, Journal of Cognitive Neuroscience.

[62]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[63]  Daniel N. Bub,et al.  Different modes of word recognition in the left and right visual fields , 1988, Brain and Language.

[64]  Murray Grossman,et al.  Left Inferior Parietal Representations for Skilled Hand-Object Interactions: Evidence from Stroke and Corticobasal Degeneration , 2007, Cortex.

[65]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach , 1999 .

[66]  C. Koch,et al.  Continuous flash suppression reduces negative afterimages , 2005, Nature Neuroscience.

[67]  Ravi S. Menon,et al.  Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2003, Experimental Brain Research.

[68]  A. Damasioa,et al.  Neural systems behind word and concept retrieval , 2004 .

[69]  Ken Nakayama,et al.  Numeric comparison in a visually-guided manual reaching task , 2008, Cognition.

[70]  Karl J. Friston,et al.  Two distinct neural mechanisms for category-selective responses. , 2006, Cerebral cortex.

[71]  G. Rees,et al.  Fine-scale activity patterns in high-level visual areas encode the category of invisible objects. , 2008, Journal of vision.

[72]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research , 1999 .

[73]  Zoë R. Hunter,et al.  Visual half-field experiments are a good measure of cerebral language dominance if used properly: Evidence from fMRI , 2008, Neuropsychologia.

[74]  C. Chiarello,et al.  Lexical decision and naming asymmetries: Influence of response selection and response bias , 1988, Brain and Language.

[75]  Ravi S. Menon,et al.  Differential Effects of Viewpoint on Object-Driven Activation in Dorsal and Ventral Streams , 2002, Neuron.

[76]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[77]  Bradford Z. Mahon,et al.  Tool manipulation knowledge is retrieved by way of the ventral visual object processing pathway , 2013, Cortex.

[78]  K Tsutsui,et al.  Neural coding of 3D features of objects for hand action in the parietal cortex of the monkey. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[79]  Kenneth I Forster,et al.  DMDX: A Windows display program with millisecond accuracy , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[80]  M. Wallace,et al.  Visual Localization Ability Influences Cross-Modal Bias , 2003, Journal of Cognitive Neuroscience.

[81]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[82]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.