Category-selective processing in the two visual pathways as a function of stimulus degradation by noise

ABSTRACT Understanding the organising principles and functional properties of the primate brain's numerous visually responsive cortical regions is one of the major goals in cognitive neuroscience. Functional magnetic resonance imaging (fMRI) studies have revealed that neural responses in higher‐order visual cortex are shaped by object categories, task context, and spatiotemporal regularities. Beyond these properties, visual processing in the ventral pathway has been shown to be tightly linked to perceptual awareness, while the evidence regarding dorsal visual processing and awareness is mixed. Most previous studies targeting the dorsal pathway have used dichotomous “visible versus invisible” experimental designs and interocular suppression paradigms to modulate stimulus visibility. In this fMRI study, we sought to investigate category‐selective processing of faces and tools in the ventral and dorsal visual streams as a function of parametric stimulus degradation by noise. Both frequentist and Bayesian statistics provide strong evidence for a linear relationship between category‐selective processing and stimulus information in both visual pathways. Overall, multivariate category decoding accuracies turned out to be lower in the dorsal pathway. We discuss our results within the context of the emerging notion of highly interconnected visual streams, and provide an outlook on how future studies may help to further refine our understanding of the functional role of the dorsal pathway in visual object processing. HIGHLIGHTSWe parametrically modulated stimulus visibility using visual noise.We observed a linear association of category decodability in both visual pathways.Our results support the notion of interconnected visual streams.

[1]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[2]  R. Hess,et al.  What causes non-monotonic tuning of fMRI response to noisy images? , 2002, Current Biology.

[3]  Jeffrey N. Rouder,et al.  Computation of Bayes Factors for Common Designs , 2015 .

[4]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[5]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[6]  F. Fang,et al.  Cortical responses to invisible objects in the human dorsal and ventral pathways , 2005, Nature Neuroscience.

[7]  Jonathan Winawer,et al.  A Major Human White Matter Pathway Between Dorsal and Ventral Visual Cortex. , 2016, Cerebral cortex.

[8]  M. Davare,et al.  Interactions between dorsal and ventral streams for controlling skilled grasp , 2015, Neuropsychologia.

[9]  Ravi S. Menon,et al.  Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2003, Experimental Brain Research.

[10]  Ione Fine,et al.  The visual white matter: The application of diffusion MRI and fiber tractography to vision science , 2016 .

[11]  Jacqueline C. Snow,et al.  Graspable Objects Grab Attention More Than Images Do , 2018, Psychological science.

[12]  J. Culham,et al.  What does the brain do when you fake it? An FMRI study of pantomimed and real grasping. , 2007, Journal of neurophysiology.

[13]  W. Singer,et al.  Early effects of previous experience on conscious perception , 2016, Neuroscience of consciousness.

[14]  H. Jeffreys,et al.  Theory of probability , 1896 .

[15]  Lauren L. Cloutman,et al.  Interaction between dorsal and ventral processing streams: Where, when and how? , 2013, Brain and Language.

[16]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[17]  Gennady Erlikhman,et al.  The neural representation of objects formed through the spatiotemporal integration of visual transients , 2016, NeuroImage.

[18]  Patrizia Fattori,et al.  The dorsal visual stream revisited: Stable circuits or dynamic pathways? , 2018, Cortex.

[19]  M. Goodale,et al.  The visual brain in action , 1995 .

[20]  Marlene Behrmann,et al.  Correction: The large-scale organization of shape processing in the ventral and dorsal pathways. , 2017 .

[21]  W. Singer,et al.  Neuroscience and Biobehavioral Reviews Distilling the Neural Correlates of Consciousness , 2022 .

[22]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[23]  Brian N. Pasley,et al.  Subcortical Discrimination of Unperceived Objects during Binocular Rivalry , 2004, Neuron.

[24]  Jonathan D. Nelson,et al.  Human cortical representations for reaching: Mirror neurons for execution, observation, and imagery , 2007, NeuroImage.

[25]  R. Kakigi,et al.  Temporal dynamics of neural activity underlying unconscious processing of manipulable objects , 2014, Cortex.

[26]  Rainer Goebel,et al.  Ventral and Dorsal Pathways Relate Differently to Visual Awareness of Body Postures under Continuous Flash Suppression , 2018, eNeuro.

[27]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[28]  A. Milner,et al.  How do the two visual streams interact with each other? , 2017, Experimental Brain Research.

[29]  A. Kleinschmidt,et al.  Temporal Tuning Properties along the Human Ventral Visual Stream , 2012, The Journal of Neuroscience.

[30]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[31]  Norbert Kathmann,et al.  Differential modulation of visual object processing in dorsal and ventral stream by stimulus visibility , 2016, Cortex.

[32]  P. Sterzer,et al.  Investigating category‐ and shape‐selective neural processing in ventral and dorsal visual stream under interocular suppression , 2015, Human brain mapping.

[33]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[34]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data , 2015, Front. Neuroinform..

[35]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[36]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[37]  J. Culham,et al.  Getting a grip on reality: Grasping movements directed to real objects and images rely on dissociable neural representations , 2018, Cortex.

[38]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[39]  Nai Ding,et al.  Perceptual integration rapidly activates dorsal visual pathway to guide local processing in early visual areas , 2017, PLoS biology.

[40]  R. Malach,et al.  The link between fMRI-BOLD activation and perceptual awareness is "stream-invariant" in the human visual system. , 2011, Cerebral cortex.

[41]  M. Overgaard,et al.  Introspection and subliminal perception , 2004 .

[42]  Yaoda Xu,et al.  Goal-Directed Visual Processing Differentially Impacts Human Ventral and Dorsal Visual Representations , 2017, The Journal of Neuroscience.

[43]  Zoe Kourtzi,et al.  Uncertainty and invariance in the human visual cortex. , 2006, Journal of neurophysiology.

[44]  R. McIntosh,et al.  Do we have independent visual streams for perception and action? , 2010, Cognitive neuroscience.

[45]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[46]  Su Keun Jeong,et al.  Behaviorally Relevant Abstract Object Identity Representation in the Human Parietal Cortex , 2016, The Journal of Neuroscience.

[47]  Nikolai Axmacher,et al.  Local Category-Specific Gamma Band Responses in the Visual Cortex Do Not Reflect Conscious Perception , 2012, The Journal of Neuroscience.

[48]  Wayne Wu Against Division: Consciousness, Information and the Visual Streams , 2014 .

[49]  H. P. Op de Beeck,et al.  Task Context Overrules Object- and Category-Related Representational Content in the Human Parietal Cortex , 2017, Cerebral cortex.

[50]  T. Bachmann,et al.  It’s all in your head: Expectations create illusory perception in a dual-task setup , 2018, Consciousness and Cognition.

[51]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[52]  Afra Wohlschläger,et al.  The Neural Correlates of Planning and Executing Actual Tool Use , 2014, The Journal of Neuroscience.

[53]  J. Culham,et al.  Neural coding within human brain areas involved in actions , 2015, Current Opinion in Neurobiology.

[54]  David C. Plaut,et al.  ‘What’ Is Happening in the Dorsal Visual Pathway , 2016, Trends in Cognitive Sciences.

[55]  K. Nakayama,et al.  Binocular Rivalry and Visual Awareness in Human Extrastriate Cortex , 1998, Neuron.

[56]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[57]  Kevin J. Miller,et al.  Unconscious neural processing differs with method used to render stimuli invisible , 2014, Front. Psychol..

[58]  Daniela Perani,et al.  Unaware Processing of Tools in the Neural System for Object-Directed Action Representation , 2017, The Journal of Neuroscience.

[59]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[60]  Zvi N. Roth,et al.  Fingerprints of Learned Object Recognition Seen in the fMRI Activation Patterns of Lateral Occipital Complex. , 2015, Cerebral cortex.

[61]  G. Rees,et al.  Fine-scale activity patterns in high-level visual areas encode the category of invisible objects. , 2008, Journal of vision.

[62]  M. Goodale,et al.  FMRI Reveals a Dissociation between Grasping and Perceiving the Size of Real 3D Objects , 2007, PloS one.

[63]  Sheng He,et al.  Cortical Responses to Invisible Faces: Dissociating Subsystems for Facial-Information Processing , 2006, Current Biology.

[64]  Albert R. Powers,et al.  Pavlovian conditioning–induced hallucinations result from overweighting of perceptual priors , 2017, Science.

[65]  M. Goodale,et al.  Visual control of reaching movements without vision of the limb , 2004, Experimental Brain Research.