Olfaction spontaneously highlights visual saliency map

Attention is intrinsic to our perceptual representations of sensory inputs. Best characterized in the visual domain, it is typically depicted as a spotlight moving over a saliency map that topographically encodes strengths of visual features and feedback modulations over the visual scene. By introducing smells to two well-established attentional paradigms, the dot-probe and the visual-search paradigms, we find that a smell reflexively directs attention to the congruent visual image and facilitates visual search of that image without the mediation of visual imagery. Furthermore, such effect is independent of, and can override, top-down bias. We thus propose that smell quality acts as an object feature whose presence enhances the perceptual saliency of that object, thereby guiding the spotlight of visual attention. Our discoveries provide robust empirical evidence for a multimodal saliency map that weighs not only visual but also olfactory inputs.

[1]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[2]  W S Cain,et al.  To know with the nose: keys to odor identification. , 1979, Science.

[3]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[4]  C. MacLeod,et al.  Attentional bias in emotional disorders. , 1986, Journal of abnormal psychology.

[5]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[6]  Wendy A Suzuki,et al.  The anatomy, physiology and functions of the perirhinal cortex , 1996, Current Opinion in Neurobiology.

[7]  C. Spence,et al.  Attention and the crossmodal construction of space , 1998, Trends in Cognitive Sciences.

[8]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[9]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[10]  L. Buck,et al.  The Molecular Architecture of Odor and Pheromone Sensing in Mammals , 2000, Cell.

[11]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[12]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[13]  B. Richmond,et al.  Role of perirhinal cortex in object perception, memory, and associations , 2001, Current Opinion in Neurobiology.

[14]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[15]  J Driver,et al.  A selective review of selective attention research from the past century. , 2001, British journal of psychology.

[16]  Zhaoping Li.  A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[17]  R. Dolan,et al.  The Nose Smells What the Eye Sees Crossmodal Visual Facilitation of Human Olfactory Perception , 2003, Neuron.

[18]  T. Wyatt.  Pheromones and Animal Behaviour: Communication by Smell and Taste , 2003 .

[19]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[20]  S. Yantis,et al.  Cortical mechanisms of space-based and object-based attentional control , 2003, Current Opinion in Neurobiology.

[21]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[22]  Melvyn A. Goodale,et al.  Faculty Opinions recommendation of Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map. , 2004 .

[23]  R. Campbell,et al.  Audiovisual Integration of Speech Falters under High Attention Demands , 2005, Current Biology.

[24]  D. Melcher,et al.  Implicit Attentional Selection of Bound Visual Features , 2005, Neuron.

[25]  E. Macaluso,et al.  Multisensory spatial interactions: a window onto functional integration in the human brain , 2005, Trends in Neurosciences.

[26]  Michael T. Lippert,et al.  Mechanisms for Allocating Auditory Attention: An Auditory Saliency Map , 2005, Current Biology.

[27]  Shin'ya Nishida,et al.  Visual search for a target changing in synchrony with an auditory signal , 2006, Proceedings of the Royal Society B: Biological Sciences.

[28]  L. Tyler,et al.  Binding crossmodal object features in perirhinal cortex. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[29]  David Gaffan,et al.  Perirhinal cortical contributions to object perception , 2006, Trends in Cognitive Sciences.

[30]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[31]  Jan Theeuwes,et al.  Pip and pop: nonspatial auditory signals improve spatial visual search. , 2008, Journal of experimental psychology. Human perception and performance.

[32]  J. Theeuwes,et al.  Poke and pop: Tactile–visual synchrony increases visual saliency , 2009, Neuroscience Letters.

[33]  S. Luck,et al.  Feature-based attention modulates feedforward visual processing , 2009, Nature Neuroscience.

[34]  K. Durand,et al.  The Nose Tells it to the Eyes: Crossmodal Associations between Olfaction and Vision , 2010, Perception.

[35]  Han-Seok Seo,et al.  Odors enhance visual attention to congruent objects , 2010, Appetite.

[36]  Denise Chen,et al.  Olfaction Modulates Visual Perception in Binocular Rivalry , 2010, Current Biology.

[37]  Sarah E Donohue,et al.  The Cross-Modal Spread of Attention Reveals Differential Constraints for the Temporal and Spatial Linking of Visual and Auditory Stimulus Events , 2011, The Journal of Neuroscience.

[38]  Edmund T. Rolls,et al.  A hedonically complex odor mixture produces an attentional capture effect in the brain , 2011, NeuroImage.

[39]  Denise Chen,et al.  Nostril-Specific Olfactory Modulation of Visual Perception in Binocular Rivalry , 2012, The Journal of Neuroscience.