The Nose Tells it to the Eyes: Crossmodal Associations between Olfaction and Vision

Crossmodal linkage between the olfactory and visual senses is still largely underexplored. In this study, we investigated crossmodal olfactory – visual associations by testing whether and how visual processing of objects is affected by the presence of olfactory cues. To this end, we explored the influence of prior learned associations between an odour (eg odour of orange) and a visual stimulus naturally associated with that odour (picture of orange) on the movements of the eyes over a complex scene. Participants were asked to freely explore a photograph containing an odour-related visual cue embedded among other objects while being exposed to the corresponding odour (subjects were unaware of the presence of the odour). Eye movements were recorded to analyse the order and distribution of fixations on each object of the scene. Our data show that the odour-related visual cue was explored faster and for a shorter time in the presence of the congruent odour. These findings suggest that odours can affect visual processing by attracting attention to the possible odour source and by facilitating its identification.

[1]  Frank Allen,et al.  THE EFFECT OF STIMULATION OF THE SENSES OF VISION, HEARING, TASTE, AND SMELL UPON THE SENSIBILITY OF THE ORGANS OF VISION , 1940, The Journal of general physiology.

[2]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  N. Mackworth,et al.  Habituation of the visual orienting response in young children1, 2 , 1970 .

[5]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[6]  D. G. Laing,et al.  Natural Sniffing Gives Optimum Odour Perception for Humans , 1983, Perception.

[7]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[8]  R. Doty,et al.  Smell identification ability: changes with age. , 1984, Science.

[9]  T. Engen Remembering Odors and Their Names , 1987 .

[10]  D. Perrott Auditory Psychomotor Coordination , 1988 .

[11]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[12]  B. Schaal Olfaction in infants and children: developmental and functional perspectives , 1988 .

[13]  H. Ludvigson,et al.  Effects of ambient odors of lavender and cloves on cognition, memory, affect and mood , 1989 .

[14]  Lawrence G. McDade,et al.  Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli , 1989, Journal of Cognitive Neuroscience.

[15]  J. Richardson,et al.  Cognition and olfaction: a review. , 1989, Psychological bulletin.

[16]  J. Richardson,et al.  Cognition and olfaction: a review. , 1989, Psychological bulletin.

[17]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[18]  K. Saberi,et al.  Auditory psychomotor coordination and visual search performance , 1990, Perception & psychophysics.

[19]  J Miller,et al.  Channel interaction and the redundant-targets effect in bimodal divided attention. , 1991, Journal of experimental psychology. Human perception and performance.

[20]  P. Bone,et al.  Olfaction as a cue for product quality , 1992 .

[21]  P. Reuter-Lorenz,et al.  Visual-auditory interactions in sensorimotor processing: saccades versus manual responses. , 1994, Journal of experimental psychology. Human perception and performance.

[22]  J. Theeuwes Stimulus-driven capture and attentional set: selective search for color and visual abrupt onsets. , 1994, Journal of experimental psychology. Human perception and performance.

[23]  S. Knasko,et al.  Pleasant odors and congruency: effects on approach behavior. , 1995, Chemical senses.

[24]  S. Kosslyn,et al.  Topographical representations of mental images in primary visual cortex , 1995, Nature.

[25]  M. Frens,et al.  Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements , 1995, Perception & psychophysics.

[26]  B. Kahn,et al.  There's Something in the Air: Effects of Congruent or Incongruent Ambient Odor on Consumer Decision Making , 1995 .

[27]  A. Gilbert,et al.  Cross-modal correspondence between vision and olfaction: the color of smells. , 1996, The American journal of psychology.

[28]  J. S. Jellinek Psychodynamic odor effects and their mechanisms , 1997 .

[29]  J. S. Jellinek Psychodynamic odor effects and their mechanisms : Failure to identify the mechanism can lead to faulty conclusions in odor studies , 1997 .

[30]  G. Aschersleben,et al.  Automatic visual bias of perceived auditory location , 1998 .

[31]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[32]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[33]  E. Köster,et al.  Implicit Memory for Odors: A Possible Method for Observation , 1998, Perceptual and motor skills.

[34]  Gilles Sicard,et al.  Functional Anatomy of Perceptual and Semantic Processing for Odors , 1999, Journal of Cognitive Neuroscience.

[35]  E P Köster,et al.  Odors: implicit memory and performance effects. , 1999, Chemical senses.

[36]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[37]  P. Bone,et al.  Scents in the marketplace: explaining a fraction of olfaction , 1999 .

[38]  D. E. Irwin,et al.  Attentional and oculomotor capture by onset, luminance and color singletons , 2000, Vision Research.

[39]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[40]  T. Schormann,et al.  Functional mapping of human brain in olfactory processing: a PET study. , 2000, Journal of neurophysiology.

[41]  J. Theeuwes,et al.  Attentional and oculomotor capture , 2001 .

[42]  R. Herz,et al.  The Influence of Verbal Labeling on the Perception of Odors: Evidence for Olfactory Illusions? , 2001, Perception.

[43]  E. Heuberger,et al.  The influence of essential oils on human attention. I: alertness. , 2001, Chemical senses.

[44]  G. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[45]  D. Dubourdieu,et al.  The Color of Odors , 2001, Brain and Language.

[46]  Jean-Louis Millot,et al.  Effects of ambient odors on reaction time in humans , 2002, Neuroscience Letters.

[47]  Arthur F. Kramer,et al.  Modulation of oculomotor capture by abrupt onsets during attentionally demanding visual search , 2002 .

[48]  Hendrik N. J. Schifferstein,et al.  Effects of Appropriate and Inappropriate Odors on Product Evaluations , 2002, Perceptual and motor skills.

[49]  E. Köster,et al.  Proactive and retroactive interference in implicit odor memory. , 2002, Chemical senses.

[50]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[51]  R. Dolan,et al.  The Nose Smells What the Eye Sees Crossmodal Visual Facilitation of Human Olfactory Perception , 2003, Neuron.

[52]  A. Kingstone,et al.  Auditory capture of vision: examining temporal ventriloquism. , 2003, Brain research. Cognitive brain research.

[53]  Jean-Louis Millot,et al.  Ambient odors modulate visual attentional capture , 2003, Neuroscience Letters.

[54]  Paul J. Laurienti,et al.  Semantic congruence is a critical factor in multisensory behavioral performance , 2004, Experimental Brain Research.

[55]  A. Diederich,et al.  Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model , 2004, Journal of Cognitive Neuroscience.

[56]  Rachel S. Herz,et al.  Olfaction, Emotion and Associative Learning: Effects on Motivated Behavior , 2004 .

[57]  Michael C. Dorris,et al.  Combined eye-head gaze shifts to visual and auditory targets in humans , 1996, Experimental Brain Research.

[58]  D. Small Crossmodal integration – insights from the chemical senses , 2004, Trends in Neurosciences.

[59]  J. Henderson,et al.  Prioritization of new objects in real-world scenes: evidence from eye movements. , 2005, Journal of experimental psychology. Human perception and performance.

[60]  D. Simons,et al.  Do New Objects Capture Attention? , 2005, Psychological science.

[61]  Jan Theeuwes,et al.  Prioritization by transients in visual search , 2005, Psychonomic bulletin & review.

[62]  Jean-Louis Millot,et al.  Ambient odors influence the amplitude and time course of visual distraction. , 2005, Behavioral neuroscience.

[63]  U. Castiello,et al.  Cross-modal interactions between olfaction and vision when grasping. , 2006, Chemical senses.

[64]  Charles Spence,et al.  Cross-modal associations between odors and colors. , 2006, Chemical senses.

[65]  P. Walla Olfaction and its dynamic influence on word and face processing: Cross-modal integration , 2008, Progress in Neurobiology.