Less is more: Removing a modality of an expected olfactory‐visual stimulation enhances brain activation

In recent years, multisensory integration of visual and olfactory stimuli has extensively been explored resulting in the identification of responsible brain areas. As the experimental designs of previous research often include alternating presentations of unimodal and bimodal stimuli, the conditions cannot be regarded as completely independent. This could lead to effects of an expected but surprisingly missing sensory modality. In our experiment, we used a common functional magnetic resonance imaging (fMRI) study design with alternating strong unimodal and bimodal olfactory‐visual food stimuli, in addition to a slight overhang of the bimodal stimuli in an effort to examine the effects of removing a visual or olfactory congruent stimulus for older people (41–83 years). Our results suggest that the processing of olfactory and visual stimuli stays intact over a wide age‐range and that the utilization of strong stimuli does not lead to superadditive multisensory integration in accordance with the principle of inverse effectiveness. However, our results demonstrate that the removal of a stimulus modality leads to an activation of additional brain areas. For example, when the visual stimulus modality is missing, the right posterior superior temporal gyrus shows higher activation, whereas the removal of the olfactory stimulus modality leads to higher activation in the amygdala/hippocampus and the postcentral gyrus. These brain areas are related to attention, memory, and the search of the missing stimulus. Consequently, careful attention must be paid to the design of a valid, multimodal sensory experiment while also controlling for cognitive expectancy effects that might confound multimodal results.

[1]  J. Freiherr,et al.  Erratum to: Less is More: Removing a Modality of an Expected Olfactory‐Visual Stimulation Enhances Brain Activation , 2022, Human brain mapping.

[2]  Joel L. Voss,et al.  Human hippocampal connectivity is stronger in olfaction than other sensory systems , 2021, Progress in Neurobiology.

[3]  J. Linseisen,et al.  A Phenotyping Platform to Characterize Healthy Individuals Across Four Stages of Life - The Enable Study , 2020, Frontiers in Nutrition.

[4]  D. Small,et al.  Identification of an Amygdala–Thalamic Circuit That Acts as a Central Gain Mechanism in Taste Perceptions , 2020, The Journal of Neuroscience.

[5]  Brett S. East,et al.  Olfaction , 2020, eLS.

[6]  Jianfeng Feng,et al.  Automated anatomical labelling atlas 3 , 2020, NeuroImage.

[7]  Lieven A. Schenk,et al.  When Expectancies Are Violated: A Functional Magnetic Resonance Imaging Study , 2019, Clinical pharmacology and therapeutics.

[8]  U. Habel,et al.  Audio–visual and olfactory–visual integration in healthy participants and subjects with autism spectrum disorder , 2019, Human brain mapping.

[9]  Jae-Yun Lee,et al.  Bottom-up and top-down modulation of multisensory integration , 2018, Current Opinion in Neurobiology.

[10]  Jessica Freiherr,et al.  Multisensory integration processing during olfactory‐visual stimulation—An fMRI graph theoretical network analysis , 2018, Human brain mapping.

[11]  R. Sijben,et al.  Semantic Congruence Alters Functional Connectivity during Olfactory-Visual Perception , 2018, Chemical senses.

[12]  John M. Chambers,et al.  Analysis of Variance; Designed Experiments , 2017 .

[13]  Winfried Rief,et al.  Learning about Expectation Violation from Prediction Error Paradigms – A Meta-Analysis on Brain Processes Following a Prediction Error , 2017, Front. Psychol..

[14]  Jan B. F. van Erp,et al.  Effects of Aging in Multisensory Integration: A Systematic Review , 2017, Front. Aging Neurosci..

[15]  P. Schieberle,et al.  Evaluation of Key Aroma Compounds in Processed Prawns (Whiteleg Shrimp) by Quantitation and Aroma Recombination Experiments. , 2017, Journal of agricultural and food chemistry.

[16]  P. Schieberle,et al.  Characterization of the Key Aroma Compounds in Raw Licorice (Glycyrrhiza glabra L.) by Means of Molecular Sensory Science. , 2016, Journal of agricultural and food chemistry.

[17]  Christopher Rorden,et al.  The first step for neuroimaging data analysis: DICOM to NIfTI conversion , 2016, Journal of Neuroscience Methods.

[18]  J. Visser-Meily,et al.  The right hemisphere is dominant in organization of visual search—A study in stroke patients , 2016, Behavioural Brain Research.

[19]  Michael J. Tobia,et al.  Rapidly acquired multisensory association in the olfactory cortex , 2015, Brain and behavior.

[20]  R. Kraft,et al.  Brain mechanisms supporting violated expectations of pain , 2015, Pain.

[21]  Peter Schieberle,et al.  Nature's chemical signatures in human olfaction: a foodborne perspective for future biotechnology. , 2014, Angewandte Chemie.

[22]  Aaron R. Nidiffer,et al.  Identifying and Quantifying Multisensory Integration: A Tutorial Review , 2014, Brain Topography.

[23]  G. Dijksterhuis,et al.  Smelly primes – when olfactory primes do or do not work , 2014, Front. Psychol..

[24]  P. Schieberle,et al.  Characterization of the key aroma compounds in roasted duck liver by means of aroma extract dilution analysis: comparison with beef and pork livers , 2014, European Food Research and Technology.

[25]  U. Habel,et al.  Multisensory integration mechanisms during aging , 2013, Front. Hum. Neurosci..

[26]  M. Vink,et al.  Expectations and violations: Delineating the neural network of proactive inhibitory control , 2013, Human brain mapping.

[27]  Jane R. Garrison,et al.  Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[28]  Jessica Freiherr,et al.  The 40-item Monell Extended Sniffin’ Sticks Identification Test (MONEX-40) , 2012, Journal of Neuroscience Methods.

[29]  Jeannette R. Mahoney,et al.  Multisensory integration across the senses in young and old adults , 2011, Brain Research.

[30]  D. Gitelman,et al.  The Anterior Insular Cortex Represents Breaches of Taste Identity Expectation , 2011, The Journal of Neuroscience.

[31]  A. Beck,et al.  Beck Depression Inventory–II , 2011 .

[32]  S. Boesveldt,et al.  Methods for building an inexpensive computer-controlled olfactometer for temporally-precise experiments. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  K. Durand,et al.  The Nose Tells it to the Eyes: Crossmodal Associations between Olfaction and Vision , 2010, Perception.

[34]  Sheng He,et al.  Olfaction Modulates Visual Perception in Binocular Rivalry , 2010, Current Biology.

[35]  C. Spence,et al.  Does Food Color Influence Taste and Flavor Perception in Humans? , 2010 .

[36]  Akira R. O’Connor,et al.  The Inferior Parietal Lobule and Recognition Memory: Expectancy Violation or Successful Retrieval? , 2010, The Journal of Neuroscience.

[37]  Paul E. Gilbert,et al.  The role of the human hippocampus in odor-place associative memory. , 2009, Chemical senses.

[38]  R. Whelan Effective Analysis of Reaction Time Data , 2008 .

[39]  Kaia L. Vilberg,et al.  Memory retrieval and the parietal cortex: A review of evidence from a dual-process perspective , 2008, Neuropsychologia.

[40]  Morteza Moazami-Goudarzi,et al.  EEG alpha distinguishes between cuneal and precuneal activation in working memory , 2008, NeuroImage.

[41]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[42]  C. Spence,et al.  The multisensory perception of flavor: Assessing the influence of color cues on flavor discrimination responses , 2007 .

[43]  Ziad S. Saad,et al.  Functional neuroanatomy of human voluntary cough and sniff production , 2007, NeuroImage.

[44]  J. Lagopoulos,et al.  An event-related functional MRI study of working memory in euthymic bipolar disorder. , 2007, Journal of psychiatry & neuroscience : JPN.

[45]  Ryan A. Stevenson,et al.  Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects , 2007, Experimental Brain Research.

[46]  Alireza Gharabaghi,et al.  The role of the right superior temporal gyrus in visual search—Insights from intraoperative electrical stimulation , 2006, Neuropsychologia.

[47]  Hyejin Kang,et al.  The neural correlates of cross-modal interaction in speech perception during a semantic decision task on sentences: A PET study , 2006, NeuroImage.

[48]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[49]  Barbara Cerf-Ducastel,et al.  Neural substrates of cross-modal olfactory recognition memory: An fMRI study , 2006, NeuroImage.

[50]  Paul J. Laurienti,et al.  On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies , 2005, Experimental Brain Research.

[51]  David A. Kareken,et al.  Neural correlates of olfactory change detection , 2005, NeuroImage.

[52]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[53]  Takatsune Kumada,et al.  Visual search and memory search engage extensive overlapping cerebral cortices: an fMRI study , 2004, NeuroImage.

[54]  Howard Eichenbaum,et al.  The hippocampus and memory for "what," "where," and "when". , 2004, Learning & memory.

[55]  Michael D Rugg,et al.  Remembrance of Odors Past Human Olfactory Cortex in Cross-Modal Recognition Memory , 2004, Neuron.

[56]  W. Parr,et al.  The nose knows: influence of colour on perception of wine aroma , 2003 .

[57]  R. Dolan,et al.  The Nose Smells What the Eye Sees Crossmodal Visual Facilitation of Human Olfactory Perception , 2003, Neuron.

[58]  D. Kareken,et al.  Functional anatomy of human odor sensation, discrimination, and identification in health and aging. , 2003, Neuropsychology.

[59]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[60]  Giovanni Galfano,et al.  Nonspatial attentional shifts between audition and vision. , 2002, Journal of experimental psychology. Human perception and performance.

[61]  E. Macaluso,et al.  Supramodal Effects of Covert Spatial Orienting Triggered by Visual or Tactile Events , 2002, Journal of Cognitive Neuroscience.

[62]  G. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[63]  D. Dubourdieu,et al.  The Color of Odors , 2001, Brain and Language.

[64]  C. Spence,et al.  The cost of expecting events in the wrong sensory modality , 2001, Perception & psychophysics.

[65]  P. Skudlarski,et al.  Event-related fMRI of auditory and visual oddball tasks. , 2000, Magnetic resonance imaging.

[66]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[67]  R. Goebel,et al.  The functional neuroanatomy of target detection: an fMRI study of visual and auditory oddball tasks. , 1999, Cerebral cortex.

[68]  E. Rolls The hippocampus and memory , 1997 .

[69]  P. Goldman-Rakic,et al.  Infrequent events transiently activate human prefrontal and parietal cortex as measured by functional MRI. , 1997, Journal of neurophysiology.

[70]  P. Schieberle,et al.  Evaluation of the character impact odorants in fresh strawberry juice by quantitative measurements and sensory studies on model mixtures , 1997 .

[71]  D. Zellner,et al.  Color affects perceived odor intensity. , 1990, Journal of experimental psychology. Human perception and performance.

[72]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[73]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[74]  Jennifer L. Mozolic,et al.  Multisensory Integration and Aging , 2012 .

[75]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[76]  Blaz Koritnik,et al.  IN PRESS 1 Imaging the brain during sniffing : a pilot fMRI study , 2008 .

[77]  P. Schieberle,et al.  Changes in key odorants of sheep meat induced by cooking , 2006 .

[78]  P. Schieberle,et al.  Key aroma compounds in apple juice-changes during juice concentration , 2006 .

[79]  M. Beauchamp,et al.  Statistical criteria in fMRI studies of multisensory integration , 2005, Neuroinformatics.

[80]  Igor Schindler,et al.  An exploration of the role of the superior temporal gyrus in visual search and spatial perception using TMS , 2014 .