Aging and Audio-Visual and Multi-Cue Integration in Motion

The perception of naturalistic events relies on the ability to integrate information from multiple sensory systems, an ability that may change with healthy aging. When two objects move toward and then past one another, their trajectories are perceptually ambiguous: the objects may seem to stream past one another or bounce off one another. Previous research showed that auditory or visual events that occur at the time of disks’ coincidence could bias the percept toward bouncing or streaming. We exploited this malleable percept to assay age-related changes in the integration of multiple inter- and intra-modal cues. The disks’ relative luminances were manipulated to produce stimuli strongly favoring either bouncing or streaming, or to produce ambiguous motion (equal luminances). A sharp sound coincident with the disks’ overlap increased both groups’ perception of bouncing, but did so significantly less for older subjects. An occluder’s impact on motion perception varied with its duration: a long duration occluder promoted streaming in both groups; a brief occluder promoted bouncing in younger subjects, but not older ones. Control experiments demonstrated that the observed differences between younger and older subjects resulted from neither age-related changes in retinal illuminance nor age-related changes in hearing, pointing to weakened inter- and intra-modal integration with aging. These changes could contribute to previously demonstrated age-related perceptual and memory deficits.

[1]  Anthony Randal McIntosh,et al.  Visual dominance and multisensory integration changes with age , 2013, NeuroImage.

[2]  Gerard B. Remijn,et al.  Perceptual completion in a dynamic scene: An investigation with an ambiguous motion paradigm , 2007, Vision Research.

[3]  G. Sandini,et al.  Development of Visuo-Auditory Integration in Space and Time , 2012, Front. Integr. Neurosci..

[4]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[5]  J. Fozard,et al.  Age- and gender-specific reference ranges for hearing level and longitudinal changes in hearing level. , 1996, The Journal of the Acoustical Society of America.

[6]  Angelique A. Scharine,et al.  AUDITORY-VISUAL INTERACTIONS , 2009 .

[7]  Takahiro Kawabe,et al.  Stream/bounce event perception reveals a temporal limit of motion correspondence based on surface feature over space and time , 2011, i-Perception.

[8]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[9]  Arlene Earley Carney,et al.  Auditory-Visual Speech Perception and Aging , 2002, Ear and hearing.

[10]  K. Mathiak,et al.  Early attention modulates perceptual interpretation of multisensory stimuli , 2011, Neuroreport.

[11]  Sharon E. Guttman,et al.  Temporal variations in visual completion: a reflection of spatial limits? , 2003, Journal of experimental psychology. Human perception and performance.

[12]  Charles Spence,et al.  Bouncing or streaming? Exploring the influence of auditory cues on the interpretation of ambiguous visual motion , 2004, Experimental Brain Research.

[13]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[14]  D. Whitaker,et al.  Factors affecting light-adapted pupil size in normal human subjects. , 1994, Investigative ophthalmology & visual science.

[15]  Chris M. Fiacconi,et al.  The Influence of Aging on Audiovisual Temporal Order Judgments , 2013, Experimental aging research.

[16]  A B Sekuler,et al.  Time course of amodal completion revealed by a shape discrimination task , 2001, Psychonomic bulletin & review.

[17]  Patrice D. Tremoulet,et al.  Individuation of visual objects over time , 2006, Cognition.

[18]  Shlomit Yuval-Greenberg,et al.  What You See Is Not (Always) What You Hear: Induced Gamma Band Responses Reflect Cross-Modal Interactions in Familiar Object Recognition , 2007, The Journal of Neuroscience.

[19]  S. Shimojo,et al.  When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception , 2001, Psychological science.

[20]  A. Diederich,et al.  Assessing age-related multisensory enhancement with the time-window-of-integration model , 2008, Neuropsychologia.

[21]  Jeannette R. Mahoney,et al.  Multisensory integration across the senses in young and old adults , 2011, Brain Research.

[22]  Stephen E. Palmer,et al.  Perception of partly occluded objects: A microgenetic analysis. , 1992 .

[23]  Yoshitaka Nakajima,et al.  Audiovisual integration: an investigation of the "streaming-bouncing" phenomenon. , 2004, Journal of physiological anthropology and applied human science.

[24]  Fiona N. Newell,et al.  The Effect of Combined Sensory and Semantic Components on Audio–Visual Speech Perception in Older Adults , 2011, Front. Ag. Neurosci..

[25]  George J. Andersen,et al.  Aging and visual processing: Declines in spatial not temporal integration , 2008, Vision Research.

[26]  Michael Kubovy,et al.  Causality and cross-modal integration. , 2009, Journal of experimental psychology. Human perception and performance.

[27]  J. Norman,et al.  Aging and the Perception of Speed , 2003, Perception.

[28]  M. Hallett,et al.  Neural correlates of cross-modal binding , 2003, Nature Neuroscience.

[29]  J. Reynolds,et al.  Temporal Resolution for the Perception of Features and Conjunctions , 2007, The Journal of Neuroscience.

[30]  S Shimojo,et al.  Attentional Modulation in Perception of Visual Motion Events , 1998, Perception.

[31]  P. Bennett,et al.  Effects of aging on calculation efficiency and equivalent noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Yousuke Kawachi,et al.  Presentation of a Visual Nearby Moving Object Alters Stream/Bounce Event Perception , 2006, Perception.

[33]  B I Bertenthal,et al.  Directional Bias in the Perception of Translating Patterns , 1993, Perception.

[34]  Takahiro Kawabe,et al.  Effects of the orientation of moving objects on the perception of streaming/bouncing motion displays , 2006, Perception & psychophysics.

[35]  Carles Escera,et al.  The effect of age on involuntary capture of attention by irrelevant sounds: A test of the frontal hypothesis of aging , 2006, Neuropsychologia.

[36]  Kenzo Sakurai,et al.  Auditory Induced Bounce Perception Persists as the Probability of a Motion Reversal is Reduced , 2009, Perception.

[37]  Paul J Laurienti,et al.  Age-related multisensory enhancement in a simple audiovisual detection task , 2007, Neuroreport.

[38]  K. Gegenfurtner,et al.  Differential aging of motion processing mechanisms: Evidence against general perceptual decline , 2008, Vision Research.

[39]  M. Grassi,et al.  Positional noise in Landolt-C stimuli reduces spatial resolution: A study with younger and older observers , 2012, Vision Research.

[40]  Antony B. Morland,et al.  Perceptual distortions of speed at low luminance: Evidence inconsistent with a Bayesian account of speed encoding , 2007, Vision Research.

[41]  S. Shimozaki,et al.  The effects of age on the spatial and temporal integration of global motion , 2012, Vision Research.

[42]  L. Trick,et al.  Age-related differences in multiple-object tracking. , 2005, The journals of gerontology. Series B, Psychological sciences and social sciences.

[43]  Daniel Senkowski,et al.  Multisensory processing and oscillatory gamma responses: effects of spatial selective attention , 2005, Experimental Brain Research.

[44]  J. Maunsell,et al.  Neuronal correlates of inferred motion in primate posterior parietal cortex , 1995, Nature.

[45]  R. Knight,et al.  Age-related top-down suppression deficit in the early stages of cortical visual memory processing , 2008, Proceedings of the National Academy of Sciences.

[46]  P. Bennett,et al.  Spatiotemporal properties of apparent motion perception and aging. , 2010, Journal of vision.

[47]  Renaud Brochard,et al.  Visual motion disambiguation by a subliminal sound , 2008, Consciousness and Cognition.

[48]  F. Newell,et al.  Audiovisual temporal discrimination is less efficient with aging: an event-related potential study , 2011, Neuroreport.

[49]  H. Vankova Mini Mental State , 2010 .

[50]  Julia M. Stephen,et al.  Aging-related changes in auditory and visual integration measured with MEG , 2010, Neuroscience Letters.

[51]  C. Spence,et al.  Multisensory contributions to the perception of motion , 2003, Neuropsychologia.

[52]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[53]  Helga C. Arsenio,et al.  Do multielement visual tracking and visual search draw continuously on the same visual attention resources? , 2005, Journal of experimental psychology. Human perception and performance.

[54]  Robert Sekuler,et al.  Multi-sensory integration of spatio-temporal segmentation cues: one plus one does not always equal two , 2007, Experimental Brain Research.

[55]  Barbara G Shinn-Cunningham,et al.  Nothing Is Irrelevant in a Noisy World: Sensory Illusions Reveal Obligatory within-and across-Modality Integration , 2012, The Journal of Neuroscience.

[56]  Lindsay E. Farber,et al.  The effects of aging on contour discrimination in clutter , 2011, Vision Research.

[57]  J. Faubert,et al.  Larger effect of aging on the perception of higher-order stimuli , 2000, Vision Research.

[58]  Laurie M Heller,et al.  Auditory — Visual Interactions in the Perception of a Ball's Path , 2005, Perception.

[59]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[60]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[61]  Kevin Karplus,et al.  Digital Synthesis of Plucked-String and Drum Timbers , 1983 .

[62]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[63]  Shinsuke Shimojo,et al.  Beyond perceptual modality: Auditory effects on visual perception , 2001 .

[64]  R. Sekuler,et al.  The effects of aging on motion detection and direction identification , 2007, Vision Research.

[65]  L. Jakobson,et al.  Representational momentum in older adults , 2011, Brain and Cognition.

[66]  Gianluca Campana,et al.  The origin of the audiovisual bounce inducing effect: A TMS study , 2012, Neuropsychologia.

[67]  Jennifer L. Mozolic,et al.  Multisensory Integration and Aging , 2012 .

[68]  Jeremy M Wolfe,et al.  How do we track invisible objects? , 2006, Psychonomic bulletin & review.

[69]  R. Sekuler,et al.  Collisions between Moving Visual Targets: What Controls Alternative Ways of Seeing an Ambiguous Display? , 1999, Perception.

[70]  Z. Pylyshyn,et al.  Tracking Multiple Items Through Occlusion: Clues to Visual Objecthood , 1999, Cognitive Psychology.

[71]  S. Getzmann,et al.  Audiovisual influences on the perception of visual apparent motion: exploring the effect of a single sound. , 2008, Acta psychologica.

[72]  Axel H. Winneke,et al.  Does audiovisual speech offer a fountain of youth for old ears? An event-related brain potential study of age differences in audiovisual speech perception. , 2011, Psychology and aging.

[73]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[74]  P. Bennett,et al.  Effects of aging on biological motion discrimination , 2010, Vision Research.

[75]  Clara Casco,et al.  Audiovisual bounce-inducing effect: attention alone does not explain why the discs are bouncing. , 2009, Journal of experimental psychology. Human perception and performance.

[76]  L. Tyler,et al.  Are the senses enough for sense? Early high-level feedback shapes our comprehension of multisensory objects , 2012, Front. Integr. Neurosci..

[77]  Graeme J. Kennedy,et al.  Early age-related decline in the effective number of trajectories tracked in adult human vision. , 2009, Journal of vision.

[78]  R. Sekuler,et al.  Age-Related Changes in Attentional Tracking of Multiple Moving Objects , 2008, Perception.