Distortions of perceived auditory and visual space following adaptation to motion

Adaptation to visual motion can induce marked distortions of the perceived spatial location of subsequently viewed stationary objects. These positional shifts are direction specific and exhibit tuning for the speed of the adapting stimulus. In this study, we sought to establish whether comparable motion-induced distortions of space can be induced in the auditory domain. Using individually measured head related transfer functions (HRTFs) we created auditory stimuli that moved either leftward or rightward in the horizontal plane. Participants adapted to unidirectional auditory motion presented at a range of speeds and then judged the spatial location of a brief stationary test stimulus. All participants displayed direction-dependent and speed-tuned shifts in perceived auditory position relative to a ‘no adaptation’ baseline measure. To permit direct comparison between effects in different sensory domains, measurements of visual motion-induced distortions of perceived position were also made using stimuli equated in positional sensitivity for each participant. Both the overall magnitude of the observed positional shifts, and the nature of their tuning with respect to adaptor speed were similar in each case. A third experiment was carried out where participants adapted to visual motion prior to making auditory position judgements. Similar to the previous experiments, shifts in the direction opposite to that of the adapting motion were observed. These results add to a growing body of evidence suggesting that the neural mechanisms that encode visual and auditory motion are more similar than previously thought.

[1]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[2]  Jing Liu,et al.  Functional organization of speed tuned neurons in visual area MT. , 2003, Journal of neurophysiology.

[3]  P. Cavanagh,et al.  Motion adaptation shifts apparent position without the motion aftereffect , 2003, Perception & psychophysics.

[4]  D R Perrott,et al.  Discrimination of moving events which accelerate or decelerate over the listening interval. , 1993, The Journal of the Acoustical Society of America.

[5]  T. Papathomas,et al.  Influences of attention on auditory aftereffects following purely visual adaptation. , 2006, Spatial vision.

[6]  Hans-Jochen Heinze,et al.  A movement-sensitive area in auditory cortex , 1999, Nature.

[7]  T D Albright,et al.  Visual motion perception. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[8]  M. M. Taylor The distance paradox of the figural after-effect in auditory localization. , 1962, Canadian journal of psychology.

[9]  David Whitaker,et al.  Isolation of stimulus characteristics contributing to Weber's law for position , 2002, Vision Research.

[10]  D. Levi,et al.  The influence of adaptation on perceived visual location , 1997, Vision Research.

[11]  J. Koenderink,et al.  Differential spatial displacement discrimination thresholds for Gabor patches , 1988, Vision Research.

[12]  Aaron M. King,et al.  The Wellcome Prize Lecture. A map of auditory space in the mammalian brain: neural computation and development , 1993, Experimental physiology.

[13]  David Whitaker,et al.  Motion Adaptation Distorts Perceived Visual Position , 2002, Current Biology.

[14]  David Whitney,et al.  Flexible retinotopy: motion-dependent position coding in the visual cortex. , 2010, Science.

[15]  G. Békésy,et al.  Experiments in Hearing , 1963 .

[16]  R. Snowden,et al.  Shifts in perceived position following adaptation to visual motion , 1998, Current Biology.

[17]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[18]  J. A. Altman,et al.  Are there neurons detecting direction of sound source motion? , 1968, Experimental neurology.

[19]  W H Ehrenstein,et al.  A Cross-Modal Aftereffect: Auditory Displacement following Adaptation to Visual Motion , 1996, Perceptual and motor skills.

[20]  M. Ahissar,et al.  Encoding of sound-source location and movement: activity of single neurons and interactions between adjacent neurons in the monkey auditory cortex. , 1992, Journal of neurophysiology.

[21]  A Rees,et al.  Human brain areas involved in the analysis of auditory movement , 2000, Human brain mapping.

[22]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[23]  P. Lennie The physiological basis of variations in visual latency , 1981, Vision Research.

[24]  Richard S. J. Frackowiak,et al.  Right parietal cortex is involved in the perception of sound movement in humans , 1998, Nature Neuroscience.

[25]  W. T. Peake,et al.  Experiments in Hearing , 1963 .

[26]  D. Grantham,et al.  Auditory motion aftereffects , 1979, Perception & psychophysics.

[27]  Gregory Hickok,et al.  An event-related fMRI study of auditory motion perception: No evidence for a specialized cortical system , 2007, Brain Research.

[28]  L. Rayleigh,et al.  XII. On our perception of sound direction , 1907 .

[29]  D. H. Kelly Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[30]  Michael F. Neelon,et al.  The effect of trajectory on the auditory motion aftereffect , 2003, Hearing Research.

[31]  S. Anstis The perception of apparent movement. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  M. Cynader,et al.  The auditory motionaftereffect: Its tuning and specificity in the spatial and frequency domains , 2000 .

[33]  J. Rauschecker,et al.  Perception of Sound-Source Motion by the Human Brain , 2002, Neuron.

[34]  D. Wesley Grantham,et al.  The effect of a free‐field auditory target’s horizontal motion on its detectability. , 1996 .

[35]  Simon Carlile,et al.  Virtual Auditory Space: Generation and Applications , 2013, Neuroscience Intelligence Unit.

[36]  D. Grantham Motion aftereffects with horizontally moving sound sources in the free field , 1989, Perception & psychophysics.

[37]  R. G. Klumpp,et al.  Some Measurements of Interaural Time Difference Thresholds , 1956 .

[38]  Paul V McGraw,et al.  Motion-Sensitive Neurones in V5/MT Modulate Perceived Spatial Position , 2004, Current Biology.

[39]  D W Grantham,et al.  Detection and discrimination of simulated motion of auditory targets in the horizontal plane. , 1986, The Journal of the Acoustical Society of America.

[40]  D W Grantham,et al.  Detectability of tonal signals with changing interaural phase differences in noise. , 1988, The Journal of the Acoustical Society of America.

[41]  J. A. Altman,et al.  Neuronal activity in the medial geniculate body of the cat during monaural and binaural stimulation , 2004, Experimental Brain Research.

[42]  Derek H. Arnold,et al.  Motion and position coding , 2007, Vision Research.

[43]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[44]  R. Reale,et al.  Auditory Space-Time Receptive Field Dynamics Revealed by Spherical White-Noise Analysis , 2001, The Journal of Neuroscience.

[45]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  David Whitney,et al.  Motion distorts perceived position without awareness of motion , 2005, Current Biology.

[47]  Simon Carlile,et al.  Generation and Applications of Virtual Auditory Space , 1996 .

[48]  J. Harris,et al.  Monaural-binaural minimum audible angles for a moving sound source. , 1971, Journal of speech and hearing research.

[49]  K. H. Britten,et al.  Motion adaptation in area MT. , 2002, Journal of neurophysiology.

[50]  Gregory Hickok,et al.  Human cortical auditory motion areas are not motion selective , 2004, Neuroreport.

[51]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[52]  V. Ramachandran,et al.  The perception of apparent motion. , 1986, Scientific American.

[53]  D. Perrott,et al.  Minimum audible movement angle: marking the end points of the path traveled by a moving sound source. , 1989, The Journal of the Acoustical Society of America.

[54]  Michael F. Neelon,et al.  The temporal growth and decay of the auditory motion aftereffect. , 2004, The Journal of the Acoustical Society of America.

[55]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[56]  S. Carlile,et al.  Systematic distortions of auditory space perception following prolonged exposure to broadband noise. , 2001, The Journal of the Acoustical Society of America.

[57]  Changing-loudness aftereffect following simulated movement: implications for channel hypotheses concerning sound level change and movement. , 1992, The Journal of general psychology.

[58]  A. J. King,et al.  Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus , 2004, Experimental Brain Research.

[59]  W H Ehrenstein,et al.  Auditory Aftereffects following Simulated Motion Produced by Varying Interaural Intensity or Time , 1994, Perception.

[60]  Norimichi Kitagawa,et al.  Hearing visual motion in depth , 2002, Nature.

[61]  D W Grantham,et al.  The effect of a free-field auditory target's motion on its detectability in the horizontal plane. , 1997, The Journal of the Acoustical Society of America.

[62]  A. Vanlierde,et al.  Specific activation of the V5 brain area by auditory motion processing: an fMRI study. , 2005, Brain research. Cognitive brain research.

[63]  R. Desimone,et al.  Local precision of visuotopic organization in the middle temporal area (MT) of the macaque , 2004, Experimental Brain Research.

[64]  Mazyar Fallah,et al.  A Motion-Dependent Distortion of Retinotopy in Area V4 , 2006, Neuron.

[65]  M. Cynader,et al.  The auditory motion aftereffect: its tuning and specificity in the spatial and frequency domains. , 2000, Perception & psychophysics.

[66]  Doris J. Kistler,et al.  Measurement and validation of human HRTFs for use in hearing research , 2005 .

[67]  Chandler Dw,et al.  Minimum audible movement angle in the horizontal plane as a function of stimulus frequency and bandwidth, source azimuth, and velocity. , 1992 .

[68]  David R. Badcock,et al.  Detecting the displacement of periodic patterns , 1985, Vision Research.

[69]  W R Thurlow,et al.  Some determinants of localization-adaptation effects for successive auditory stimuli. , 1973, The Journal of the Acoustical Society of America.

[70]  Sieu K. Khuu,et al.  The perceived position shift of a pattern that contains internal motion is accompanied by a change in the pattern’s apparent size and shape , 2007, Vision Research.

[71]  Alexander Thiele,et al.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons , 2001, Nature Neuroscience.

[72]  V. Ramachandran,et al.  Illusory Displacement of Equiluminous Kinetic Edges , 1990, Perception.

[73]  L. Maffei,et al.  Neural Correlate of Perceptual Adaptation to Gratings , 1973, Science.

[74]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[75]  Y. Dan,et al.  Asymmetry in Visual Cortical Circuits Underlying Motion-Induced Perceptual Mislocalization , 2004, The Journal of Neuroscience.

[76]  Brian A Wandell,et al.  Assessment of stimulus-induced changes in human V1 visual field maps. , 2006, Journal of neurophysiology.

[77]  Eric I Knudsen,et al.  Dynamic shifts in the owl's auditory space map predict moving sound location , 2006, Nature Neuroscience.

[78]  H. Barlow,et al.  Evidence for a Physiological Explanation of the Waterfall Phenomenon and Figural After-effects , 1963, Nature.

[79]  Taylor Mm The distance paradox of the figural after-effect in auditory localization. , 1962 .