Decoding the direction of auditory motion in blind humans

Accurate processing of nonvisual stimuli is fundamental to humans with visual impairments. In this population, moving sounds activate an occipito-temporal region thought to encompass the equivalent of monkey area MT+, but it remains unclear whether the signal carries information beyond the mere presence of motion. To address this important question, we tested whether the processing in this region retains functional properties that are critical for accurate motion processing and that are well established in the visual modality. Specifically, we focussed on the property of 'directional selectivity', because MT+ neurons in non-human primates fire preferentially to specific directions of visual motion. Recent neuroimaging studies have revealed similar properties in sighted humans by successfully decoding different directions of visual motion from fMRI activation patterns. Here we used fMRI and multivariate pattern classification to demonstrate that the direction in which a sound is moving can be reliably decoded from dorsal occipito-temporal activation in the blind. We also show that classification performance is at chance (i) in a control region in posterior parietal cortex and (ii) when motion information is removed and subjects only hear a sequence of static sounds presented at the same start and end positions. These findings reveal that information about the direction of auditory motion is present in dorsal occipito-temporal responses of blind humans. As such, this area, which appears consistent with the hMT+ complex in the sighted, provides crucial information for the generation of a veridical percept of moving non-visual stimuli.

[1]  Mark W Greenlee,et al.  Neural correlates of coherent audiovisual motion perception. , 2007, Cerebral cortex.

[2]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[3]  K. Zilles,et al.  Polymodal Motion Processing in Posterior Parietal and Premotor Cortex A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys , 2001, Neuron.

[4]  Karl J. Friston,et al.  Speed-Dependent Responses in V5: A Replication Study , 1999, NeuroImage.

[5]  Andreas Bartels,et al.  The Coding of Color, Motion, and Their Conjunction in the Human Visual Cortex , 2009, Current Biology.

[6]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[7]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[8]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Colline Poirier,et al.  Auditory motion perception activates visual motion areas in early blind subjects , 2006, NeuroImage.

[10]  Alvaro Pascual-Leone,et al.  Behavioral and neuroplastic changes in the blind: evidence for functionally relevant cross-modal interactions , 2004, Journal of Physiology-Paris.

[11]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[12]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[13]  Andreas Bartels,et al.  fMRI and its interpretations: an illustration on directional selectivity in area V5/MT , 2008, Trends in Neurosciences.

[14]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[15]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[16]  M. Paré,et al.  Early-blind human subjects localize sound sources better than sighted subjects , 1998, Nature.

[17]  M. Lassonde,et al.  Cross-modal plasticity for the spatial processing of sounds in visually deprived subjects , 2008, Experimental Brain Research.

[18]  Richard S. J. Frackowiak,et al.  Right parietal cortex is involved in the perception of sound movement in humans , 1998, Nature Neuroscience.

[19]  A. Vanlierde,et al.  Specific activation of the V5 brain area by auditory motion processing: an fMRI study. , 2005, Brain research. Cognitive brain research.

[20]  Henrik Møller Fundamentals of binaural technology , 1991 .

[21]  David G. Stork,et al.  Pattern Classification , 1973 .

[22]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[23]  John J. Rieser,et al.  Blindness and Brain Plasticity in Navigation and Object Perception , 2007 .

[24]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[25]  M. Hallett,et al.  Functional relevance of cross-modal plasticity in blind humans , 1997, Nature.

[26]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[27]  S. Hillyard,et al.  Improved auditory spatial tuning in blind humans , 1999, Nature.

[28]  Richard S. J. Frackowiak,et al.  Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. , 1993, Cerebral cortex.

[29]  Sandra M. Sanabria-Bohórquez,et al.  Occipital Activation by Pattern Recognition in the Early Blind Using Auditory Substitution for Vision , 2001, NeuroImage.

[30]  Claude Veraart,et al.  Changes in occipital cortex activity in early blind humans using a sensory substitution device , 1999, Brain Research.

[31]  Alexander G. Huth,et al.  Visual Motion Area MT+/V5 Responds to Auditory Motion in Human Sight-Recovery Subjects , 2008, The Journal of Neuroscience.