Crinkling and crumpling: An auditory fMRI study of material properties

Knowledge of an object's material composition (i.e., what it is made of) alters how we interact with that object. Seeing the bright glint or hearing the metallic crinkle of a foil plate for example, confers information about that object before we have even touched it. Recent research indicates that the medial aspect of the ventral visual pathway is sensitive to the surface properties of objects. In the present functional magnetic resonance imaging (fMRI) study, we investigated whether the ventral pathway is also sensitive to material properties derived from sound alone. Relative to scrambled material sounds and non-verbal human vocalizations, audio recordings of materials being manipulated (i.e., crumpled) in someone's hands elicited greater BOLD activity in the right parahippocampal cortex of neurologically intact listeners, as well as a cortically blind participant. Additional left inferior parietal lobe activity was also observed in the neurologically intact group. Taken together, these results support a ventro-medial pathway that is specialized for processing the material properties of objects, and suggest that there are sub-regions within this pathway that subserve the processing of acoustically-derived information about material composition.

[1]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[2]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[3]  A. Oliva,et al.  Flexible, Diagnosticity-Driven, Rather Than Fixed, Perceptually Determined Scale Selection in Scene and Face Recognition , 1997, Perception.

[4]  M. Goodale,et al.  Ventral occipital lesions impair object recognition but not object-directed grasping: an fMRI study. , 2003, Brain : a journal of neurology.

[5]  James W. Lewis,et al.  Lefties Get It Right When Hearing Tool Sounds , 2006, Journal of Cognitive Neuroscience.

[6]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[7]  Julius Fridriksson,et al.  Speech perception in MRI scanner noise by persons with aphasia. , 2007, Journal of speech, language, and hearing research : JSLHR.

[8]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[9]  Gary H. Glover,et al.  Neural Correlates of Timbre Change in Harmonic Sounds , 2002, NeuroImage.

[10]  D L Rosene,et al.  Organization of direct hippocampal efferent projections to the cerebral cortex of the rhesus monkey: Projections from CA1, prosubiculum, and subiculum to the temporal lobe , 1998, The Journal of comparative neurology.

[11]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[12]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[13]  P Møller,et al.  Psychophysical evidence for fast region-based segmentation processes in motion and color. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Dinesh K. Pai,et al.  Perception of Material from Contact Sounds , 2000, Presence: Teleoperators & Virtual Environments.

[15]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[16]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[17]  Melvyn A Goodale,et al.  Voice recognition and the posterior cingulate: an fMRI study of prosopagnosia. , 2008, Journal of neuropsychology.

[18]  D. Eidelberg,et al.  Functional neuroanatomy of non-verbal semantic sound processing in humans , 2006, Journal of Neural Transmission.

[19]  K. Zilles,et al.  Polymodal Motion Processing in Posterior Parietal and Premotor Cortex A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys , 2001, Neuron.

[20]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[21]  E. DeYoe,et al.  Distinct Cortical Pathways for Processing Tool versus Animal Sounds , 2005, The Journal of Neuroscience.

[22]  A Engelien,et al.  The Parahippocampal Region and Auditory‐Mnemonic Processing , 2000, Annals of the New York Academy of Sciences.

[23]  Andreas Kleinschmidt,et al.  Interaction of Face and Voice Areas during Speaker Recognition , 2005, Journal of Cognitive Neuroscience.

[24]  G N Dutton,et al.  Cognitive vision, its disorders and differential diagnosis in adults and children: knowing where and what things are , 2003, Eye.

[25]  Gregory Hickok,et al.  An event-related fMRI study of auditory motion perception: No evidence for a specialized cortical system , 2007, Brain Research.

[26]  Pierre Fonlupt,et al.  Listening to a walking human activates the temporal biological motion area , 2005, NeuroImage.

[27]  Douglas L Rosene,et al.  Parcellation of cortical afferents to three distinct sectors in the parahippocampal gyrus of the rhesus monkey: An anatomical and neurophysiological study , 2003, The Journal of comparative neurology.

[28]  Gian Luca Romani,et al.  “What” versus “Where” in the audiovisual domain: An fMRI study , 2006, NeuroImage.

[29]  D. Amaral,et al.  Perirhinal and parahippocampal cortices of the macaque monkey: Intrinsic projections and interconnections , 2004, The Journal of comparative neurology.

[30]  Scott T. Grafton,et al.  Cortical topography of human anterior intraparietal cortex active during visually guided grasping. , 2005, Brain research. Cognitive brain research.

[31]  Whitman A. Richards.  Natural Computation , 1988 .

[32]  G. Orban,et al.  Attention to 3-D Shape, 3-D Motion, and Texture in 3-D Structure from Motion Displays , 2004, Journal of Cognitive Neuroscience.

[33]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[34]  A Rees,et al.  Human brain areas involved in the analysis of auditory movement , 2000, Human brain mapping.

[35]  M. Buckley.  The Role of the Perirhinal Cortex and Hippocampus in Learning, Memory, and Perception , 2005, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[36]  D. Amaral,et al.  Perirhinal and parahippocampal cortices of the macaque monkey: Projections to the neocortex , 2002, The Journal of comparative neurology.

[37]  S. Iversen,et al.  Detection of Audio-Visual Integration Sites in Humans by Application of Electrophysiological Criteria to the BOLD Effect , 2001, NeuroImage.

[38]  M. Goodale,et al.  Active manual control of object views facilitates visual recognition , 1999, Current Biology.

[39]  Jon H. Kaas,et al.  'What' and 'where' processing in auditory cortex , 1999, Nature Neuroscience.

[40]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[41]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[42]  D. Amaral,et al.  Where are the perirhinal and parahippocampal cortices? a historical overview of the nomenclature and boundaries applied to the primate medial temporal lobe , 2003, Neuroscience.

[43]  Jonathan S. Cant,et al.  fMR-adaptation reveals separate processing regions for the perception of form and texture in the human ventral stream , 2008, Experimental Brain Research.

[44]  Alex Martin,et al.  Grounding Object Concepts in Perception and Action: Evidence from FMRI Studies of Tools , 2007, Cortex.

[45]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[46]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[47]  Péter Szigetvári,et al.  What and When? , 2019, Inauguration and Liturgical Kingship in the Long Twelfth Century.

[48]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[49]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[50]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[51]  M Jeannerod,et al.  Visual working memory for shape and 3D‐orientation: a PET study , 1997, Neuroreport.

[52]  J. Culham,et al.  The role of parietal cortex in visuomotor control: What have we learned from neuroimaging? , 2006, Neuropsychologia.

[53]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[54]  Richard S. J. Frackowiak,et al.  Right parietal cortex is involved in the perception of sound movement in humans , 1998, Nature Neuroscience.

[55]  W. Singer,et al.  Retinotopic effects during spatial audio-visual integration , 2007, Neuropsychologia.

[56]  D. Amaral,et al.  Perirhinal and parahippocampal cortices of the macaque monkey: Cortical afferents , 1994, The Journal of comparative neurology.

[57]  Stephen R. Arnott,et al.  The Functional Organization of Auditory Working Memory as Revealed by fMRI , 2005, Journal of Cognitive Neuroscience.

[58]  M. Bar,et al.  Top-down facilitation of visual object recognition: object-based and context-based contributions. , 2006, Progress in brain research.

[59]  Anne-Lise Giraud,et al.  Voice recognition and cross-modal responses to familiar speakers' voices in prosopagnosia. , 2006, Cerebral cortex.

[60]  Claude Alain,et al.  Assessing the auditory dual-pathway model in humans , 2004, NeuroImage.

[61]  Stephen R. Arnott,et al.  Distorting visual space with sound , 2006, Vision Research.

[62]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[63]  G. Humphrey,et al.  Recognizing novel views of three-dimensional objects. , 1992, Canadian journal of psychology.

[64]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Ravi S. Menon,et al.  Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2003, Experimental Brain Research.

[66]  Umberto Castiello,et al.  The Cortical Control of Visually Guided Grasping , 2008, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[67]  E Macaluso,et al.  Spatial and temporal factors during processing of audiovisual speech: a PET study , 2004, NeuroImage.

[68]  A. Oliva,et al.  Diagnostic Colors Mediate Scene Recognition , 2000, Cognitive Psychology.

[69]  T. R. Jordan,et al.  Perception and action in 'visual form agnosia'. , 1991, Brain : a journal of neurology.

[70]  A. Oliva,et al.  Coarse Blobs or Fine Edges? Evidence That Information Diagnosticity Changes the Perception of Complex Visual Stimuli , 1997, Cognitive Psychology.

[71]  C Dohle,et al.  Human anterior intraparietal area subserves prehension , 1998, Neurology.

[72]  Joseph B. Sala,et al.  Dissociable functional cortical topographies for working memory maintenance of voice identity and location. , 2004, Cerebral cortex.

[73]  Hsuan-Chih Chen,et al.  Brain Responses to Segmentally and Tonally Induced Semantic Violations in Cantonese , 2005, Journal of Cognitive Neuroscience.

[74]  M. Brett,et al.  Actions Speak Louder Than Functions: The Importance of Manipulability and Action in Tool Representation , 2003, Journal of Cognitive Neuroscience.

[75]  C. Grady,et al.  “What” and “where” in the human auditory system , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[76]  Kenneth F. Valyear,et al.  Human parietal cortex in action , 2006, Current Opinion in Neurobiology.

[77]  H. Scheich,et al.  Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems , 2006, Neuroscience.

[78]  Hanna Damasio,et al.  The neuroanatomical correlates of route learning impairment , 2000, Neuropsychologia.

[79]  Bruno L. Giordano,et al.  Material identification of real impact sounds: effects of size variation in steel, glass, wood, and plexiglass plates. , 2006, The Journal of the Acoustical Society of America.

[80]  M. Bar.  Visual objects in context , 2004, Nature Reviews Neuroscience.

[81]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[82]  Jean-Philippe Thiran,et al.  What and Where in human audition: selective deficits following focal hemispheric lesions , 2002, Experimental Brain Research.

[83]  R. Insausti,et al.  The human entorhinal cortex: A cytoarchitectonic analysis , 1995, The Journal of comparative neurology.