Reaching for the high note: judgments of auditory pitch are affected by kinesthetic position

Auditory pitch is represented on a vertical continuum (e.g., high vs. low). In three experiments, we examined whether the kinesthetic experience of moving in a particular direction (e.g., walking up vs. down stairs; reaching up vs. down) would affect judgments of auditory pitch. Participants listened to three tones twice each, once while moving upward and once while moving downward, and estimated the pitch of each tone. In all experiments, participants’ judgments of the tones’ pitch were biased in the direction of their movement. Moreover, this effect is not due to visibility of the movement or to using a numerical response method. Our results suggest that kinesthetic information from one’s own bodily movements biases pitch estimation, and several possible mechanisms for the effect are discussed.

[1]  Takeshi Hatta,et al.  Spatial structure of quantitative representation of numbers: Evidence from the SNARC effect , 2004, Memory & cognition.

[2]  Z. Eitan,et al.  HOW MUSIC MOVES: Musical Parameters and Listeners' Images of Motion , 2006 .

[3]  M. van der Schoot,et al.  The developmental onset of symbolic approximation: beyond nonsymbolic representations, the language of numbers matters , 2015, Front. Psychol..

[4]  F. Strack,et al.  Routes to embodiment , 2015, Front. Psychol..

[5]  C. Spence,et al.  Are crossmodal correspondences relative or absolute? Sequential effects on speeded classification , 2018, Attention, perception & psychophysics.

[6]  Anne Treisman,et al.  Natural cross-modal mappings between visual and auditory features. , 2011, Journal of vision.

[7]  Sofia Dahl,et al.  Facial Expression and Vocal Pitch Height: Evidence of an Intermodal Association , 2009 .

[8]  Bruno L. Giordano,et al.  Spatial representation of pitch height: the SMARC effect , 2006, Cognition.

[9]  Daniel Shanahan,et al.  Eyebrow movements and vocal pitch height: evidence consistent with an ethological signal. , 2013, The Journal of the Acoustical Society of America.

[10]  P. Gomez,et al.  Music and felt emotions: How systematic pitch level variations affect the experience of pleasantness and arousal , 2014 .

[11]  Ryota Kanai,et al.  Changing pitch induced visual motion illusion , 2004, Current Biology.

[12]  Ellen Winner,et al.  "Metaphorical" Mapping in Human Infants , 1981 .

[13]  A. Majid,et al.  The Thickness of Musical Pitch , 2013, Psychological science.

[14]  Marcia Grabowecky,et al.  Changes in auditory frequency guide visual–spatial attention , 2011, Cognition.

[15]  Norbert Schwarz,et al.  To judge a book by its weight you need to know its content: Knowledge moderates the use of embodied cues , 2012 .

[16]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[17]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[18]  R. Butler,et al.  Localization of tonal stimuli in the vertical plane. , 1968, The Journal of the Acoustical Society of America.

[19]  Frédéric Bevilacqua,et al.  Rising tones and rustling noises: Metaphors in gestural depictions of sounds , 2017, PloS one.

[20]  C. Spence,et al.  Does Language Influence the Vertical Representation of Auditory Pitch and Loudness? , 2017, i-Perception.

[21]  Judith Holler,et al.  Do you see what I’m singing? Visuospatial movement biases pitch perception , 2013, Brain and Cognition.

[22]  Fernando Marmolejo-Ramos,et al.  Drawing sounds: representing tones and chords spatially , 2016, Experimental Brain Research.

[23]  Janet Metcalfe,et al.  From the Revolution to Embodiment , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[24]  D. Casasanto,et al.  Motor action and emotional memory , 2010, Cognition.

[25]  Daniel Casasanto,et al.  Spatial Congruity Effects Reveal Metaphorical Thinking, not Polarity Correspondence , 2015, Front. Psychol..

[26]  Mark Johnson,et al.  The Metaphorical Structure of the Human Conceptual System , 1980, Cogn. Sci..

[27]  Marco Costa,et al.  Pitch-verticality and pitch-size cross-modal interactions , 2018 .

[28]  C. Spence Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[29]  A. Mencacci,et al.  Time trend analysis (2009-2016) of antimicrobial susceptibility in Neisseria gonorrhoeae isolated in Italy following the introduction of the combined antimicrobial therapy , 2017, PloS one.

[30]  C. C. Pratt The spatial character of high and low tones. , 1930 .

[31]  Charles Spence,et al.  Compatibility effects between sound frequency and tactile elevation , 2009, Neuroreport.

[32]  Joost X. Maier,et al.  Natural, Metaphoric, and Linguistic Auditory Direction Signals Have Distinct Influences on Visual Motion Processing , 2009, The Journal of Neuroscience.