Plucked String Stiffness Affects Loudness Perception

A great variety of interactions between senses, and between motor production and senses, have been reported in previous research. In the present study, we tested whether the mechanics of a plucked string affected how the sound it produced was perceived. To test this hypothesis, we simulated the feel of a plucked string using a high fidelity haptic force-feedback device and simultaneously simulated its acoustic emission. This way, we could independently manipulate the two sensory inputs -- how it felt and how it sounded -- together with physical correct haptic interaction and with accurate synchronization. This arrangement makes it very plausible that the two sensory inputs came from a common source. We used a two-interval forced-choice discrimination procedure to determine the point of subjective equality of the loudness between a stiff and a soft plucked string. When the stiffness of the string was low, the sound was perceived to be softer. Interestingly, this effect was found only when the first string was less stiff than the second string plucked during a comparison. The results are consistent with the inverse effectiveness principle of multisensory integration.

[1]  B. Stein,et al.  The Merging of the Senses , 1993 .

[2]  Rolf Nordahl,et al.  Haptic and Audio Interaction Design - 5th International Workshop, HAID 2010, Copenhagen, Denmark, September 16-17, 2010. Proceedings , 2010, HAID.

[3]  V. Hayward,et al.  The effects of voluntary movements on auditory-haptic and haptic-haptic temporal order judgments. , 2012, Acta psychologica.

[4]  Lawrence E Marks,et al.  Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias , 2003, Perception & psychophysics.

[5]  Caroline Palmer,et al.  Movement-Related Feedback and Temporal Accuracy in Clarinet Performance , 2009 .

[6]  Kevin Karplus,et al.  Digital Synthesis of Plucked-String and Drum Timbers , 1983 .

[7]  Vincent Hayward,et al.  Vibrotactile Stimulation Can Affect Auditory Loudness: A Pilot Study , 2012, EuroHaptics.

[8]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[9]  Sebastian Merchel,et al.  HEARING WITH YOUR BODY: THE INFLUENCE OF WHOLE-BODY VIBRATIONS ON LOUDNESS PERCEPTION , 2009 .

[10]  Matti Karjalainen,et al.  Audibility of Inharmonicity in String Instrument Sounds, and Implications to Digital Sound Synthesis , 1999, ICMC.

[11]  M. Eimer,et al.  Tactile enhancement of auditory detection and perceived loudness , 2007, Brain Research.

[12]  B. Repp Effects of Auditory Feedback Deprivation on Expressive Piano Performance , 1999 .

[13]  Harvey Fletcher,et al.  Quality of Piano Tones , 1962 .

[14]  Caroline Palmer,et al.  Tactile feedback and timing accuracy in piano performance , 2008, Experimental Brain Research.

[15]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[16]  C. Drake,et al.  Tapping in Time with Mechanically and Expressively Performed Music , 2000 .

[17]  Caroline Palmer,et al.  Effects of hearing the past, present, or future during music performance , 2006, Perception & psychophysics.

[18]  Riitta Hari,et al.  Hands help hearing: facilitatory audiotactile interaction at low sound-intensity levels. , 2004, The Journal of the Acoustical Society of America.

[19]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[20]  Srikantan S. Nagarajan,et al.  Neural Mechanisms of the Time-order Error: An MEG Study , 2007, Journal of Cognitive Neuroscience.

[21]  Poika Isokoski,et al.  Haptics: Perception, Devices, Mobility, and Communication , 2012, Lecture Notes in Computer Science.

[22]  Marc O. Ernst,et al.  An instance of tactile suppression: Active exploration impairs tactile sensitivity for the direction of lateral movement , 2006 .

[23]  S. Coren,et al.  In Sensation and perception , 1979 .

[24]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[25]  Felix Wichmann,et al.  The psychometric function: I , 2001 .

[26]  Eckart Altenmüller,et al.  Loudness control in pianists as exemplified in keystroke force measurements on different touches. , 2007, The Journal of the Acoustical Society of America.

[27]  Vincent Hayward,et al.  International Conference on Intelligent Robots and Systems The Pantograph Mk-II : A Haptic Instrument * , 2005 .

[28]  Marcelo M. Wanderley,et al.  Vibrotactile Feedback in Digital Musical Instruments , 2006, NIME.

[29]  Federico Avanzini,et al.  Haptic-Auditory Rendering and Perception of Contact Stiffness , 2006, HAID.

[30]  G. Deco,et al.  Multisensory contributions to the perception of vibrotactile events , 2009, Behavioural Brain Research.