Consonance of Vibrotactile Chords

This paper is concerned with the perception of complex vibrotactile stimuli in which a few sinusoidal vibrations with different frequencies are superimposed. We begin with an observation that such vibrotactile signals are analogous to musical chords in which multiple notes are played simultaneously. A set of so-called “vibrotactile chords” are designed on the basis of musical chords, and their degrees of consonance (harmony) that participants perceive are evaluated through a perceptual experiment. Experimental results indicate that participants can reliably rate the degrees of consonance of vibrotactile chords and establish a well-defined function that relates the degree of consonance to the base and chordal frequency of a vibrotactile chord. These findings have direct implications for the design of complex vibrotactile signals that can be produced by current wideband actuators such as voice-coil, piezoelectric, and electroactive polymer actuators.

[1]  Karon E. MacLean,et al.  Designing Large Sets of Haptic Icons with Rhythm , 2008, EuroHaptics.

[2]  최승문,et al.  Perceptual Space of Amplitude-Modulated Vibrotactile Stimuli , 2011 .

[3]  Seungmoon Choi,et al.  Consonance Perception of Vibrotactile Chords: A Feasibility Study , 2011, HAID.

[4]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[5]  Martha Guernsey,et al.  The Role of Consonance and Dissonance in Music , 1928 .

[6]  V. Venkatachalam,et al.  A simple envelope detector , 1988 .

[7]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[8]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[9]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[10]  Seungmoon Choi,et al.  Tactile effect design and evaluation for virtual buttons on a mobile device touchscreen , 2011, Mobile HCI.

[11]  M. Hollins,et al.  Vibrotactile intensity and frequency information in the Pacinian system: A psychophysical model , 2005, Perception & psychophysics.

[12]  M. Hollins,et al.  The vibrations of texture , 2003, Somatosensory & motor research.

[13]  Pantelis N. Vassilakis,et al.  Psychoacoustic and cognitive aspects of auditory roughness: definitions, models, and applications , 2010, Electronic Imaging.

[14]  Hong Z. Tan,et al.  Information transmission with a multi-finger tactual display , 1997, Scandinavian audiology. Supplementum.

[15]  R. Plomp,et al.  Tonal consonance and critical bandwidth. , 1965, The Journal of the Acoustical Society of America.

[16]  Seungmoon Choi,et al.  Perceived intensity of tool-transmitted vibration: Effects of amplitude and frequency , 2012, 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012) Proceedings.

[17]  R. Parncutt.  Harmony: A Psychoacoustical Approach , 1989 .

[18]  Ali Israr,et al.  Detection Threshold and Mechanical Impedance of the Hand in a Pen-Hold Posture , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Vuokko Lantz,et al.  Design of Dynamic Vibrotactile Textures , 2010, IEEE Transactions on Haptics.

[20]  Seungmoon Choi,et al.  Real-time perception-level translation from audio signals to vibrotactile effects , 2013, CHI.

[21]  Constantine Frithiof Malmberg,et al.  The perception of consonance and dissonance , 1918 .

[22]  Seungmoon Choi,et al.  Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device , 2010, 2010 IEEE Haptics Symposium.

[23]  M. Rowe,et al.  Perceived pitch of vibrotactile stimuli: effects of vibration amplitude, and implications for vibration frequency coding. , 1990, The Journal of physiology.

[24]  M. Hollins,et al.  A ratio code for vibrotactile pitch. , 1998, Somatosensory & motor research.

[25]  M. Hollins,et al.  Vibrotaction and texture perception , 2002, Behavioural Brain Research.

[26]  C. W. Valentine.  THE METHOD OF COMPARISON1 IN EXPERIMENTS WITH MUSICAL INTERVALS AND THE EFFECT OF PRACTICE ON THE APPRECIATION OF DISCORDS , 1914 .

[27]  S. Lederman,et al.  Human Hand Function , 2006 .

[28]  Georg v. Békésy,et al.  Synchronism of Neural Discharges and Their Demultiplication in Pitch Perception on the Skin and in Hearing , 1959 .

[29]  Hermann von Helmholtz,et al.  On the Sensations of Tone , 1954 .

[30]  Carl Stumpf,et al.  Konsonanz und Dissonanz , 1898 .

[31]  R. Plomp,et al.  The connotation of musical consonance , 1962 .

[32]  Stephen A. Brewster,et al.  Mobile Multi-actuator Tactile Displays , 2007, HAID.

[33]  M. Goldstein,et al.  Tactile aids for profoundly deaf children. , 1985, The Journal of the Acoustical Society of America.

[34]  J. F. Dammann,et al.  Temporal Frequency Channels Are Linked across Audition and Touch , 2009, Current Biology.