Influence of Auditory Pitch on Haptic Estimation of Spatial Height

This paper presents an experiment aimed at assessing the influence of auditory feedback on haptic estimation of size. Experimental subjects were instructed to explore a virtual 3D object (a stair-step) with a haptic device, and to return a verbal estimate of the step riser height. Haptic exploration was accompanied with a real-time generated sinusoid whose pitch varied as a function of the interaction point’s height within two different ranges. Experimental results show that the haptic estimation is robust and accurate regardless the frequency range of the accompanying sound.

[1]  Bruno L. Giordano,et al.  Spatial representation of pitch height: the SMARC effect , 2006, Cognition.

[2]  S. Shimojo,et al.  Visual illusion induced by sound. , 2002, Brain research. Cognitive brain research.

[3]  Cagatay Basdogan,et al.  Haptics in virtual environments: taxonomy, research status, and challenges , 1997, Comput. Graph..

[4]  Marcelo M. Wanderley,et al.  New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series) , 2006 .

[5]  Vincent Walsh.  A theory of magnitude: common cortical metrics of time, space and quantity , 2003, Trends in Cognitive Sciences.

[6]  Federico Avanzini,et al.  Integrating physically based sound models in a multimodal rendering architecture , 2006, Comput. Animat. Virtual Worlds.

[7]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[8]  James K. Hahn,et al.  Integrating Sounds in Virtual Environments. , 1998 .

[9]  R. Chellali,et al.  Tactile exploration of virtual objects for blind and sighted people: the role of beta 1 EEG band in sensory substitution and supramodal mental mapping. , 2012, Journal of neurophysiology.

[10]  G. Fechner.  Elemente der Psychophysik , 1998 .

[11]  Bruno L. Giordano,et al.  The Mental Space of Pitch Height a , 2005, Annals of the New York Academy of Sciences.

[12]  Sebastian Merchel,et al.  Influence of the Auditory Localization Direction on the Haptic Estimation of Virtual Length , 2011, HAID.

[13]  S. Dehaene,et al.  The mental representation of parity and number magnitude. , 1993 .

[14]  Masami Ishihara,et al.  Horizontal spatial representations of time: Evidence for the STEARC effect , 2008, Cortex.