Audio-haptic physically-based simulation of walking on different grounds

We describe a system which simulates in realtime the auditory and haptic sensations of walking on different surfaces. The system is based on a pair of sandals enhanced with pressure sensors and actuators. The pressure sensors detect the interaction force during walking, and control several physically based synthesis algorithms, which drive both the auditory and haptic feedback. The different hardware and software components of the system are described, together with possible uses and possibilities for improvements in future design iterations.

[1]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[2]  Davide Rocchesso,et al.  MODELING COLLISION SOUNDS: NON-LINEAR CONTACT FORCE , 2001 .

[3]  S. Lederman.  Auditory Texture Perception , 1979, Perception.

[4]  Luca Turchet,et al.  Sound synthesis and evaluation of interactive footsteps for virtual reality applications , 2010, 2010 IEEE Virtual Reality Conference (VR).

[5]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[6]  Davide Rocchesso,et al.  Interactive Simulation of rigid body interaction with friction-induced sound generation , 2005, IEEE Transactions on Speech and Audio Processing.

[7]  Bruno L. Giordano,et al.  Non‐visual identification of walking grounds , 2008 .

[8]  Vincent Hayward,et al.  Single state elastoplastic friction models , 2002, IEEE Trans. Autom. Control..

[9]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[10]  Perry R. Cook,et al.  Modeling Bill's Gait: Analysis and Parametric Synthesis of Walking Sounds , 2002 .

[11]  Federico Avanzini,et al.  Haptic-Auditory Rendering and Perception of Contact Stiffness , 2006, HAID.

[12]  Andy Farnell.  Marching onwards Procedural synthetic footsteps for video games and animation , 2007 .

[13]  Vincent Hayward,et al.  Preliminary Experiment Combining Virtual Reality Haptic Shoes and Audio Synthesis , 2010, EuroHaptics.

[14]  Federico Fontana,et al.  Physics-based sound synthesis and control: crushing, walking and running by crumpling sounds , 2003 .

[15]  Cumhur Erkut,et al.  Synthesis of Hand Clapping Sounds , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  K. H. Hunt,et al.  Coefficient of Restitution Interpreted as Damping in Vibroimpact , 1975 .