Interactive footstep sounds modulate the perceptual-motor aftereffect of treadmill walking

In this study, we investigated the role of interactive auditory feedback in modulating the inadvertent forward drift experienced while attempting to walk in place with closed eyes following a few minutes of treadmill walking. Simulations of footstep sounds upon surface materials such as concrete and snow were provided by means of a system composed of headphones and shoes augmented with sensors. In a control condition, participants could hear their actual footstep sounds. Results showed an overall enhancement of the forward drift after treadmill walking independent of the sound perceived, while the strength of the aftereffect, measured as the proportional increase (posttest/pretest) in forward drift, was higher under the influence of snow compared to both concrete and actual sound. In addition, a higher knee angle flexion was found during the snow sound condition both before and after treadmill walking. Behavioral results confirmed those of a perceptual questionnaire, which showed that the snow sound was effective in producing strong pseudo-haptic illusions. Our results provide evidence that the walking in place aftereffect results from a recalibration of haptic, visuo-motor but also sound-motor control systems. Self-motion perception is multimodal.

[1]  Luca Turchet,et al.  Sound synthesis and evaluation of interactive footsteps for virtual reality applications , 2010, 2010 IEEE Virtual Reality Conference (VR).

[2]  K. H. Hunt,et al.  Coefficient of Restitution Interpreted as Damping in Vibroimpact , 1975 .

[3]  D. Proffitt,et al.  Treadmill experience mediates the perceptual-motor aftereffect of treadmill walking , 2011, Experimental Brain Research.

[4]  E. Saltzman,et al.  Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions , 2007, The Journal of Neuroscience.

[5]  M. Schieppati,et al.  Quiet stance control is affected by prior treadmill but not overground locomotion , 2007, European Journal of Applied Physiology.

[6]  Istvan Molnar-Szakacs,et al.  Music and mirror neurons: from motion to 'e'motion. , 2006, Social cognitive and affective neuroscience.

[7]  Yvon Brenière,et al.  Changes to the gait initiation programme following a running exercise in human subjects , 1999, Neuroscience Letters.

[8]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[9]  Stuart Anstis,et al.  Aftereffects from jogging , 2004, Experimental Brain Research.

[10]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[11]  F. Alton,et al.  A kinematic comparison of overground and treadmill walking. , 1998, Clinical biomechanics.

[12]  Luca Turchet,et al.  Physically Based Sound Synthesis and Control of Footsteps Sounds , 2010 .

[13]  Y. Baram,et al.  Auditory feedback control for improvement of gait in patients with Multiple Sclerosis , 2007, Journal of the Neurological Sciences.

[14]  Luca Turchet,et al.  Walking pace affected by interactive sounds simulating stepping on different terrains , 2013, ACM Trans. Appl. Percept..

[15]  Luca Turchet,et al.  Investigating the amplitude of interactive footstep sounds and soundscape reproduction , 2013 .

[16]  Vincent Hayward,et al.  Audio-haptic physically-based simulation of walking on different grounds , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[17]  Bruno L. Giordano,et al.  When Ears Drive Hands: The Influence of Contact Sound on Reaching to Grasp , 2010, PloS one.

[18]  Laura F. Fox,et al.  Self-motion perception during locomotor recalibration: more than meets the eye. , 2005, Journal of experimental psychology. Human perception and performance.

[19]  Ciara M O'Connor,et al.  Automatic detection of gait events using kinematic data. , 2007, Gait & posture.

[20]  Melvyn A. Goodale,et al.  Integration of visual and auditory information for hand actions: preliminary evidence for the contribution of natural sounds to grasping , 2011, Experimental Brain Research.

[21]  Yoram Baram,et al.  Gait improvement in patients with cerebral palsy by visual and auditory feedback , 2009, 2009 Virtual Rehabilitation International Conference.

[22]  Luca Turchet,et al.  Physically based sound synthesis and control of jumping sounds on an elastic trampoline , 2013 .

[23]  D. Rocchesso,et al.  Might as Well Jump: Sound Affects Muscle Activation in Skateboarding , 2014, PloS one.

[24]  G. Deuschl,et al.  Gait analysis during treadmill and overground locomotion in children and adults. , 1997, Electroencephalography and clinical neurophysiology.

[25]  Matthew W. M. Rodger,et al.  Synthesis of Walking Sounds for Alleviating Gait Disturbances in Parkinson's Disease , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Robert J. Logan,et al.  Perception of acoustic source characteristics: walking sounds. , 1991, The Journal of the Acoustical Society of America.

[27]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[28]  J. Philbeck,et al.  Progressive locomotor recalibration during blind walking , 2008, Perception & psychophysics.

[29]  Davide Rocchesso,et al.  MODELING COLLISION SOUNDS: NON-LINEAR CONTACT FORCE , 2001 .

[30]  D. Sternad,et al.  Local dynamic stability versus kinematic variability of continuous overground and treadmill walking. , 2001, Journal of biomechanical engineering.

[31]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[32]  Alberto E. Minetti,et al.  Anatomically Asymmetrical Runners Move More Asymmetrically at the Same Metabolic Cost , 2013, PloS one.

[33]  Michael H. Thaut,et al.  Rhythmic Auditory Stimulation in Rehabilitation of Movement Disorders: A Review Of Current Research , 2010 .

[34]  Adar Pelah,et al.  Visuomotor adaptation without vision? , 1999, Experimental Brain Research.

[35]  Anne E. Garing,et al.  Calibration of human locomotion and models of perceptual-motor organization. , 1995, Journal of experimental psychology. Human perception and performance.