SoleSound: Towards a novel portable system for audio-tactile underfoot feedback

This paper introduces the design of SoleSound, a wearable system designed to deliver ecological, audio-tactile, underfoot feedback. The device, which primarily targets clinical applications, uses an audio-tactile footstep synthesis engine informed by the readings of pressure and inertial sensors embedded in the footwear to integrate enhanced feedback modalities into the authors' previously developed instrumented footwear. The synthesis models currently implemented in the SoleSound simulate different ground surface interactions. Unlike similar devices, the system presented here is fully portable, and can therefore be utilized outside the laboratory setting. A first experimental evaluation indicates that the device can effectively modulate the perception of the ground surface during walking, thereby, inducing changes in the gait of healthy subjects.

[1]  Vincent Hayward,et al.  Audio-haptic physically-based simulation of walking on different grounds , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[2]  Christian B. Redd,et al.  A wireless sensory feedback system for real-time gait modification , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Federico Fontana,et al.  Auditory feedback through continuous control of crumpling sound synthesis , 2008, CHI 2008.

[4]  Davide Rocchesso,et al.  Physically-based audio rendering of contact , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  Sunil Kumar Agrawal,et al.  An untethered shoe with vibratory feedback for improving gait of Parkinson's Patients: The PDShoe , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Joseph A. Paradiso,et al.  Shoe-integrated sensor system for wireless gait analysis and real-time feedback , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[7]  Sunil K. Agrawal,et al.  The Effect of Step-Synchronized Vibration on Patients With Parkinson's Disease: Case Studies on Subjects With Freezing of Gait or an Implanted Deep Brain Stimulator , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  J. T. Inglis,et al.  Distribution and behaviour of glabrous cutaneous receptors in the human foot sole , 2002, The Journal of physiology.

[9]  Matthew W. M. Rodger,et al.  Synthesis of Walking Sounds for Alleviating Gait Disturbances in Parkinson's Disease , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Joseph A. Paradiso,et al.  Design and implementation of expressive footwear , 2000, IBM Syst. J..

[11]  Federico Fontana,et al.  Expressive sonification of footstep sounds , 2010 .

[12]  Kate E. Webster,et al.  Rhythmic auditory cueing to improve walking in patients with neurological conditions other than Parkinson’s disease – what is the evidence? , 2013, Disability and rehabilitation.

[13]  Xiangyang Zhu,et al.  An Overview of Wearable Sensing and Wearable Feedback for Gait Retraining , 2013, ICIRA.

[14]  E Alcántara,et al.  Properties of Shoe Insert Materials Related to Shock Wave Transmission During Gait , 1995, Foot & ankle international.

[15]  Luca Turchet,et al.  Physically Based Sound Synthesis and Control of Footsteps Sounds , 2010 .

[16]  Luca Turchet,et al.  Walking pace affected by interactive sounds simulating stepping on different terrains , 2013, ACM Trans. Appl. Percept..

[17]  Martin J.-D. Otis,et al.  Toward an augmented shoe for preventing falls related to physical conditions of the soil , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[18]  Luca Turchet,et al.  Haptic Feedback for Enhancing Realism of Walking Simulations , 2013, IEEE Transactions on Haptics.

[19]  A. de Lange,et al.  A comparison of the 1-step, 2-step, and 3-step protocols for obtaining barefoot plantar pressure data in the diabetic neuropathic foot. , 2005, Clinical biomechanics.

[20]  Ziad O. Abu-Faraj,et al.  Design and development of a prototype rehabilitative shoes and spectacles for the blind , 2012, 2012 5th International Conference on BioMedical Engineering and Informatics.

[21]  Luca Turchet,et al.  Custom made wireless systems for interactive footstep sounds synthesis , 2014 .

[22]  Jeremy R. Cooperstock,et al.  Vibration Influences Haptic Perception of Surface Compliance During Walking , 2011, PloS one.

[23]  Perry R. Cook,et al.  Modeling Bill's Gait: Analysis and Parametric Synthesis of Walking Sounds , 2002 .

[24]  Luca Turchet,et al.  Semantic congruence in audio–haptic simulation of footsteps , 2014 .

[25]  M. Whittle,et al.  Generation and attenuation of transient impulsive forces beneath the foot: a review. , 1999, Gait & posture.

[26]  Stefano Papetti,et al.  Rhythm'n'Shoes: a Wearable Foot Tapping Interface with Audio-Tactile Feedback , 2011, NIME.

[27]  S. Agrawal,et al.  Effects of Complementary Auditory Feedback in Robot-Assisted Lower Extremity Motor Adaptation , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.