Augmenting Virtual Reality Terrain Display with Smart Shoe Physical Rendering: A Pilot Study

Haptic terrain rendering is limited in existing Virtual Reality (VR) systems. This paper describes integration of the Smart Shoe (SS) for physical terrain display with the TreadPort VR system. The SS renders both gross sloped terrain and subtle sensations of stepping on small objects or uneven surfaces. The TreadPort projects terrain on the floor and the SS renders terrain that the user steps upon via motion tracking. The research is motivated towards eventually providing gait training for people with Parkinson's Disease (PD), hence this work presents a pilot study evaluating haptic terrain rendering with healthy elderly and PD participants wearing the SS within the TreadPort. Uneven cobblestone surfaces are rendered by the SS as the participant steps on their graphical representation in VR. While post hoc analysis shows the study is underpowered, kinematic and spatiotemporal results derived from motion capture data demonstrates kinesthetic response (e.g., increased maximum ankle angle and minimum toe clearance, reduced minimum ankle angle and knee angle) provided by the SS. Questionnaire data shows increased VR realism and difficulty walking on cobbled terrain using SS rendering. Thus, results indicate that the integrated haptic system demonstrates promise in potential gait training for PD in future work.

[1]  V. C. Roberts,et al.  The effect of footwear mass on the gait patterns of unilateral below-knee amputees , 1989, Prosthetics and orthotics international.

[2]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[3]  Joyce Zwiener,et al.  Effect of Boot Weight and Sole Flexibility on Gait and Physiological Responses of Firefighters in Stepping Over Obstacles , 2012, Hum. Factors.

[4]  Mark A. Minor,et al.  Design of a bladder based elastomeric Smart Shoe for haptic terrain display , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  John M. Hollerbach,et al.  A 3 wire body weight support system for a large treadmill , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Brian W Schulz,et al.  Minimum toe clearance adaptations to floor surface irregularity and gait speed. , 2011, Journal of biomechanics.

[7]  Mark A. Minor,et al.  Design and Evaluation of a Soft Robotic Smart Shoe for Haptic Terrain Rendering , 2018, IEEE/ASME Transactions on Mechatronics.

[8]  K. Bo Foreman,et al.  Gait alterations on irregular surface in people with Parkinson's disease , 2018, Clinical biomechanics.

[9]  Tsutomu Miyasato,et al.  Development of Ground Surface Simulator for Tel-E-Merge system , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[10]  Jeffrey M. Hausdorff,et al.  Virtual reality for gait training: can it induce motor learning to enhance complex walking and reduce fall risk in patients with Parkinson's disease? , 2011, The journals of gerontology. Series A, Biological sciences and medical sciences.

[11]  Jake J. Abbott,et al.  Kinesthetic Force Feedback and Belt Control for the Treadport Locomotion Interface , 2015, IEEE Transactions on Haptics.

[12]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[13]  N. Harries,et al.  Training to walk amid uncertainty with Re-Step: measurements and changes with perturbation training for hemiparesis and cerebral palsy , 2013, Disability and rehabilitation. Assistive technology.

[14]  John M. Hollerbach,et al.  Torso Force Feedback Realistically Simulates Slope on Treadmill-Style Locomotion Interfaces , 2001, Int. J. Robotics Res..

[15]  Haruo Noma,et al.  Simulating side slopes on locomotion interfaces using torso forces , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[16]  A. G. Feldman,et al.  Dopamine replacement therapy does not restore the ability of Parkinsonian patients to make rapid adjustments in motor strategies according to changing sensorimotor contexts. , 2007, Parkinsonism & related disorders.

[17]  Vincent Hayward,et al.  Compressibility and Crushability Reproduction through an Amorphous Haptic Interface , 2012, EuroHaptics.

[18]  Robert Kovacs,et al.  Level-Ups: Motorized Stilts that Simulate Stair Steps in Virtual Reality , 2015, CHI Extended Abstracts.

[19]  Ismet Handzic,et al.  Comparison of the passive dynamics of walking on ground, tied-belt and split-belt treadmills, and via the Gait Enhancing Mobile Shoe (GEMS) , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[20]  Francine Malouin,et al.  A Treadmill and Motion Coupled Virtual Reality System for Gait Training Post-Stroke , 2006, Cyberpsychology Behav. Soc. Netw..

[21]  A. Merryweather,et al.  Training Persons with Parkinson Disease using an Advanced CAVE Virtual Reality System , 2019, The FASEB Journal.

[22]  Martin Krzywinski,et al.  Points of significance: Power and sample size , 2013, Nature Methods.

[23]  Sang-Youn Kim,et al.  RealWalk: Feeling Ground Surfaces While Walking in Virtual Reality , 2018, CHI Extended Abstracts.

[24]  S. Hesse,et al.  Gait rehabilitation machines based on programmable footplates , 2007, Journal of NeuroEngineering and Rehabilitation.

[25]  Regina Katzenschlager,et al.  Gait disorders in adults and the elderly , 2016, Wiener klinische Wochenschrift.

[26]  Robert Riener,et al.  Patient-cooperative control increases active participation of individuals with SCI during robot-aided gait training , 2010, Journal of NeuroEngineering and Rehabilitation.

[27]  Sahar Hassani,et al.  Human gait and Clinical Movement Analysis , 2015 .

[28]  Mark A Minor,et al.  Improving Mechanical Properties of Molded Silicone Rubber for Soft Robotics Through Fabric Compositing. , 2018, Soft robotics.

[29]  Jake J. Abbott,et al.  Investigation of the Treadport for gait rehabilitation of spinal cord injury , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Janice J Eng,et al.  A systematic review of the efficacy of gait rehabilitation strategies for spinal cord injury. , 2007, Topics in spinal cord injury rehabilitation.

[31]  Vincent G. Duffy,et al.  Developing virtual environments for industrial training , 2002, Inf. Sci..

[32]  D. Curran‐Everett,et al.  The fickle P value generates irreproducible results , 2015, Nature Methods.

[33]  Hiroo Iwata,et al.  Gait Master: a versatile locomotion interface for uneven virtual terrain , 2001, Proceedings IEEE Virtual Reality 2001.

[34]  Steven A Gard,et al.  Methodology for determining the sensitivity of swing leg toe clearance and leg length to swing leg joint angles during gait. , 2006, Gait & posture.

[35]  Kevin M. Holloway,et al.  Effectiveness of virtual reality exposure therapy for active duty soldiers in a military mental health clinic. , 2011, Journal of traumatic stress.

[36]  L. Ada,et al.  Walking capacity in mild to moderate Parkinson's disease. , 2006, Archives of physical medicine and rehabilitation.

[37]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[38]  J. Jankovic,et al.  Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results , 2008, Movement disorders : official journal of the Movement Disorder Society.

[39]  Babak Hejrati,et al.  The Treadport: Natural Gait on a Treadmill , 2019, Hum. Factors.

[40]  Rezaul Begg,et al.  A method for calculating the probability of tripping while walking. , 2008, Journal of biomechanics.

[41]  Ş. Kutlay,et al.  Does Treadmill Training Improve Lower-Extremity Tasks in Parkinson Disease? A Randomized Controlled Trial , 2008, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.