Framework for visual-feedback training based on a modified self-organizing map to imitate complex motion

The goal of this research was to develop a visual-feedback system, based on motion sensing and computational technologies, to help athletes and patients imitate desired motor skills. To accomplish this objective, the authors used a self-organizing map to visualize high-dimensional, time-series motion data. The cyclic motion of one expert and five non-experts was captured as they pedaled a bicycle ergometer. A self-organizing map algorithm was used to display the corresponding circular motion trajectories on a two-dimensional motor skills map. The non-experts modified their motion to make their real-time motion trajectory approach that of the expert, thereby training themselves to imitate the expert motion. The root mean square error, which represents the difference between the non-expert motion and the expert motion, was significantly reduced upon using the proposed visual-feedback system. This indicates that the non-expert subjects successfully approximated the expert motion by repeated comparison of their trajectories on the motor skills map with that of the expert. The results demonstrate that the self-organizing map algorithm provides a unique way to visualize human movement and greatly facilitates the task of imitating a desired motion. By capturing the appropriate movements for display in the visual-feedback system, the proposed framework may be adopted for sports training or clinical practice.

[1]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[2]  Pablo Aqueveque,et al.  Wearable EMG Shirt for Upper Limb Training , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Giancarlo Ferrigno,et al.  Neuro-Mechanics of Recumbent Leg Cycling in Post-Acute Stroke Patients , 2016, Annals of Biomedical Engineering.

[4]  Chris H. Mullens,et al.  Visual feedback during pedaling allows individuals poststroke to alter inappropriately prolonged paretic vastus medialis activity. , 2018, Journal of neurophysiology.

[5]  Hiroki Yokota,et al.  Visualization of human motion information using self-organizing map (Motor skill map involving optimized motion based on musculoskeletal model simulation) , 2016 .

[6]  Jasper Reenalda,et al.  Manual physical balance assistance of therapists during gait training of stroke survivors: characteristics and predicting the timing , 2017, Journal of NeuroEngineering and Rehabilitation.

[7]  James W Moore,et al.  Comparing forward and backward chaining in teaching Olympic weightlifting. , 2018, Journal of applied behavior analysis.

[8]  C. Winstein,et al.  The Mirror Neuron System: A Neural Substrate for Methods in Stroke Rehabilitation , 2010, Neurorehabilitation and neural repair.

[9]  Hajime Asama,et al.  Visualization of Muscle Activity During Squat Motion for Skill Education , 2014, ICServ.

[10]  G. Ferrigno,et al.  A biofeedback cycling training to improve locomotion: a case series study based on gait pattern classification of 153 chronic stroke patients , 2011, Journal of NeuroEngineering and Rehabilitation.

[11]  G. Ferrigno,et al.  Cycling Induced by Electrical Stimulation Improves Motor Recovery in Postacute Hemiparetic Patients: A Randomized Controlled Trial , 2011, Stroke.

[12]  Hiroki Yokota,et al.  Sit-to-Stand Motion Analysis Using Multiobjective Genetic Algorithm Based on Musculoskeletal Model Simulation , 2016 .

[13]  Brian D Schmit,et al.  Influence of visual feedback on dynamic balance control in chronic stroke survivors. , 2016, Journal of biomechanics.

[14]  M. Franceschini,et al.  Action observation and mirror neuron network: a tool for motor stroke rehabilitation. , 2012, European journal of physical and rehabilitation medicine.

[15]  Jill S Higginson,et al.  Walking speed changes in response to novel user-driven treadmill control. , 2018, Journal of biomechanics.

[16]  Hiroki Yokota,et al.  Information Visualisation of Optimised Underhand Throw for Cybernetic Training , 2015 .

[17]  Richard R. Neptune,et al.  Dynamic balance during walking adaptability tasks in individuals post-stroke. , 2018, Journal of biomechanics.

[18]  Scott L. Delp,et al.  Simulation-Based Design for Wearable Robotic Systems: An Optimization Framework for Enhancing a Standing Long Jump , 2016, IEEE Transactions on Biomedical Engineering.