Using Probabilistic Movement Primitives in Analyzing Human Motion Differences Under Transcranial Current Stimulation

In medical tasks such as human motion analysis, computer-aided auxiliary systems have become the preferred choice for human experts for their high efficiency. However, conventional approaches are typically based on user-defined features such as movement onset times, peak velocities, motion vectors, or frequency domain analyses. Such approaches entail careful data post-processing or specific domain knowledge to achieve a meaningful feature extraction. Besides, they are prone to noise and the manual-defined features could hardly be re-used for other analyses. In this paper, we proposed probabilistic movement primitives (ProMPs), a widely-used approach in robot skill learning, to model human motions. The benefit of ProMPs is that the features are directly learned from the data and ProMPs can capture important features describing the trajectory shape, which can easily be extended to other tasks. Distinct from previous research, where classification tasks are mostly investigated, we applied ProMPs together with a variant of Kullback-Leibler (KL) divergence to quantify the effect of different transcranial current stimulation methods on human motions. We presented an initial result with 10 participants. The results validate ProMPs as a robust and effective feature extractor for human motions.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[3]  Dong Seog Han,et al.  Feature Representation and Data Augmentation for Human Activity Classification Based on Wearable IMU Sensor Data Using a Deep LSTM Neural Network , 2018, Sensors.

[4]  M. Bikson,et al.  Transcranial current stimulation focality using disc and ring electrode configurations: FEM analysis , 2008, Journal of neural engineering.

[5]  L. Cohen,et al.  Transcranial direct current stimulation: State of the art 2008 , 2008, Brain Stimulation.

[6]  Jan Peters,et al.  Using probabilistic movement primitives in robotics , 2017, Autonomous Robots.

[7]  U. Ziemann,et al.  Non-invasive Cerebellar Stimulation—a Consensus Paper , 2022 .

[8]  Bin Jiang,et al.  An improved incipient fault detection method based on Kullback-Leibler divergence. , 2018, ISA transactions.

[9]  Andrea d'Avella,et al.  Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems , 2013, Front. Comput. Neurosci..

[10]  Jun Nakanishi,et al.  Learning Movement Primitives , 2005, ISRR.

[11]  Jan Peters,et al.  Learning multiple collaborative tasks with a mixture of Interaction Primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  S. N. Omkar,et al.  Time-frequency analysis of human motion during rhythmic exercises , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Sandra Hirche,et al.  Dynamic Movement Primitives for cooperative manipulation and synchronized motions , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Stefan Schaal,et al.  Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[16]  Dominik Schuldhaus,et al.  IMU-based Trick Classification in Skateboarding , 2015 .

[17]  Giorgio Visani,et al.  Metrics for Multi-Class Classification: an Overview , 2020, ArXiv.

[18]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.

[19]  S. Schaal Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[20]  Jan Peters,et al.  Learning Probabilistic Features from EMG Data for Predicting Knee Abnormalities , 2016 .

[21]  Jan Peters,et al.  Extracting low-dimensional control variables for movement primitives , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Laura Power,et al.  Quantitative assessment of cerebellar ataxia, through automated limb functional tests , 2019, Journal of NeuroEngineering and Rehabilitation.

[23]  Affan Pervez,et al.  Learning task-parameterized dynamic movement primitives using mixture of GMMs , 2018, Intell. Serv. Robotics.

[24]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[25]  Hong Wei,et al.  A survey of human motion analysis using depth imagery , 2013, Pattern Recognit. Lett..

[26]  Jeffrey M. Hausdorff,et al.  A new measure for quantifying the bilateral coordination of human gait: effects of aging and Parkinson’s disease , 2007, Experimental Brain Research.

[27]  Jie Liu,et al.  Multisensor Fault Detection and Isolation Using Kullback Leibler Divergence: Application to Data Vibration Signals , 2017, 2017 International Conference on Sensing, Diagnostics, Prognostics, and Control (SDPC).

[28]  Don H. Johnson,et al.  Symmetrizing the Kullback-Leibler Distance , 2001 .

[29]  F. Fregni,et al.  Neurobiological Effects of Transcranial Direct Current Stimulation: A Review , 2012, Front. Psychiatry.

[30]  Qian Du,et al.  A potential field method-based extension of the dynamic movement primitive algorithm for imitation learning with obstacle avoidance , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[31]  P. Brown,et al.  Tremor Suppression by Rhythmic Transcranial Current Stimulation , 2013, Current Biology.

[32]  A. Gemignani,et al.  The clinical application of transcranial direct current stimulation in patients with cerebellar ataxia: a systematic review , 2020, The International journal of neuroscience.

[33]  H. Francis Song,et al.  V-MPO: On-Policy Maximum a Posteriori Policy Optimization for Discrete and Continuous Control , 2019, ICLR.

[34]  J. Desmond,et al.  Alcohol and the Cerebellum , 1995, Alcohol health and research world.

[35]  Jan Peters,et al.  A comparison of distance measures for learning nonparametric motor skill libraries , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[36]  Stefan Schaal,et al.  Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[37]  Margherita Russo,et al.  Does Transcranial Alternating Current Stimulation Induce Cerebellum Plasticity? Feasibility, Safety and Efficacy of a Novel Electrophysiological Approach , 2016, Brain Stimulation.

[38]  Ales Ude,et al.  Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives , 2011, Robotics Auton. Syst..

[39]  M. Hallett,et al.  Effects of cerebellar theta-burst stimulation on arm and neck movement kinematics in patients with focal dystonia , 2016, Clinical Neurophysiology.

[40]  Jan Peters,et al.  Probabilistic Movement Models Show that Postural Control Precedes and Predicts Volitional Motor Control , 2016, Scientific Reports.

[41]  Jun Nakanishi,et al.  Control, Planning, Learning, and Imitation with Dynamic Movement Primitives , 2003 .

[42]  Satoshi Endo,et al.  Dynamic Movement Primitives for Human-Robot interaction: Comparison with human behavioral observation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  M. Dopsaj,et al.  Potential of IMU-Based Systems in Measuring Single Rapid Movement Variables in Females with Different Training Backgrounds and Specialization , 2020, Applied bionics and biomechanics.

[44]  Michelle Karg,et al.  Movement Primitive Segmentation for Human Motion Modeling: A Framework for Analysis , 2016, IEEE Transactions on Human-Machine Systems.

[45]  Geoffroy Saussez,et al.  Rehabilitation of Motor Function after Stroke: A Multiple Systematic Review Focused on Techniques to Stimulate Upper Extremity Recovery , 2016, Front. Hum. Neurosci..

[46]  J. Desmond,et al.  Alcohol and the Cerebellum: Effects on Balance, Motor Coordination, and Cognition. , 1995 .

[47]  Jan Peters,et al.  Learning interaction for collaborative tasks with probabilistic movement primitives , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[48]  B. Borroni,et al.  Long term clinical and neurophysiological effects of cerebellar transcranial direct current stimulation in patients with neurodegenerative ataxia , 2017, Brain Stimulation.

[49]  R. Calabró,et al.  Effects of cerebellar transcranial alternating current stimulation on motor cortex excitability and motor function , 2017, Brain Structure and Function.

[50]  Thomas B. Schön,et al.  Using Inertial Sensors for Position and Orientation Estimation , 2017, Found. Trends Signal Process..

[51]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[52]  P. Veltink,et al.  Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Frank Chongwoo Park,et al.  Movement Primitives, Principal Component Analysis, and the Efficient Generation of Natural Motions , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[54]  Bernhard Schölkopf,et al.  Using probabilistic movement primitives for striking movements , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[55]  Etsuo Chosa,et al.  Efficacy of Inertial Measurement Units in the Evaluation of Trunk and Hand Kinematics in Baseball Hitting , 2020, Sensors.

[56]  Shraga Hocherman,et al.  Visuo-Motor Coordination Deficits and Motor Impairments in Parkinson's Disease , 2008, PloS one.

[57]  Hayley Thair,et al.  Transcranial Direct Current Stimulation (tDCS): A Beginner's Guide for Design and Implementation , 2017, Front. Neurosci..

[58]  Katsunori Shimohara,et al.  EMG pattern analysis and classification by neural network , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[59]  Min-Chun Pan,et al.  Lower-limb motion classification for hemiparetic patients through IMU and EMG signal processing , 2016, 2016 International Conference on Biomedical Engineering (BME-HUST).

[60]  K. Koh,et al.  Motion quality in rotator cuff tear using an inertial measurement unit: new parameters for dynamic motion assessment. , 2020, Journal of shoulder and elbow surgery.

[61]  M. Fillmore,et al.  Effects of energy drinks mixed with alcohol on information processing, motor coordination and subjective reports of intoxication. , 2012, Experimental and clinical psychopharmacology.

[62]  J. Mattingley,et al.  Applications of transcranial direct current stimulation for understanding brain function , 2014, Trends in Neurosciences.

[63]  E A Bullock,et al.  Post-stroke rehabilitation. , 1975, Royal Society of Health journal.