Forearm Motion Recognition With Noncontact Capacitive Sensing

This study presents a noncontact capacitive sensing method for forearm motion recognition. A method is proposed to record upper limb motion information from muscle contractions without contact with human skin, compensating for the limitations of existing sEMG-based methods. The sensing front-ends are designed based on human forearm shapes, and the forearm limb shape changes caused by muscle contractions will be represented by capacitance signals. After implementation of the capacitive sensing system, experiments on healthy subjects are conducted to evaluate the effectiveness. Nine motion patterns combined with 16 motion transitions are investigated on seven participants. We also designed an automatic data labeling method based on inertial signals from the measured hand, which greatly accelerated the training procedure. With the capacitive sensing system and the designed recognition algorithm, the method produced an average recognition of over 92%. Correct decisions could be made with approximately a 347-ms delay from the relaxed state to the time point of motion initiation. The confounding factors that affect the performances are also analyzed, including the sliding window length, the motion types and the external disturbances. We found the average accuracy increased to 98.7% when five motion patterns were recognized. The results of the study proved the feasibility and revealed the problems of the noncontact capacitive sensing approach on upper-limb motion sensing and recognition. Future efforts in this direction could be worthwhile for achieving more promising outcomes.

[1]  Robert Riener,et al.  A survey of sensor fusion methods in wearable robotics , 2015, Robotics Auton. Syst..

[2]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Guangquan Zhou,et al.  Human motion analysis with sonomyography , 2016 .

[4]  Barbara Caputo,et al.  Stable myoelectric control of a hand prosthesis using non-linear incremental learning , 2014, Front. Neurorobot..

[5]  Aude Billard,et al.  Learning from Humans , 2016, Springer Handbook of Robotics, 2nd Ed..

[6]  Qinghua Huang,et al.  Continuous Monitoring of Sonomyography, Electromyography and Torque Generated by Normal Upper Arm Muscles During Isometric Contraction: Sonomyography Assessment for Arm Muscles , 2008, IEEE Transactions on Biomedical Engineering.

[7]  Ilja Kuzborskij,et al.  Characterization of a Benchmark Database for Myoelectric Movement Classification , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  L J Hargrove,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[10]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[11]  Junsong Yuan,et al.  Context Aware Human-Robot and Human-Agent Interaction , 2015, Human–Computer Interaction Series.

[12]  Long Wang,et al.  A Noncontact Capacitive Sensing System for Recognizing Locomotion Modes of Transtibial Amputees , 2014, IEEE Transactions on Biomedical Engineering.

[13]  Robinson Jimenez Moreno,et al.  Individual Robotic Arms Manipulator Control Employing Electromyographic Signals Acquired by Myo Armbands , 2016 .

[14]  Andrea Parri,et al.  Gait Phase Estimation Based on Noncontact Capacitive Sensing and Adaptive Oscillators , 2017, IEEE Transactions on Biomedical Engineering.

[15]  Dario Farina,et al.  High-Density Electromyography and Motor Skill Learning for Robust Long-Term Control of a 7-DoF Robot Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Gilbert Tang The development of a human-robot interface for industrial collaborative system , 2016 .

[17]  Enhao Zheng,et al.  Noncontact Capacitive Sensing-Based Locomotion Transition Recognition for Amputees With Robotic Transtibial Prostheses , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Jose L Pons,et al.  Wearable Robots: Biomechatronic Exoskeletons , 2008 .

[19]  T.C. Lueth,et al.  Intelligent recognition system for hand gestures , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[20]  C. Castellini,et al.  Using Ultrasound Images of the Forearm to Predict Finger Positions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  J.W. Sensinger,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Alessandra Pedrocchi,et al.  Robustness and Reliability of Synergy-Based Myocontrol of a Multiple Degree of Freedom Robotic Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[24]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[25]  Kianoush Nazarpour,et al.  Combined influence of forearm orientation and muscular contraction on EMG pattern recognition , 2016, Expert Syst. Appl..

[26]  Beth Jelfs,et al.  Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network , 2017, Front. Neurosci..

[27]  David A. Winter,et al.  Biomechanics and Motor Control of Human Movement , 1990 .

[28]  Koh Hosoda,et al.  Surface EMG based posture control of shoulder complex linkage mechanism , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Levi J Hargrove,et al.  A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure , 2014, Journal of NeuroEngineering and Rehabilitation.

[30]  Panagiotis K. Artemiadis,et al.  A Learning Scheme for Reach to Grasp Movements: On EMG-Based Interfaces Using Task Specific Motion Decoding Models , 2013, IEEE Journal of Biomedical and Health Informatics.

[31]  Enhao Zheng,et al.  A Preliminary Study of Upper-Limb Motion Recognition with Noncontact Capacitive Sensing , 2017, ICIRA.