Exploring Arm Posture and Temporal Variability in Myoelectric Hand Gesture Recognition

Hand gesture recognition based on myoelectric (EMG) signals is an innovative approach for the development of intuitive interaction devices, ranging from poliarticulated prosthetic hands to intuitive robot and mobile interfaces. Their study and development in controlled environments provides promising results, but effective real-world adoption is still limited due to reliability problems, such as motion artifacts and arm posture, temporal variability and issues caused by the re-positioning of sensors at each use. In this work, we present an EMG dataset collected with the aim to explore postural and temporal variability in the recognition of arm gestures. Its collection of gestures executed in 4 arm postures over 8 days allows to evaluate the impact of such variability on classification performance. We implemented and tested State-of-the-Art (SoA) recognition approaches analyzing the impact of different training strategies. Moreover, we compared the computational and memory requirements of the considered algorithms, providing an additional evaluation criteria useful for real-time implementation. Results show a decrease in the recognition of inter-posture and inter-day gestures up to 20%. The provided dataset will allow further exploration of such effects and the development of effective training and recognition strategies.

[1]  L. Benini,et al.  An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[2]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Domen Novak,et al.  Difficulty adaptation in a competitive arm rehabilitation game using real-time control of arm electromyogram and respiration , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[4]  Luca Benini,et al.  Analysis of Robust Implementation of an EMG Pattern Recognition based Control , 2014, BIOSIGNALS.

[5]  Barbara Caputo,et al.  Repeatability of grasp recognition for robotic hand prosthesis control based on sEMG data , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[6]  Heung-Il Suk,et al.  Position-Independent Decoding of Movement Intention for Proportional Myoelectric Interfaces , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[8]  Christian Cipriani,et al.  Comparative study of state-of-the-art myoelectric controllers for multigrasp prosthetic hands. , 2014, Journal of rehabilitation research and development.

[9]  Arto Visala,et al.  urrent state of digital signal processing in myoelectric interfaces and elated applications , 2015 .

[10]  Luca Benini,et al.  Power Line Interference Removal for High-Quality Continuous Biosignal Monitoring With Low-Power Wearable Devices , 2016, IEEE Sensors Journal.

[11]  Dario Farina,et al.  Long term stability of surface EMG pattern classification for prosthetic control , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Jindong Liu,et al.  Optimization of EMG movement recognition for use in an upper limb wearable robot , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[13]  Desney S. Tan,et al.  Making muscle-computer interfaces more practical , 2010, CHI.

[14]  Hao Jiang,et al.  MyoHMI: A low-cost and flexible platform for developing real-time human machine interface for myoelectric controlled applications , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Ilja Kuzborskij,et al.  Characterization of a Benchmark Database for Myoelectric Movement Classification , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Luca Benini,et al.  A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies , 2017, Sensors.

[17]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[18]  Fillia Makedon,et al.  Evaluation of a Low Cost EMG Sensor as a Modality for Use in Virtual Reality Applications , 2017, HCI.

[19]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[20]  Sethu Vijayakumar,et al.  Real-time classification of multi-modal sensory data for prosthetic hand control , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[21]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[22]  Luca Benini,et al.  Experimental evaluation of a sEMG-based human-robot interface for human-like grasping tasks , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[23]  Elisabetta Farella,et al.  Design challenges for wearable EMG applications , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[24]  Manfredo Atzori,et al.  Control Capabilities of Myoelectric Robotic Prostheses by Hand Amputees: A Scientific Research and Market Overview , 2015, Front. Syst. Neurosci..

[25]  Marco Platzner,et al.  Fluctuating emg signals: Investigating long-term effects of pattern matching algorithms , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[26]  Levi J. Hargrove,et al.  The effect of wrist position and hand-grasp pattern on virtual prosthesis task performance , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[27]  Kianoush Nazarpour,et al.  Combined influence of forearm orientation and muscular contraction on EMG pattern recognition , 2016, Expert Syst. Appl..