Foot Gesture Recognition Through Dual Channel Wearable EMG System

Surface electromyography (sEMG)-based hand gesture recognition (HGR) is finding its application as a general-purpose wearable human machine interface (HMI). However, the same is rarely explored for foot gesture recognition (FGR). The FGR is interesting as a hands-free controller, e.g. in case of an electric guitar player who controls the musical effects by foot pedals. Yet, the FGR is challenging, since general leg movements such as walking can be classified as foot gestures. In this paper, the application of a minimalistic sEMG wearable footband is demonstrated as a hands-free HMI. With only two channels and a support vector machine (SVM) classifier, the system is able to classify five foot gestures. In addition, we added a locking/unlocking mechanism and also controlled by one of the gestures, which eliminates undesired gesture classification during general leg movements. We show that the gesture-controlled locking feature is robust, and system does not unlock during walking, jumping, climbing the stairs, and similar. This paper covers the system design, the real-time classification algorithm, the selection of the target muscles, and experimental results. Sessions independence, accuracy, and robustness of the device are tested in a total of 18 sessions with three volunteers having different usage skills. As case study, the system was interfaced with a Window 10 application developed for controlling musical effects with the foot wearable band as a hands-free alternative for the DJ mixer equipment.

[1]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Alcimar Soares,et al.  The Development of a Virtual Myoelectric Prosthesis Controlled by an EMG Pattern Recognition System Based on Neural Networks , 2004, Journal of Intelligent Information Systems.

[3]  A. Stoica,et al.  Decoding static and dynamic arm and hand gestures from the JPL BioSleeve , 2013, 2013 IEEE Aerospace Conference.

[4]  C. Majidi,et al.  Reliable interfaces for EGaIn multi-layer stretchable circuits and microelectronics. , 2019, Lab on a chip.

[5]  A. d’Avella,et al.  EMG patterns during assisted walking in the exoskeleton , 2014, Front. Hum. Neurosci..

[6]  Ganesh R. Naik,et al.  Twin SVM for Gesture Classification Using the Surface Electromyogram , 2010, IEEE Transactions on Information Technology in Biomedicine.

[7]  Patrick van der Smagt,et al.  Learning EMG control of a robotic hand: towards active prostheses , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  C C Luzzio Controlling an Artificial Arm with Foot Movements , 2000, Neurorehabilitation and neural repair.

[9]  Russel Torah,et al.  A Smart Textile Based Facial EMG and EOG Computer Interface , 2014, IEEE Sensors Journal.

[10]  D. Winter,et al.  EMG profiles during normal human walking: stride-to-stride and inter-subject variability. , 1987, Electroencephalography and clinical neurophysiology.

[11]  Kenneth R. Lyons,et al.  ON CLASSIFICATION OF FOOT GESTURES VIA SURFACE ELECTROMYOGRAPHY , 2015 .

[12]  Carmel Majidi,et al.  Hydroprinted Electronics: Ultrathin Stretchable Ag-In-Ga E-Skin for Bioelectronics and Human-Machine Interaction. , 2018, ACS applied materials & interfaces.

[13]  Muhammad Haroon Yousaf,et al.  Adjustable Pedals by Gesture Recognition: A Novel Approach for User Interface in Automotive , 2012 .

[14]  Mahmoud Tavakoli,et al.  Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach , 2017, Expert Syst. Appl..

[15]  Linda Resnik,et al.  The DEKA Arm: Its features, functionality, and evolution during the Veterans Affairs Study to optimize the DEKA Arm , 2014, Prosthetics and orthotics international.

[16]  R. Jailani,et al.  Analysis of EMG signals of TA and GAS muscles during walking of Autism Spectrum Disorder (ASD) children , 2016, 2016 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[17]  Koichi Matsuda,et al.  Spectral-Distance-Based Detection of EMG Activity From Capacitive Measurements , 2018, IEEE Sensors Journal.

[18]  Carmel Majidi,et al.  EGaIn‐Assisted Room‐Temperature Sintering of Silver Nanoparticles for Stretchable, Inkjet‐Printed, Thin‐Film Electronics , 2018, Advanced materials.

[19]  Amit M. Joshi,et al.  Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application , 2018, IEEE Sensors Journal.

[20]  G. Mawston,et al.  Multi-Channel Surface Electromyography Electrodes: A Review , 2016, IEEE Sensors Journal.

[21]  G. Melchiorri,et al.  A method for positioning electrodes during surface EMG recordings in lower limb muscles , 2004, Journal of Neuroscience Methods.

[22]  Qingguo Li,et al.  Overground vs. treadmill walking on biomechanical energy harvesting: An energetics and EMG study. , 2017, Gait & posture.

[23]  Anibal T. de Almeida,et al.  Robust hand gesture recognition with a double channel surface EMG wearable armband and SVM classifier , 2018, Biomed. Signal Process. Control..

[24]  Myoungho Lee,et al.  Comparison of Conductive Fabric Electrode With Electromyography to Evaluate Knee Joint Movement , 2012, IEEE Sensors Journal.

[25]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[26]  J V Tu,et al.  Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. , 1996, Journal of clinical epidemiology.

[27]  Guido Bugmann,et al.  Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography , 2013, IEEE Journal of Biomedical and Health Informatics.

[28]  Hong Liu,et al.  EMG pattern recognition and grasping force estimation: Improvement to the myocontrol of multi-DOF prosthetic hands , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[30]  M.C. Carrozza,et al.  A Wearable Biomechatronic Interface for Controlling Robots with Voluntary Foot Movements , 2007, IEEE/ASME Transactions on Mechatronics.

[31]  Anibal T. de Almeida,et al.  Adaptive under-actuated anthropomorphic hand: ISR-SoftHand , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Linda Resnik,et al.  Controlling a multi-degree of freedom upper limb prosthesis using foot controls: user experience , 2014, Disability and rehabilitation. Assistive technology.