A Piezoresistive Array Armband With Reduced Number of Sensors for Hand Gesture Recognition

Human machine interfaces (HMIs) are employed in a broad range of applications, spanning from assistive devices for disability to remote manipulation and gaming controllers. In this study, a new piezoresistive sensors array armband is proposed for hand gesture recognition. The armband encloses only three sensors targeting specific forearm muscles, with the aim to discriminate eight hand movements. Each sensor is made by a force-sensitive resistor (FSR) with a dedicated mechanical coupler and is designed to sense muscle swelling during contraction. The armband is designed to be easily wearable and adjustable for any user and was tested on 10 volunteers. Hand gestures are classified by means of different machine learning algorithms, and classification performances are assessed applying both, the 10-fold and leave-one-out cross-validations. A linear support vector machine provided 96% mean accuracy across all participants. Ultimately, this classifier was implemented on an Arduino platform and allowed successful control for videogames in real-time. The low power consumption together with the high level of accuracy suggests the potential of this device for exergames commonly employed for neuromotor rehabilitation. The reduced number of sensors makes this HMI also suitable for hand-prosthesis control.

[1]  Andre van Schaik,et al.  Dry electrode bio-potential recordings , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[2]  Paolo Bifulco,et al.  Design and assessment of a low-cost, electromyographically controlled, prosthetic hand , 2013, Medical devices.

[3]  Cosimo Della Santina,et al.  DeepDynamicHand: A Deep Neural Architecture for Labeling Hand Manipulation Strategies in Video Sources Exploiting Temporal Information , 2018, Front. Neurorobot..

[4]  Yeongjin Kim,et al.  Design of an optical soft sensor for measuring fingertip force and contact recognition , 2017 .

[5]  Alessandro D’Ausilio,et al.  Arduino: A low-cost multipurpose lab equipment , 2011, Behavior Research Methods.

[6]  David A. Abbink,et al.  Feel-Good Robotics: Requirements on Touch for Embodiment in Assistive Robotics , 2018, Front. Neurorobot..

[7]  Carlo Menon,et al.  Exploration of Force Myography and surface Electromyography in hand gesture classification. , 2017, Medical engineering & physics.

[8]  P. Bifulco,et al.  A stretchable, conductive rubber sensor to detect muscle contraction for prosthetic hand control , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[9]  Erik Scheme,et al.  High-density force myography: A possible alternative for upper-limb prosthetic control. , 2016, Journal of rehabilitation research and development.

[10]  M. Eugeni,et al.  A Review on Mechanisms for Piezoelectric-Based Energy Harvesters , 2018, Energies.

[11]  Elisabetta Farella,et al.  Force Sensing Resistor and Evaluation of Technology for Wearable Body Pressure Sensing , 2016, J. Sensors.

[12]  Honghai Liu,et al.  Ultrasound-Based Sensing Models for Finger Motion Classification , 2018, IEEE Journal of Biomedical and Health Informatics.

[13]  Alexander Refsum Jensenius,et al.  Mumyo - evaluating and exploring the myo armband for musical interaction , 2015, NIME.

[14]  Riley Booth,et al.  A Wrist-Worn Piezoelectric Sensor Array for Gesture Input , 2018 .

[15]  P. Bifulco,et al.  A wearable device for recording of biopotentials and body movements , 2011, 2011 IEEE International Symposium on Medical Measurements and Applications.

[16]  Atau Tanaka,et al.  Understanding Gesture Expressivity through Muscle Sensing , 2015, ACM Trans. Comput. Hum. Interact..

[17]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[18]  G. Boy A Human-Centered Design Approach , 2017 .

[19]  Paolo Bifulco,et al.  Real-Time EMG Based Pattern Recognition Control for Hand Prostheses: A Review on Existing Methods, Challenges and Future Implementation , 2019, Sensors.

[20]  Peter B. Shull,et al.  Wrist-worn hand gesture recognition based on barometric pressure sensing , 2018, 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[21]  Paolo Bifulco,et al.  A Piezoresistive Sensor to Measure Muscle Contraction and Mechanomyography , 2018, Sensors.

[22]  Paolo Bifulco,et al.  Experimental Study to Improve “Federica” Prosthetic Hand and Its Control System , 2019, IFMBE Proceedings.

[23]  Richard Polfreman Hand posture recognition: IR, sEMG and IMU , 2018 .

[24]  Sandy Sajko Gray’s Anatomy for Student’s , 2006 .

[25]  Mithileysh Sathiyanarayanan,et al.  MYO Armband for physiotherapy healthcare: A case study using gesture recognition application , 2016, 2016 8th International Conference on Communication Systems and Networks (COMSNETS).

[26]  Zhijun Yang,et al.  Development of an EMG-Controlled Mobile Robot , 2018, Robotics.

[27]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[28]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[29]  Brendan O'Flynn,et al.  Hand Tracking and Gesture Recognition Using Lensless Smart Sensors , 2018, Sensors.

[30]  Pyeong-Gook Jung,et al.  A Wearable Gesture Recognition Device for Detecting Muscular Activities Based on Air-Pressure Sensors , 2015, IEEE Transactions on Industrial Informatics.

[31]  Antonio Krüger,et al.  EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing , 2016, CHI.

[32]  Paolo Bifulco,et al.  Study on the activation speed and the energy consumption of “federica” prosthetic hand , 2019 .

[33]  Paolo Bifulco,et al.  Towards Ultra Low-Cost Myoactivated Prostheses , 2018, BioMed research international.

[34]  Karl F. MacDorman,et al.  Review of constraints on vision-based gesture recognition for human-computer interaction , 2018, IET Comput. Vis..

[35]  Keum Shik Hong,et al.  Selectivity and Longevity of Peripheral-Nerve and Machine Interfaces: A Review , 2017, Front. Neurorobot..

[36]  Keum-Shik Hong,et al.  Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfaces , 2018, Front. Hum. Neurosci..

[37]  Minhua Ma,et al.  Serious games for movement therapy after stroke , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[38]  A. Villringer,et al.  No Overt Effects of a 6-Week Exergame Training on Sensorimotor and Cognitive Function in Older Adults. A Preliminary Investigation , 2017, Front. Hum. Neurosci..

[39]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[40]  Justus H. Piater,et al.  Learning Semantics of Gestural Instructions for Human-Robot Collaboration , 2018, Front. Neurorobot..