EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing

Practical wearable gesture tracking requires that sensors align with existing ergonomic device forms. We show that combining EMG and pressure data sensed only at the wrist can support accurate classification of hand gestures. A pilot study with unintended EMG electrode pressure variability led to exploration of the approach in greater depth. The EMPress technique senses both finger movements and rotations around the wrist and forearm, covering a wide range of gestures, with an overall 10-fold cross validation classification accuracy of 96%. We show that EMG is especially suited to sensing finger movements, that pressure is suited to sensing wrist and forearm rotations, and their combination is significantly more accurate for a range of gestures than either technique alone. The technique is well suited to existing wearable device forms such as smart watches that are already mounted on the wrist.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  P H Chappell,et al.  Surface EMG pattern analysis of the wrist muscles at different speeds of contraction , 2009, Journal of medical engineering & technology.

[3]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[4]  Kongqiao Wang,et al.  Hand Gesture Recognition Research Based on Surface EMG Sensors and 2D-accelerometers , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[5]  Antonio Krüger,et al.  Same-side Hand Interactions with Arm-placed Devices Using EMG , 2015, CHI Extended Abstracts.

[6]  Ahmet Alkan,et al.  Identification of EMG signals using discriminant analysis and SVM classifier , 2012, Expert Syst. Appl..

[7]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[8]  Yong Gyu Lim,et al.  Conductive Polymer Foam Surface Improves the Performance of a Capacitive EEG Electrode , 2012, IEEE Transactions on Biomedical Engineering.

[9]  Joseph A. Paradiso,et al.  WristFlex: low-power gesture input with wrist-worn pressure sensors , 2014, UIST.

[10]  A. Stoica,et al.  Decoding static and dynamic arm and hand gestures from the JPL BioSleeve , 2013, 2013 IEEE Aerospace Conference.

[11]  Marco Paleari,et al.  Quantifying Forearm Muscle Activity during Wrist and Finger Movements by Means of Multi-Channel Electromyography , 2014, PloS one.

[12]  Jie Liu,et al.  An energy harvesting wearable ring platform for gestureinput on surfaces , 2014, MobiSys.

[13]  Tanja Schultz,et al.  Advancing Muscle-Computer Interfaces with High-Density Electromyography , 2015, CHI.

[14]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[15]  Yong Zhu,et al.  Wearable silver nanowire dry electrodes for electrophysiological sensing , 2015 .

[16]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.