Electromyogram in Cigarette Smoking Activity Recognition

In this study, information from surface electromyogram (sEMG) signals was used to recognize cigarette smoking. The sEMG signals collected from lower arm were used in two different ways: (1) as an individual predictor of smoking activity and (2) as an additional sensor/modality along with the inertial measurement unit (IMU) to augment recognition performance. A convolutional and a recurrent neural network were utilized to recognize smoking-related hand gestures. The model was developed and evaluated with leave-one-subject-out (LOSO) cross-validation on a dataset from 16 subjects who performed ten activities of daily living including smoking. The results show that smoking detection using only sEMG signal achieved an F1-score of 75% in person-independent cross-validation. The combination of sEMG and IMU improved reached the F1-score of 84%, while IMU alone sensor modality was 81%. The study showed that using only sEMG signals would not provide superior cigarette smoking detection performance relative to IMU signals. However, sEMG improved smoking detection results when combined with IMU signals without using an additional device.

[1]  Donna B. Gilleskie,et al.  Smoking and Mortality: New Evidence from a Long Panel , 2018, International economic review.

[2]  Adrian D. C. Chan,et al.  Surface electromyographic signals using a dry electrode , 2011, 2010 IEEE International Workshop on Medical Measurements and Applications.

[3]  Hazel Doughty,et al.  StopWatch: The Preliminary Evaluation of a Smartwatch-Based System for Passive Detection of Cigarette Smoking , 2018, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[4]  Volkan Y. Senyurek,et al.  Performance Comparison of Artificial Neural Network and Gaussian Mixture Model in Classifying Hand Motions by Using sEMG Signals , 2013 .

[5]  Qiang Cheng,et al.  The Fisher-Markov Selector: Fast Selecting Maximally Separable Feature Subset for Multiclass Classification with Applications to High-Dimensional Data , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Fei-Fei Li,et al.  Visualizing and Understanding Recurrent Networks , 2015, ArXiv.

[7]  S. Akter,et al.  mHealth for Smoking Cessation Programs: A Systematic Review , 2014, Journal of personalized medicine.

[8]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[9]  Edward Sazonov,et al.  Smoking detection based on regularity analysis of hand to mouth gestures , 2019, Biomed. Signal Process. Control..

[10]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[11]  Changmok Choi,et al.  Real-time pinch force estimation by surface electromyography using an artificial neural network. , 2010, Medical engineering & physics.

[12]  Cho Y. Lam,et al.  The use of ambulatory assessment in smoking cessation. , 2018, Addictive behaviors.

[13]  Edward Sazonov,et al.  Cigarette Smoking Detection with an Inertial Sensor and a Smart Lighter , 2019, Sensors.

[14]  Edward Sazonov,et al.  Computation of Cigarette Smoke Exposure Metrics From Breathing , 2019, IEEE Transactions on Biomedical Engineering.

[15]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[16]  Yuan-Ting Zhang,et al.  A novel channel selection method for multiple motion classification using high-density electromyography , 2014, BioMedical Engineering OnLine.

[17]  Beth Jelfs,et al.  Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network , 2017, Front. Neurosci..

[18]  Matti Nykter,et al.  Predicting Gene Expression Levels from Histone Modification Signals with Convolutional Recurrent Neural Networks , 2017 .

[19]  Stephen T. Tiffany,et al.  Wearable Egocentric Camera as a Monitoring Tool of Free-living Cigarette Smoking: A Feasibility Study. , 2019, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[20]  Raul I. Ramos-Garcia,et al.  Development of a Multisensory Wearable System for Monitoring Cigarette Smoking Behavior in Free-Living Conditions , 2017, Electronics.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Mohan S. Kankanhalli,et al.  A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface , 2017, Pattern Recognit. Lett..

[23]  He Huang,et al.  An Analysis of EMG Electrode Configuration for Targeted Muscle Reinnervation Based Neural Machine Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  N. Nargis,et al.  Global economic cost of smoking-attributable diseases , 2017, Tobacco Control.

[25]  Bruno Cornelis,et al.  Deep Learning in EMG-based Gesture Recognition , 2018, PhyCS.

[26]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[27]  R. A. R. C. Gopuraa,et al.  A Study on Human Upper-Limb Muscles Activities during Daily Upper-Limb Motions , 2009 .

[28]  Ping Zhou,et al.  Decoding a new neural machine interface for control of artificial limbs. , 2007, Journal of neurophysiology.

[29]  Reuven Dar,et al.  Effect of Real-Time Monitoring and Notification of Smoking Episodes on Smoking Reduction: A Pilot Study of a Novel Smoking Cessation App , 2018, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[30]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[31]  Paolo Dario,et al.  Recognition of Daily Gestures with Wearable Inertial Rings and Bracelets , 2016, Sensors.

[32]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[34]  Hüseyin Selçuk Varol,et al.  A comparative study of denoising sEMG signals , 2015 .

[35]  Enzo Pasquale Scilingo,et al.  Comparative Evaluation of Susceptibility to Motion Artifact in Different Wearable Systems for Monitoring Respiratory Rate , 2010, IEEE Transactions on Information Technology in Biomedicine.

[36]  Dario Pompili,et al.  Laboratory Validation of Inertial Body Sensors to Detect Cigarette Smoking Arm Movements , 2014, Electronics.

[37]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..