Exploring Deep Physiological Models for Nociceptive Pain Recognition

Standard feature engineering involves manually designing and assessing measurable descriptors based on some expert knowledge in the domain of application, followed by the selection of the best performing set of designed features in order to optimize an inference model. Several studies have shown that this whole manual process can be efficiently replaced by deep learning approaches which are characterized by the integration of feature engineering, feature selection and inference model optimization into a single learning process. Such techniques have proven to be very successful in the domain of image processing and have been able to attain state-of-the-art performances while significantly outperforming traditional approaches based on hand-crafted features. In the following work, we explore deep learning approaches for the analysis of physiological signals. More precisely, deep learning architectures are designed for the assessment of measurable physiological channels in order to perform an accurate classification of different levels of artificially induced nociceptive pain. Most of the previous works related to pain intensity classification based on physiological signals rely on a carefully designed set of hand-crafted features in order to achieve a relatively good classification performance. Therefore, the current work aims at building competitive pain intensity classification models without the need of domain specific expert knowledge for the generation of relevant features. The assessment of the designed deep learning architectures is based on the BioVid Heat Pain Database (Part A) and experimental validation demonstrates that the proposed uni-modal architecture for the electrodermal activity (EDA) and the deep fusion approaches significantly outperform previous classification methods reported in the literature, with respective average performances of 85.03% and 83.76% for the binary classification experiment consisting of the discrimination between the baseline level and the pain tolerance level (T0vs.T4) in a Leave-One-Subject-Out (LOSO) cross-validation evaluation setting.

[1]  Junmo Kim,et al.  Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Ayoub Al-Hamadi,et al.  The biovid heat pain database data for the advancement and systematic validation of an automated pain recognition system , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[3]  François Chollet,et al.  Keras: The Python Deep Learning library , 2018 .

[4]  Beth Jelfs,et al.  Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network , 2017, Front. Neurosci..

[5]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[6]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[7]  Xiang Li,et al.  Hand Gesture Recognition Based on Deep Learning Method , 2018, 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC).

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Ayoub Al-Hamadi,et al.  Automatic Pain Recognition from Video and Biomedical Signals , 2014, 2014 22nd International Conference on Pattern Recognition.

[14]  H. Traue,et al.  Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector Machines , 2015, PloS one.

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  Afnizanfaizal Abdullah,et al.  A Review of Deep Learning Architectures and Their Application , 2017, AsiaSim 2017.

[17]  Marta R. Costa-jussà,et al.  From Feature To Paradigm: Deep Learning In Machine Translation , 2018, J. Artif. Intell. Res..

[18]  Mohammad I. Daoud,et al.  Tonic Cold Pain Detection Using Choi–Williams Time-Frequency Distribution Analysis of EEG Signals: A Feasibility Study , 2019, Applied Sciences.

[19]  Patrick Thiam,et al.  Pain recognition with camera photoplethysmography , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Patrick Thiam,et al.  Methods for Person-Centered Continuous Pain Intensity Assessment From Bio-Physiological Channels , 2016, IEEE Journal of Selected Topics in Signal Processing.

[22]  Enas Abdulhay,et al.  Using Deep Convolutional Neural Network for Emotion Detection on a Physiological Signals Dataset (AMIGOS) , 2019, IEEE Access.

[23]  Shafishuhaza Sahlan,et al.  Modeling, Design and Simulation of Systems , 2017, Communications in Computer and Information Science.

[24]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[25]  Yoshua Bengio,et al.  Learning deep physiological models of affect , 2013, IEEE Computational Intelligence Magazine.

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Shigeo Abe Support Vector Machines for Pattern Classification , 2010, Advances in Pattern Recognition.

[28]  Patrick Thiam,et al.  The SenseEmotion Database: A Multimodal Database for the Development and Systematic Validation of an Automatic Pain- and Emotion-Recognition System , 2016, MPRSS.

[29]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[31]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[32]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[33]  Patrick Thiam,et al.  Multi-classifier-Systems: Architectures, Algorithms and Applications , 2018 .

[34]  Kamal Nasrollahi,et al.  Deep Pain: Exploiting Long Short-Term Memory Networks for Facial Expression Classification , 2017, IEEE Transactions on Cybernetics.

[35]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[36]  B Pyakillya,et al.  Deep Learning for ECG Classification , 2017 .

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Patrick Thiam,et al.  Multi-Modal Pain Intensity Recognition Based on the SenseEmotion Database , 2019, IEEE Transactions on Affective Computing.

[39]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[40]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[41]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[42]  Gustavo Moreira da Silva,et al.  Automatic pain quantification using autonomic parameters , 2014 .

[43]  Martin J. Wainwright,et al.  Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions , 2011, ICML.

[44]  L. Levin,et al.  Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps , 2015, PloS one.

[45]  Sun K. Yoo,et al.  A Deep Neural Network-Based Pain Classifier Using a Photoplethysmography Signal , 2019, Sensors.

[46]  Gordon Cheng,et al.  Validating Deep Neural Networks for Online Decoding of Motor Imagery Movements from EEG Signals , 2018, Sensors.

[47]  Rosalind W. Picard,et al.  Continuous Pain Intensity Estimation from Autonomic Signals with Recurrent Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[48]  Björn W. Schuller,et al.  Deep Learning for Environmentally Robust Speech Recognition , 2017, ACM Trans. Intell. Syst. Technol..

[49]  Patrick Thiam,et al.  Multimodal Data Fusion for Person-Independent, Continuous Estimation of Pain Intensity , 2015, EANN.

[50]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[51]  Patrick Thiam,et al.  Adaptive confidence learning for the personalization of pain intensity estimation systems , 2017, Evol. Syst..

[52]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  S. Salanterä,et al.  Acute pain intensity monitoring with the classification of multiple physiological parameters , 2018, Journal of clinical monitoring and computing.

[54]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[55]  Markus Kächele,et al.  Bio-Visual Fusion for Person-Independent Recognition of Pain Intensity , 2015, MCS.

[56]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[57]  Peng Song,et al.  A Joint Convolutional Bidirectional LSTM Framework for Facial Expression Recognition , 2018, IEICE Trans. Inf. Syst..

[58]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[59]  Patrick Thiam,et al.  Multi-modal data fusion for pain intensity assessment and classification , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[60]  Eman M. G. Younis,et al.  Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detection , 2019, Inf. Fusion.

[61]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[62]  Ayoub Al-Hamadi,et al.  Automatic Pain Assessment with Facial Activity Descriptors , 2017, IEEE Transactions on Affective Computing.

[63]  James H. Garrett,et al.  Engineering applications of neural networks , 1993, J. Intell. Manuf..

[64]  Thomas M. Deserno,et al.  Deep Learning on 1-D Biosignals: a Taxonomy-based Survey , 2018, Yearbook of Medical Informatics.