Exploring Deep Physiological Models for Nociceptive Pain Recognition

Standard feature engineering involves manually designing measurable descriptors based on some expert knowledge in the domain of application, followed by the selection of the best performing set of designed features for the subsequent optimisation of an inference model. Several studies have shown that this whole manual process can be efficiently replaced by deep learning approaches which are characterised by the integration of feature engineering, feature selection and inference model optimisation into a single learning process. In the following work, deep learning architectures are designed for the assessment of measurable physiological channels in order to perform an accurate classification of different levels of artificially induced nociceptive pain. In contrast to previous works, which rely on carefully designed sets of hand-crafted features, the current work aims at building competitive pain intensity inference models through autonomous feature learning, based on deep neural networks. The assessment of the designed deep learning architectures is based on the BioVid Heat Pain Database (Part A) and experimental validation demonstrates that the proposed uni-modal architecture for the electrodermal activity (EDA) and the deep fusion approaches significantly outperform previous methods reported in the literature, with respective average performances of 84.57% and 84.40% for the binary classification experiment consisting of the discrimination between the baseline and the pain tolerance level (T0 vs. T4) in a Leave-One-Subject-Out (LOSO) cross-validation evaluation setting. Moreover, the experimental results clearly show the relevance of the proposed approaches, which also offer more flexibility in the case of transfer learning due to the modular nature of deep neural networks.

[1]  James H. Garrett,et al.  Engineering applications of neural networks , 1993, J. Intell. Manuf..

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[4]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[7]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[8]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yoshua Bengio,et al.  Learning deep physiological models of affect , 2013, IEEE Computational Intelligence Magazine.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Gustavo Moreira da Silva,et al.  Automatic pain quantification using autonomic parameters , 2014 .

[12]  H. Traue,et al.  Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector Machines , 2015, PloS one.

[13]  Markus Kächele,et al.  Bio-Visual Fusion for Person-Independent Recognition of Pain Intensity , 2015, MCS.

[14]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[15]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[16]  Patrick Thiam,et al.  Methods for Person-Centered Continuous Pain Intensity Assessment From Bio-Physiological Channels , 2016, IEEE Journal of Selected Topics in Signal Processing.

[17]  Patrick Thiam,et al.  The SenseEmotion Database: A Multimodal Database for the Development and Systematic Validation of an Automatic Pain- and Emotion-Recognition System , 2016, MPRSS.

[18]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[19]  Kamal Nasrollahi,et al.  Deep Pain: Exploiting Long Short-Term Memory Networks for Facial Expression Classification , 2017, IEEE Transactions on Cybernetics.

[20]  B Pyakillya,et al.  Deep Learning for ECG Classification , 2017 .

[21]  Afnizanfaizal Abdullah,et al.  A Review of Deep Learning Architectures and Their Application , 2017, AsiaSim 2017.

[22]  Patrick Thiam,et al.  Adaptive confidence learning for the personalization of pain intensity estimation systems , 2017, Evol. Syst..

[23]  Beth Jelfs,et al.  Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network , 2017, Front. Neurosci..

[24]  Ayoub Al-Hamadi,et al.  Automatic Pain Assessment with Facial Activity Descriptors , 2017, IEEE Transactions on Affective Computing.

[25]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[26]  Marta R. Costa-jussà,et al.  From Feature To Paradigm: Deep Learning In Machine Translation , 2018, J. Artif. Intell. Res..

[27]  Thomas M. Deserno,et al.  Deep Learning on 1-D Biosignals: a Taxonomy-based Survey , 2018, Yearbook of Medical Informatics.

[28]  Björn W. Schuller,et al.  Deep Learning for Environmentally Robust Speech Recognition , 2017, ACM Trans. Intell. Syst. Technol..

[29]  S. Salanterä,et al.  Acute pain intensity monitoring with the classification of multiple physiological parameters , 2018, Journal of clinical monitoring and computing.

[30]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[31]  Peng Song,et al.  A Joint Convolutional Bidirectional LSTM Framework for Facial Expression Recognition , 2018, IEICE Trans. Inf. Syst..

[32]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[33]  Sun K. Yoo,et al.  A Deep Neural Network-Based Pain Classifier Using a Photoplethysmography Signal , 2019, Sensors.

[34]  Enas Abdulhay,et al.  Using Deep Convolutional Neural Network for Emotion Detection on a Physiological Signals Dataset (AMIGOS) , 2019, IEEE Access.

[35]  Eman M. G. Younis,et al.  Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detection , 2019, Inf. Fusion.

[36]  Gordon Cheng,et al.  Validating Deep Neural Networks for Online Decoding of Motor Imagery Movements from EEG Signals , 2018, Sensors.

[37]  Mohammad I. Daoud,et al.  Tonic Cold Pain Detection Using Choi–Williams Time-Frequency Distribution Analysis of EEG Signals: A Feasibility Study , 2019, Applied Sciences.

[38]  Patrick Thiam,et al.  Multi-Modal Pain Intensity Recognition Based on the SenseEmotion Database , 2019, IEEE Transactions on Affective Computing.