Multimodal Data Fusion for Person-Independent, Continuous Estimation of Pain Intensity

In this work, a method is presented for the continuous estimation of pain intensity based on fusion of bio-physiological and video features. The focus of the paper is to analyse which modalities and feature sets are suited best for the task of recognizing pain levels in a person-independent setting. A large set of features is extracted from the available bio-physiological channels (ECG, EMG and skin conductivity) and the video stream. Experimental validation demonstrates which modalities contribute the most to a robust prediction and the effects when combining them to improve the continuous estimation given unseen persons.

[1]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[2]  Jeffrey F. Cohn,et al.  Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database , 2012, Image Vis. Comput..

[3]  Maja Pantic,et al.  Continuous Pain Intensity Estimation from Facial Expressions , 2012, ISVC.

[4]  R. Treister,et al.  Differentiating between heat pain intensities: The combined effect of multiple autonomic parameters , 2012, PAIN®.

[5]  Ayoub Al-Hamadi,et al.  The biovid heat pain database data for the advancement and systematic validation of an automated pain recognition system , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[6]  Semyon Slobounov,et al.  Application of a novel measure of EEG non-stationarity as ‘Shannon- entropy of the peak frequency shifting’ for detecting residual abnormalities in concussed individuals , 2011, Clinical Neurophysiology.

[7]  Jeffrey F. Cohn,et al.  Painful data: The UNBC-McMaster shoulder pain expression archive database , 2011, Face and Gesture 2011.

[8]  Markus Kächele,et al.  Inferring Depression and Affect from Application Dependent Meta Knowledge , 2014, AVEC '14.

[9]  Gustavo Moreira da Silva,et al.  Automatic pain quantification using autonomic parameters , 2014 .

[10]  Weiting Chen,et al.  Measuring complexity using FuzzyEn, ApEn, and SampEn. , 2009, Medical engineering & physics.

[11]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[12]  Jeffrey F. Cohn,et al.  Automatic detection of pain intensity , 2012, ICMI '12.

[13]  Ayoub Al-Hamadi,et al.  Automatic Pain Recognition from Video and Biomedical Signals , 2014, 2014 22nd International Conference on Pattern Recognition.

[14]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[15]  Tanu Sharma,et al.  A novel feature extraction for robust EMG pattern recognition , 2016, Journal of medical engineering & technology.

[16]  M. Benedek,et al.  Decomposition of skin conductance data by means of nonnegative deconvolution , 2010, Psychophysiology.

[17]  Liqing Zhang,et al.  ECG Feature Extraction and Classification Using Wavelet Transform and Support Vector Machines , 2005, 2005 International Conference on Neural Networks and Brain.

[18]  Markus Kächele,et al.  Bio-Visual Fusion for Person-Independent Recognition of Pain Intensity , 2015, MCS.

[19]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.