Automatic Subject Independent Pain Intensity Estimation using a Deep Learning Approach

The notion of pain covers a multitude of distinct sensorial experiences that serve as a warning system to the human subject. Pain management is crucial because an untreated or intense pain can subdue the nervous system and the entire emotional universe of the suffering patient. In this paper we propose an automatic pain assistance solution, a visual recognition system for pain intensity estimation that targets patients unable to communicate that they are in pain. We trained from scratch a ResNet model on the BioVid Heat Pain data set, with different selections of hyper-parameters and data augmentation and we evaluated the results. We also analyzed the impact of constraining the test and train data sets with regards to using images of the same subject for both the train and the test sets comparing with the scenario where the images of a subject are used solely for testing or for training sets. The selection of parameters is of central importance in building a robust classifier that generalizes and led us to state of the art results in the context of the complex pain intensity estimation task on the BioVid Heat Pain data set.

[1]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[2]  M. Berger,et al.  Pain in elderly people with severe dementia: A systematic review of behavioural pain assessment tools , 2006, BMC geriatrics.

[3]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[4]  Jeffrey F. Cohn,et al.  Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database , 2012, Image Vis. Comput..

[5]  K. Prkachin,et al.  The structure, reliability and validity of pain expression: Evidence from patients with shoulder pain , 2008, PAIN.

[6]  Rosalind W. Picard,et al.  Automatic Recognition Methods Supporting Pain Assessment: A Survey , 2019, IEEE Transactions on Affective Computing.

[7]  Ayoub Al-Hamadi,et al.  Automatic Pain Assessment with Facial Activity Descriptors , 2017, IEEE Transactions on Affective Computing.

[8]  Jeffrey Soar,et al.  Enhanced deep learning algorithm development to detect pain intensity from facial expression images , 2020, Expert Syst. Appl..

[9]  Ayoub Al-Hamadi,et al.  The biovid heat pain database data for the advancement and systematic validation of an automated pain recognition system , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[10]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  L. Zeltzer,et al.  Pediatric pain: interacting behavioral and physical factors. , 1992, Pediatrics.

[13]  M. Boswell,et al.  Weiner's Pain Management : A Practical Guide for Clinicians , 2005 .

[14]  S. A. Khonsary.  Guyton and Hall: Textbook of Medical Physiology , 2017, Surgical Neurology International.

[15]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.