Assessment of Pain Using Facial Pictures Taken with a Smartphone

Timely and accurate information about patients' symptoms is important for clinical decision making such as adjustment of medication. Due to the limitations of self-reported symptom such as pain, we investigated whether facial images can be used for detecting pain level accurately using existing algorithms and infrastructure for cancer patients. For low cost and better pain management solution, we present a smart phone based system for pain expression recognition from facial images. To the best of our knowledge, this is the first study for mobile based chronic pain intensity detection. The proposed algorithms classify faces, represented as a weighted combination of Eigenfaces, using an angular distance, and support vector machines (SVMs). A pain score was assigned to each image by the subject. The study was done in two phases. In the first phase, data were collected as a part of a six month long longitudinal study in Bangladesh. In the second phase, pain images were collected for a cross-sectional study in three different countries: Bangladesh, Nepal and the United States. The study shows that a personalized model for pain assessment performs better for automatic pain assessment and the training set should contain varying levels of pain representing the application scenario.

[1]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[2]  K. Prkachin,et al.  The structure, reliability and validity of pain expression: Evidence from patients with shoulder pain , 2008, PAIN.

[3]  Christopher E. Hann,et al.  Measuring facial grimacing for quantifying patient agitation in critical care , 2007, Comput. Methods Programs Biomed..

[4]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[5]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  C. Cleeland,et al.  Pain assessment: global use of the Brief Pain Inventory. , 1994, Annals of the Academy of Medicine, Singapore.

[7]  K. Prkachin,et al.  Eigenimage Based Pain Expression Recognition , 2007 .

[8]  Eduardo Bruera,et al.  The Edmonton Symptom Assessment System (ESAS): A Simple Method for the Assessment of Palliative Care Patients , 1991, Journal of palliative care.

[9]  K. Prkachin Assessing pain by facial expression: facial expression as nexus. , 2009, Pain research & management.

[10]  P Novotny,et al.  Regular use of a verbal pain scale improves the understanding of oncology inpatient pain intensity. , 1994, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[11]  Sheikh Iqbal Ahamed,et al.  Findings of e-ESAS: a mobile based symptom monitoring system for breast cancer patients in rural Bangladesh , 2012, CHI.

[12]  K. Prkachin The consistency of facial expressions of pain: a comparison across modalities , 1992, Pain.

[13]  K. Craig,et al.  Acute and chronic low back pain: cognitive, affective, and behavioral dimensions. , 1994, Journal of consulting and clinical psychology.

[14]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[15]  S. Rezaei,et al.  Pain Recognition Using Artificial Neural Network , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[16]  Jeffrey F. Cohn,et al.  Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database , 2012, Image Vis. Comput..

[17]  Wassim M. Haddad,et al.  Relevance Vector Machine Learning for Neonate Pain Intensity Assessment Using Digital Imaging , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Loris Nanni,et al.  Introduction to Neonatal Facial Pain Detection Using Common and Advanced Face Classification Techniques , 2007, Advanced Computational Intelligence Paradigms in Healthcare.

[19]  S. Brahnam,et al.  Machine recognition and representation of neonatal facial displays of acute pain , 2006 .

[20]  Ayoub Al-Hamadi,et al.  Towards Pain Recognition in Post-Operative Phases Using 3D-based Features From Video and Support Vector Machines , 2009, J. Digit. Content Technol. its Appl..

[21]  Paul Dourish,et al.  How emotion is made and measured , 2007, Int. J. Hum. Comput. Stud..

[22]  K. Craig,et al.  Influencing non-verbal expressions of pain: Signal detection analyses , 1985, Pain.

[23]  R. Twycross,et al.  Pain in far-advanced cancer , 1982, Pain.

[24]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Ronald Melzack,et al.  Handbook of pain assessment , 1992 .

[26]  Siamak Rezaei,et al.  Appearance-based Pain Recognition from Video Sequences , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.