Facial Expression Analysis for Estimating Pain in Clinical Settings

Pain assessment is vital for effective pain management in clinical settings. It is generally obtained via patient's self-report or observer's assessment. Both of these approaches suffer from several drawbacks such as unavailability of self-report, idiosyncratic use and observer bias. This work aims at developing automated machine learning based approaches for estimating pain in clinical settings. We propose to use facial expression information to accomplish current goals since previous studies have demonstrated consistency between facial behavior and experienced pain. Moreover, with recent advances in computer vision it is possible to design algorithms for identifying spontaneous expressions such as pain in more naturalistic conditions. Our focus is towards designing robust computer vision models for estimating pain in videos containing patient's facial behavior. In this regard we discuss different research problem, technical approaches and challenges that needs to be addressed. In this work we particularly highlight the problem of predicting self-report measures of pain intensity since this problem is not only more challenging but also received less attention. We also discuss our efforts towards collecting an in-situ pediatric pain dataset for validating these approaches. We conclude the paper by presenting some results on both UNBC Mc-Master Pain dataset and pediatric pain dataset.

[1]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[2]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[3]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sridha Sridharan,et al.  Improving pain recognition through better utilisation of temporal information , 2008, AVSP.

[5]  Arman Savran,et al.  Regression-based intensity estimation of facial action units , 2012, Image Vis. Comput..

[6]  Jeffrey F. Cohn,et al.  Painful data: The UNBC-McMaster shoulder pain expression archive database , 2011, Face and Gesture 2011.

[7]  K. Prkachin,et al.  Encoding and decoding of pain expressions: a judgement study , 1994, Pain.

[8]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[9]  P. Solomon,et al.  Congruence between health professionals' and patients' pain ratings: a review of the literature. , 2001, Scandinavian journal of caring sciences.

[10]  Maja Pantic,et al.  Continuous Pain Intensity Estimation from Facial Expressions , 2012, ISVC.

[11]  Marian Stewart Bartlett,et al.  Facial expression recognition using Gabor motion energy filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[12]  K. Prkachin,et al.  Racial differences in pain treatment and empathy in a Canadian sample. , 2012, Pain research & management.

[13]  M. Bartlett,et al.  Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions , 2014, Current Biology.

[14]  J. Stinson,et al.  Systematic review of the psychometric properties, interpretability and feasibility of self-report pain intensity measures for use in clinical trials in children and adolescents , 2006, Pain.

[15]  R. Howard,et al.  Current status of pain management in children. , 2003, JAMA.

[16]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[17]  Gwen Littlewort,et al.  The motion in emotion — A CERT based approach to the FERA emotion challenge , 2011, Face and Gesture 2011.

[18]  Kenneth D. Craig,et al.  The facial expression of pain Better than a thousand words , 1992 .

[19]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[20]  Jennifer N. Stinson,et al.  A Systematic Review of Faces Scales for the Self-report of Pain Intensity in Children , 2010, Pediatrics.

[21]  Vladimir Pavlovic,et al.  Automatic Pain Intensity Estimation with Heteroscedastic Conditional Ordinal Random Fields , 2013, ISVC.

[22]  Huaqiong Zhou,et al.  Association between self-report pain ratings of child and parent, child and nurse and parent and nurse dyads: meta-analysis. , 2008, Journal of advanced nursing.

[23]  W. David Leak,et al.  Handbook of Pain Assessment , 1994 .

[24]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  C. L. Baeyer,et al.  Systematic review of observational (behavioral) measures of pain for children and adolescents aged 3 to 18 years , 2007, Pain.

[26]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  Jennifer N Stinson,et al.  Measurement of self-reported pain intensity in children and adolescents. , 2010, Journal of psychosomatic research.

[28]  Marian Stewart Bartlett,et al.  Weakly supervised pain localization using multiple instance learning , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).