Automated Assessment of Children’s Postoperative Pain Using Computer Vision

BACKGROUND: Current pain assessment methods in youth are suboptimal and vulnerable to bias and underrecognition of clinical pain. Facial expressions are a sensitive, specific biomarker of the presence and severity of pain, and computer vision (CV) and machine-learning (ML) techniques enable reliable, valid measurement of pain-related facial expressions from video. We developed and evaluated a CVML approach to measure pain-related facial expressions for automated pain assessment in youth. METHODS: A CVML-based model for assessment of pediatric postoperative pain was developed from videos of 50 neurotypical youth 5 to 18 years old in both endogenous/ongoing and exogenous/transient pain conditions after laparoscopic appendectomy. Model accuracy was assessed for self-reported pain ratings in children and time since surgery, and compared with by-proxy parent and nurse estimates of observed pain in youth. RESULTS: Model detection of pain versus no-pain demonstrated good-to-excellent accuracy (Area under the receiver operating characteristic curve 0.84–0.94) in both ongoing and transient pain conditions. Model detection of pain severity demonstrated moderate-to-strong correlations (r = 0.65–0.86 within; r = 0.47–0.61 across subjects) for both pain conditions. The model performed equivalently to nurses but not as well as parents in detecting pain versus no-pain conditions, but performed equivalently to parents in estimating pain severity. Nurses were more likely than the model to underestimate youth self-reported pain ratings. Demographic factors did not affect model performance. CONCLUSIONS: CVML pain assessment models derived from automatic facial expression measurements demonstrated good-to-excellent accuracy in binary pain classifications, strong correlations with patient self-reported pain ratings, and parent-equivalent estimation of children’s pain levels over typical pain trajectories in youth after appendectomy.

[1]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[2]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[3]  R. Melzack,et al.  Self-mutilation after dorsal rhizotomy in rats: Effects of prior pain and pattern of root lesions , 1979, Experimental Neurology.

[4]  Richard Grossman,et al.  The animals , 1983 .

[5]  Richard Taylor Interpretation of the Correlation Coefficient: A Basic Review , 1990 .

[6]  H. Kehlet,et al.  Pain sensation and nociceptive reflex excitability in surgical patients and human volunteers. , 1992, British journal of anaesthesia.

[7]  K. Craig,et al.  Appearance-based information about coping with pain: valid or biased? , 1995, Social science & medicine.

[8]  Y. Heloury,et al.  Randomized, single-blinded trial of laparoscopic versus open appendectomy in children: effects on postoperative analgesia. , 1996 .

[9]  Y. Heloury,et al.  Randomized, Single-blinded Trial of Laparoscopic Versus Open Appendectomy in Children: Effects on Postoperative Analgesia , 1996, Anesthesiology.

[10]  K. Craig,et al.  Agreement between child and parent reports of pain. , 1998, The Clinical journal of pain.

[11]  T. Sejnowski,et al.  Measuring facial expressions by computer image analysis. , 1999, Psychophysiology.

[12]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[13]  E. Horcher,et al.  Open versus Laparoscopic Appendectomy in Children: A Comparison of Complications , 2000, JSLS : Journal of the Society of Laparoendoscopic Surgeons.

[14]  E. Goldson,et al.  The assessment and management of acute pain in infants, children, and adolescents. , 2001, Pediatrics.

[15]  E. Goldson,et al.  American Academy of Pediatrics American Pain Society the Assessment and Management of Acute Pain in Infants, Children, and Adolescents , 2022 .

[16]  M. Hodgins Interpreting the meaning of pain severity scores. , 2002, Pain research & management.

[17]  Amanda C.C. Williams,et al.  Facial expression of pain: An evolutionary account , 2002, Behavioral and Brain Sciences.

[18]  A. Singer,et al.  Parents and practitioners are poor judges of young children's pain severity. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[19]  Kathleen Puntillo,et al.  Accuracy of emergency nurses in assessment of patients' pain. , 2003, Pain management nursing : official journal of the American Society of Pain Management Nurses.

[20]  Miriam Kunz,et al.  On the relationship between self-report and facial expression of pain. , 2004, The journal of pain : official journal of the American Pain Society.

[21]  J. Mogil,et al.  What should we be measuring in behavioral studies of chronic pain in animals? , 2004, Pain.

[22]  K. Prkachin,et al.  Testing two accounts of pain underestimation , 2006, Pain.

[23]  K. Craig,et al.  Genuine, suppressed and faked facial expressions of pain in children , 2006, Pain.

[24]  M. Kunz,et al.  The facial expression of pain in patients with dementia , 2007, Pain.

[25]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[26]  Huaqiong Zhou,et al.  Association between self-report pain ratings of child and parent, child and nurse and parent and nurse dyads: meta-analysis. , 2008, Journal of advanced nursing.

[27]  M. Duignan,et al.  Congruence of pain assessment between nurses and emergency department patients: a replication. , 2008, International emergency nursing.

[28]  K. Weiss,et al.  Evidence-based assessment of pediatric pain. , 2008, Journal of pediatric psychology.

[29]  G. Braitberg,et al.  Paediatric pain assessment: Differences between triage nurse, child and parent , 2009, Journal of paediatrics and child health.

[30]  C. L. Baeyer,et al.  Three new datasets supporting use of the Numerical Rating Scale (NRS-11) for children’s self-reports of pain intensity , 2009, PAIN®.

[31]  John T Chibnall,et al.  Provider judgments of patients in pain: seeking symptom certainty. , 2009, Pain medicine.

[32]  D. Bluemke,et al.  Relationship of temporal resolution to diagnostic performance for dynamic contrast enhanced MRI of the breast , 2009, Journal of magnetic resonance imaging : JMRI.

[33]  K. Craig,et al.  Pain Assessment as a Social Transaction: Beyond the “Gold Standard” , 2010, The Clinical journal of pain.

[34]  Jose Alvir,et al.  How do changes in pain severity levels correspond to changes in health status and function in patients with painful diabetic peripheral neuropathy? , 2010, PAIN®.

[35]  P. McGrath,et al.  Pain as the neglected adverse event , 2010, Canadian Medical Association Journal.

[36]  Sridha Sridharan,et al.  Automatically Detecting Pain in Video Through Facial Action Units , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  G. Crombez,et al.  When you dislike patients, pain is taken less seriously , 2011, PAIN®.

[38]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[39]  I. Gilron,et al.  Systematic review of movement-evoked pain versus pain at rest in postsurgical clinical trials and meta-analyses: A fundamental distinction requiring standardized measurement , 2011, PAIN®.

[40]  P. McGrath,et al.  When does pain matter? Acknowledging the subjectivity of clinical significance , 2012, PAIN®.

[41]  P. Parker Systematic review of movement-evoked pain versus pain at rest in postsurgical clinical trials and meta-analyses: A fundamental distinction requiring standardized measurement , 2012, PAIN.

[42]  G. Bennett,et al.  What is spontaneous pain and who has it? , 2012, The journal of pain : official journal of the American Pain Society.

[43]  G. Crombez,et al.  Impact of being primed with social deception upon observer responses to others’ pain , 2013, PAIN.

[44]  P. Tighe,et al.  The evolution and practice of acute pain medicine. , 2013, Pain medicine.

[45]  Ronald J. Pelias,et al.  Intensity , 1973, Definitions.

[46]  B. Dick,et al.  Post-surgical pain syndromes: a review for the non-pain specialist , 2014, Canadian Journal of Anesthesia/Journal canadien d'anesthésie.

[47]  J. Chibnall,et al.  Racial/ethnic disparities in the assessment and treatment of pain: psychosocial perspectives. , 2014, The American psychologist.

[48]  M. Bartlett,et al.  Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions , 2014, Current Biology.

[49]  K. Craig,et al.  Health care professionals' reactions to patient pain: impact of knowledge about medical evidence and psychosocial influences. , 2014, The journal of pain : official journal of the American Pain Society.

[50]  Y. Miyauchi,et al.  Comparison of postoperative pain between single‐incision and conventional laparoscopic appendectomy in children , 2014, Asian journal of endoscopic surgery.

[51]  K. Craig,et al.  Pain Assessment in Children: Validity of Facial Expression Items in Observational Pain Scales , 2015, The Clinical journal of pain.