Automatic Infants’ Pain Assessment by Dynamic Facial Representation: Effects of Profile View, Gestational Age, Gender, and Race

Infants’ early exposure to painful procedures can have negative short and long-term effects on cognitive, neurological, and brain development. However, infants cannot express their subjective pain experience, as they do not communicate in any language. Facial expression is the most specific pain indicator, which has been effectively employed for automatic pain recognition. In this paper, dynamic pain facial expression representation and fusion scheme for automatic pain assessment in infants is proposed by combining temporal appearance facial features and temporal geometric facial features. We investigate the effects of various factors that influence pain reactivity in infants, such as individual variables of gestational age, gender, and race. Different automatic infant pain assessment models are constructed, depending on influence factors as well as facial profile view, which affect the model ability of pain recognition. It can be concluded that the profile-based infant pain assessment is feasible, as its performance is almost as good as that of the whole face. Moreover, gestational age is the most influencing factor for pain assessment, and it is necessary to construct specific models depending on it. This is mainly because of a lack of behavioral communication ability in infants with low gestational age, due to limited neurological development. To our best knowledge, this is the first study investigating infants’ pain recognition, highlighting profile facial views and various individual variables.

[1]  Karan Sikka,et al.  Facial Expression Analysis for Estimating Pain in Clinical Settings , 2014, ICMI.

[2]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[3]  Lorenzo Fabrizi,et al.  Premature infants display increased noxious-evoked neuronal activity in the brain compared to healthy age-matched term-born infants , 2010, NeuroImage.

[4]  M. Dehan,et al.  Development and initial validation of the EDIN scale, a new tool for assessing prolonged pain in preterm infants , 2001, Archives of disease in childhood. Fetal and neonatal edition.

[5]  Peter H. N. de With,et al.  Video-based facial discomfort analysis for infants , 2014, Electronic Imaging.

[6]  K. Prkachin,et al.  Encoding and decoding of pain expressions: a judgement study , 1994, Pain.

[7]  K. Craig,et al.  Understanding caregiver judgments of infant pain: contrasts of parents, nurses and pediatricians. , 2008, Pain research & management.

[8]  Ayoub Al-Hamadi,et al.  Towards Pain Monitoring: Facial Expression, Head Pose, a new Database, an Automatic System and Remaining , 2013, BMVC.

[9]  A. Tannenbaum,et al.  Agitation and pain assessment using digital imaging , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  J. Medves,et al.  A SYSTEMATIC INTEGRATIVE REVIEW OF INFANT PAIN ASSESSMENT TOOLS , 2004, Advances in neonatal care : official journal of the National Association of Neonatal Nurses.

[11]  Yu Sun,et al.  Automated Pain Assessment in Neonates , 2017, SCIA.

[12]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[14]  Jeffrey F. Cohn,et al.  Detecting Depression Severity from Vocal Prosody , 2013, IEEE Transactions on Affective Computing.

[15]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Liisa Holsti,et al.  Bedside application of the Neonatal Facial Coding System in pain assessment of premature infants , 1998, Pain.

[17]  Shaoping Zhu,et al.  Pain Expression Recognition Based on pLSA Model , 2014, TheScientificWorldJournal.

[18]  Robert C. Coghill,et al.  Neural correlates of interindividual differences in the subjective experience of pain , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[19]  M. Bartlett,et al.  Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions , 2014, Current Biology.

[20]  J. Beyene,et al.  Determining behavioural and physiological responses to pain in infants at risk for neurological impairment , 2007, Pain.

[21]  Liisa Holsti,et al.  Specific Newborn Individualized Developmental Care and Assessment Program movements are associated with acute pain in preterm infants in the neonatal intensive care unit. , 2004, Pediatrics.

[22]  J Shermina Application of Locality Preserving Projections in Face Recognition , 2010 .

[23]  C. Celeste Johnston,et al.  Acute pain response in infants: a multidimensional description , 1986, Pain.

[24]  David W. Haley,et al.  Altered basal cortisol levels at 3, 6, 8 and 18 months in infants born at extremely low gestational age. , 2007, The Journal of pediatrics.

[25]  Marco Dondi,et al.  Facial Action Coding System for Infants and Young Children (Baby FACS) , 2016 .

[26]  Juan Carlos Prados-Frutos,et al.  [Pain assessment using the Facial Action Coding System. A systematic review]. , 2015, Medicina clinica.

[27]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[28]  Marco La Cascia,et al.  Boosting Hankel matrices for face emotion recognition and pain detection , 2017, Comput. Vis. Image Underst..

[29]  Jeffrey F. Cohn,et al.  Automatic detection of pain intensity , 2012, ICMI '12.

[30]  K. Craig,et al.  Judgment of pain in newborns: Facial activity and cry as determinants. , 1988 .

[31]  Fakhri Karray,et al.  Survey on speech emotion recognition: Features, classification schemes, and databases , 2011, Pattern Recognit..

[32]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Sheryl Brahnam,et al.  Machine recognition and representation of neonatal facial displays of acute pain , 2006, Artif. Intell. Medicine.

[34]  Yu Sun,et al.  Infants' Pain Recognition Based on Facial Expression: Dynamic Hybrid Descriptions , 2018, IEICE Trans. Inf. Syst..

[35]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[36]  Rosa Rojo,et al.  Evaluación del dolor mediante el Sistema de Codificación de la Acción Facial. Revisión sistemática , 2015 .

[37]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  B. O. Valeri,et al.  Pain in preterm infants: effects of sex, gestational age, and neonatal illness severity , 2012 .

[39]  O. Tolba,et al.  Effect of early procedural pain experience on subsequent pain responses among premature infants , 2016 .

[40]  S. Krechel,et al.  CRIES: a new neonatal postoperative pain measurement score. Initial testing of validity and reliability , 1995, Paediatric anaesthesia.

[41]  Elisabeth Scheiner,et al.  Acoustic analyses of developmental changes and emotional expression in the preverbal vocalizations of infants. , 2002, Journal of voice : official journal of the Voice Foundation.

[42]  R. P. Pillai Riddell,et al.  Assessing pain in infancy: the caregiver context. , 2009, Pain research & management.

[43]  Sheryl Brahnam,et al.  Machine assessment of neonatal facial expressions of acute pain , 2007, Decis. Support Syst..

[44]  D. Hudson-Barr,et al.  Validation of the Pain Assessment in Neonates (PAIN) Scale with the Neonatal Infant Pain Scale (NIPS) , 2002, Neonatal Network.

[45]  Vladimir Pavlovic,et al.  Automatic Pain Intensity Estimation with Heteroscedastic Conditional Ordinal Random Fields , 2013, ISVC.

[46]  D. Tibboel,et al.  Neonatal Facial Coding System for Assessing Postoperative Pain in Infants: Item Reduction is Valid and Feasible , 2003, The Clinical journal of pain.

[47]  K Aminian,et al.  Ambulatory system for the quantitative and qualitative analysis of gait and posture in chronic pain patients treated with spinal cord stimulation. , 2004, Gait & posture.

[48]  Sheryl Brahnam,et al.  SVM Classification of Neonatal Facial Images of Pain , 2005, WILF.

[49]  Dmitry B. Goldgof,et al.  An approach for automated multimodal analysis of infants' pain , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[50]  S. Creech,et al.  Clinical reliability and validity of the N-PASS: neonatal pain, agitation and sedation scale with prolonged pain , 2008, Journal of Perinatology.

[51]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[52]  T. Voepel-Lewis,et al.  The FLACC: a behavioral scale for scoring postoperative pain in young children. , 1997, Pediatric nursing.

[53]  P. McGrath,et al.  The development of a tool to assess neonatal pain. , 1991, Neonatal network : NN.

[54]  Maja Pantic,et al.  Continuous Pain Intensity Estimation from Facial Expressions , 2012, ISVC.