Introduction to Neonatal Facial Pain Detection Using Common and Advanced Face Classification Techniques

Assessing pain in neonates is a challenging problem. Neonates cannot describe their pain experiences but must rely exclusively on the judgments of others. Studies demonstrate, however, that proper diagnosis of pain is impeded by observer bias. It has therefore been recommended that neonatal pain assessment instruments include evaluations that have bypassed an observer. In this article, we describe the Infant COPE project and our work using face classification to detect pain in a neonate’s facial displays. We begin by providing an introduction to face classification that includes an outline of some common and advanced algorithms. We then describe a small database we designed specifically to investigate classifier performance in this problem domain. This is followed by a summary of the experiments we have performed to date, including some preliminary results of current work. We believe these results indicate that the application of face classification to the problem of neonatal pain assessment is a promising area of investigation.

[1]  D. Wong,et al.  Pain in children: comparison of assessment scales. , 1988, The Oklahoma nurse.

[2]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[4]  Thomas S. Huang,et al.  Final Report To NSF of the Planning Workshop on Facial Expression Understanding , 1992 .

[5]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[6]  Tomaso A. Poggio,et al.  Face recognition with support vector machines: global versus component-based approach , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Amit Jain,et al.  Integrating independent components and linear discriminant analysis for gender classification , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[8]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[9]  Patrick J. McGrath,et al.  Measurement of Pain in Infants and Children , 1998 .

[10]  Randall S. Sexton,et al.  Reliable classification using neural networks: a genetic algorithm and backpropagation comparison , 2000, Decis. Support Syst..

[11]  S. Coffman,et al.  Nursing assessment and management of pain in critically ill children. , 1997, Heart & lung : the journal of critical care.

[12]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[13]  Seon Hwa Seo,et al.  Neonatal Facial and Cry Responses to Invasive and Non-invasive Procedures , 1997 .

[14]  Sheryl Brahnam,et al.  Machine assessment of neonatal facial expressions of acute pain , 2007, Decis. Support Syst..

[15]  S. Brahnam,et al.  Machine recognition and representation of neonatal facial displays of acute pain , 2006 .

[16]  L Van Cleve,et al.  Pain responses of hospitalized infants and children to venipuncture and intravenous cannulation. , 1996, Journal of pediatric nursing.

[17]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[19]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[20]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[21]  H. Abdi,et al.  Principal Component and Neural Network Analyses of Face Images: What Can Be Generalized in Gender Classification? , 1997, Journal of mathematical psychology.

[22]  Randall S. Sexton,et al.  Toward global optimization of neural networks: A comparison of the genetic algorithm and backpropagation , 1998, Decis. Support Syst..

[23]  Alistair G. Rust,et al.  Image redundancy reduction for neural network classification using discrete cosine transforms , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[24]  L. Zeltzer,et al.  Pain in Children: Nature, Assessment, and Treatment , 1992 .

[25]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[26]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[27]  Alice J. O'Toole,et al.  CATEGORIZATION AND IDENTIFICATION OF HUMAN FACE IMAGES BY NEURAL NETWORKS: A REVIEW OF THE LINEAR AUTOASSOCIATIVE AND PRINCIPAL COMPONENT APPROACHES , 1994 .

[28]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[29]  Randall S. Sexton,et al.  Simultaneous optimization of neural network function and architecture algorithm , 2004, Decis. Support Syst..

[30]  Pujitha Gunaratne,et al.  Estimation of Asymmetry in Facial Actions for the Analysis of Motion Dysfunction Due to Paralysis , 2003, Int. J. Image Graph..

[31]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[32]  Michael G. Strintzis,et al.  Face Recognition , 2008, Encyclopedia of Multimedia.

[33]  Sun-Yuan Kung,et al.  Face recognition/detection by probabilistic decision-based neural network , 1997, IEEE Trans. Neural Networks.

[34]  Makoto Kosugi,et al.  Human-face search and location in a scene by multi-pyramid architecture for personal identification , 1995, Systems and Computers in Japan.

[35]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[36]  Randall S. Sexton,et al.  Improving Decision Effectiveness of Artificial Neural Networks: A Modified Genetic Algorithm Approach , 2003, Decis. Sci..

[37]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[38]  Michael Egmont-Petersen,et al.  Sequential selection of discrete features for neural networks - A Bayesian approach to building a cascade , 1999, Pattern Recognit. Lett..

[39]  Guodong Guo,et al.  Support vector machines for face recognition , 2001, Image Vis. Comput..

[40]  K. Prkachin,et al.  Does experience influence judgments of pain behaviour? Evidence from relatives of pain patients and therapists. , 2001, Pain research & management.

[41]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  M. Miyoshi,et al.  The Recognition of Facial Expression of Pain in Full-term Newborns by Parents and Health Professionals , 2022 .

[43]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[44]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[45]  Kenneth D. Craig,et al.  Pain expression in neonates: facial action and cry , 1987, Pain.

[46]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Ming-Hsuan Yang,et al.  Gender classification with support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[48]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[49]  P. Jonathon Phillips,et al.  Support Vector Machines Applied to Face Recognition , 1998, NIPS.

[50]  A. J. O'toole,et al.  Classifying faces by face and sex using an autoassociative memory trained for recognition , 1991 .

[51]  Anil K. Jain,et al.  Ethnicity identification from face images , 2004, SPIE Defense + Commercial Sensing.

[52]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[53]  A. O'Toole,et al.  The perception of face gender: The role of stimulus structure in recognition and classification , 1998, Memory & cognition.

[54]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[55]  T. Mills,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires , 2006 .

[56]  F. Warnock,et al.  Comprehensive description of newborn distress behavior in response to acute pain (newborn male circumcision) , 2004, Pain.

[57]  Dick Tibboel,et al.  Pain assessment in neonates , 2004 .

[58]  Dominique Valentin,et al.  Sex classification of face areas: How well can a linear neural network predict human performance? , 1998 .

[59]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  D. Wong,et al.  Pain in children: comparison of assessment scales. , 1988, The Oklahoma nurse.

[61]  A. M. Burton,et al.  What's the Difference between Men and Women? Evidence from Facial Measurement , 1993, Perception.

[62]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[63]  G. Cottrell,et al.  A Simple Neural Network Models Categorical Perception of Facial Expressions , 1998 .

[64]  Garrison W. Cottrell,et al.  EMPATH: Face, Emotion, and Gender Recognition Using Holons , 1990, NIPS.

[65]  V. Lindh,et al.  Heel lancing in term new-born infants: an evaluation of pain by frequency domain analysis of heart rate variability , 1999, Pain.

[66]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Ming-Hsuan Yang,et al.  Learning Gender with Support Faces , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  J. Peters,et al.  Long-term consequences of pain in human neonates. , 2006, Seminars in fetal & neonatal medicine.

[69]  A. S. Malowany,et al.  Identification of pain from infant cry vocalizations using artificial neural networks (ANNs) , 1995, SPIE Defense + Commercial Sensing.