Convolutional Neural Networks for Neonatal Pain Assessment

The current standard for assessing neonatal pain is discontinuous and inconsistent because it depends highly on the observers bias. These drawbacks can result in delayed intervention and inconsistent treatment of pain. Convolutional neural networks (CNNs) have gained much popularity in the last decades due to the wide range of its successful applications in medical image analysis, object and emotion recognition. In this paper, we investigated the use of a novel lightweight neonatal convolutional neural network as well as other popular CNN architectures for assessing neonatal pain. We experimented with various image augmentation techniques and evaluated the CNN architectures using two real-world datasets [COPE and neonatal pain assessment dataset (NPAD)] collected from neonates while being hospitalized in the intensive care unit. The experimental results demonstrate the superiority and efficiency of the novel network in assessing neonatal pain. They also suggest that the automatic recognition of neonatal pain using CNN networks is a viable and more efficient alternative to the current assessment standard.

[1]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Luigi Celona,et al.  Neonatal Facial Pain Assessment Combining Hand-Crafted and Deep Features , 2017, ICIAP Workshops.

[3]  Mark D. McDonnell,et al.  Understanding Data Augmentation for Classification: When to Warp? , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[4]  Yu Sun,et al.  Pain assessment in infants: Towards spotting pain expression based on infants' facial strain , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[5]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[6]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Peter H. N. de With,et al.  Video-based facial discomfort analysis for infants , 2014, Electronic Imaging.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Jeffrey F. Cohn,et al.  Automatic action unit detection in infants using convolutional neural network , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[12]  Himanshu S. Bhatt,et al.  Domain Specific Learning for Newborn Face Recognition , 2016, IEEE Transactions on Information Forensics and Security.

[13]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[14]  Rangachar Kasturi,et al.  A Review of Automated Pain Assessment in Infants: Features, Classification Tasks, and Databases , 2018, IEEE Reviews in Biomedical Engineering.

[15]  A. Marchant ‘Neonates do not feel pain’: a critical review of the evidence , 2014 .

[16]  D. Hudson-Barr,et al.  Validation of the Pain Assessment in Neonates (PAIN) Scale with the Neonatal Infant Pain Scale (NIPS) , 2002, Neonatal Network.

[17]  Liisa Holsti,et al.  Bedside application of the Neonatal Facial Coding System in pain assessment of premature infants , 1998, Pain.

[18]  Yu Sun,et al.  Neonatal Pain Expression Recognition Using Transfer Learning , 2018, ArXiv.

[19]  Paul Suetens,et al.  Validation of different soft tissue simulation methods for breast augmentation , 2005 .

[20]  Mohd Nazri Rejab,et al.  A computational model of the infant pain impressions with Gaussian and Nearest Mean Classifier , 2013, 2013 IEEE International Conference on Control System, Computing and Engineering.

[21]  Dmitry B. Goldgof,et al.  Pain Assessment From Facial Expression: Neonatal Convolutional Neural Network (N-CNN) , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[22]  Andreas Holzinger,et al.  Augmentor: An Image Augmentation Library for Machine Learning , 2017, J. Open Source Softw..

[23]  Yu Sun,et al.  Automated Pain Assessment in Neonates , 2017, SCIA.

[24]  R. Kasturi,et al.  A Comprehensive and Context-Sensitive Neonatal Pain Assessment Using Computer Vision , 2019, IEEE Transactions on Affective Computing.

[25]  M. Cruz,et al.  Epidemiology of painful procedures performed in neonates: A systematic review of observational studies , 2016, European journal of pain.

[26]  Chi Fang,et al.  Development of Recognition Engine for Baby Faces , 2010, 2010 20th International Conference on Pattern Recognition.

[27]  Terri Ashmeade,et al.  Automatic Infants’ Pain Assessment by Dynamic Facial Representation: Effects of Profile View, Gestational Age, Gender, and Race , 2018, Journal of clinical medicine.

[28]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[29]  Takeo Kanade,et al.  Dense 3D face alignment from 2D videos in real-time , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[30]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[31]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[32]  T. Field Preterm newborn pain research review. , 2017, Infant behavior & development.