Automatic Multimodal Assessment of Neonatal Pain

McCafery [1] describes pain as, ”whatever the experiencing person says it is, existing whenever the experiencing person says it does.” Unfortunately, neonates do not have the ability to communicate this experience verbally (self-evaluation) or non-verbally by writing or pointing (Visual Analog Scale). The limited ability of neonates to communicate pain and the earlier misconception about the absence of neurological substrate for the perception of pain in neonates have led pediatricians to believe, for several decades, that neonates do not feel or remember pain. Several scientific studies [2; 3; 4; 5] disproved this earlier belief and reported a strong association between repeated pain exposure (under-treatment) and alterations in the brain structure and function. This association has led to the increased use of anesthetic medications. However, recent studies [6; 7] found that the excessive use of analgesic medications such as Morphine and Fentanyl may cause several side effects (e.g., hypotension and feeding intolerance). The current standard for assessing neonatal pain involves observing, by bedside caregivers, multiple behavioral (e.g., facial expression) and physiological (e.g., vital signs) responses of pain. At least 29 response-based pain scales [8] have been developed to evaluate procedural and postoperative pain in neonates. This practice has three main shortcomings. First, it relies on the caregiver’s direct observation and interpretation of multiple responses. It is highly affected by several idiosyncratic factors, such as the observer’s cognitive bias, identity, culture, and gender [9]. The interand intraobserver variations can lead to inconsistent assessment and treatment of pain. Second, caregivers assess pain at different time intervals. The discontinuity of assessment can lead to missing pain while the neonate is left unattended; therefore, it may result in delayed intervention. Third, this practice requires a substantial time commitment and a large number of well-trained caregivers to ensure the proper utilization of the pain scale. The substantial cost of this practice makes it infeasible in underdeveloped countries where medical professionals and resources are scarce. This dissertation introduces an automatic, comprehensive, and multimodal neonatal pain assessment system. The proposed system addresses the shortcomings of the current practice and provide continuous, consistent, and inexpensive pain assessment to guide treatment. The main contributions of this dissertation can be summarized as follows:

[1]  Chin-Liang Chang,et al.  Finding Prototypes For Nearest Neighbor Classifiers , 1974, IEEE Transactions on Computers.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Kenneth D. Craig,et al.  Pain expression in neonates: facial action and cry , 1987, Pain.

[5]  D. O'Shaughnessy,et al.  Linear predictive coding , 1988, IEEE Potentials.

[6]  Y Horii,et al.  Spectral energy distribution in four types of infant vocalizations. , 1988, Journal of communication disorders.

[7]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[8]  P. McGrath,et al.  The development of a tool to assess neonatal pain. , 1991, Neonatal network : NN.

[9]  S. Krechel,et al.  CRIES: a new neonatal postoperative pain measurement score. Initial testing of validity and reliability , 1995, Paediatric anaesthesia.

[10]  A. S. Malowany,et al.  Identification of pain from infant cry vocalizations using artificial neural networks (ANNs) , 1995, SPIE Defense + Commercial Sensing.

[11]  B. Stevens,et al.  Premature Infant Pain Profile: development and initial validation. , 1996, The Clinical journal of pain.

[12]  T. Voepel-Lewis,et al.  The FLACC: a behavioral scale for scoring postoperative pain in young children. , 1997, Pediatric nursing.

[13]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[14]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[15]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[16]  V. Lindh,et al.  Heel lancing in term new-born infants: an evaluation of pain by frequency domain analysis of heart rate variability , 1999, Pain.

[17]  Beth Logan,et al.  Mel Frequency Cepstral Coefficients for Music Modeling , 2000, ISMIR.

[18]  Frank M. Scalzo,et al.  Can Adverse Neonatal Experiences Alter Brain Development and Subsequent Behavior? , 2000, Neonatology.

[19]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[20]  M. Dehan,et al.  Development and initial validation of the EDIN scale, a new tool for assessing prolonged pain in preterm infants , 2001, Archives of disease in childhood. Fetal and neonatal edition.

[21]  E. Wong,et al.  Comparison of linear prediction cepstrum coefficients and mel-frequency cepstrum coefficients for language identification , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[22]  A. Bhutta,et al.  Interactions of inflammatory pain and morphine in infant rats: long-term behavioral effects , 2001, Physiology & Behavior.

[23]  A. Bhutta,et al.  Vulnerability of the developing brain. Neuronal mechanisms. , 2002, Clinics in perinatology.

[24]  Shuxian Hu,et al.  Morphine induces apoptosis of human microglia and neurons , 2002, Neuropharmacology.

[25]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[27]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[28]  Dick Tibboel,et al.  Do we still hurt newborn babies? A prospective study of procedural pain and analgesia in neonates. , 2003, Archives of pediatrics & adolescent medicine.

[29]  Z. Benyo,et al.  Acoustic analysis of the infant cry: classical and new methods , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  G. Page,et al.  Are There Long-Term Consequences of Pain in Newborn or Very Young Infants? , 2004, Journal of Perinatal Education.

[31]  K. Craig,et al.  Parental judgements of infant pain: importance of perceived cognitive abilities, behavioural cues and contextual cues. , 2004, Pain research & management.

[32]  R. Grunau,et al.  Neonatal procedural pain and preterm infant cortisol response to novelty at 8 months. , 2004, Pediatrics.

[33]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[34]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[35]  Milan Sonka,et al.  Robust active appearance models and their application to medical image analysis , 2005, IEEE Transactions on Medical Imaging.

[36]  Sheryl Brahnam,et al.  SVM Classification of Neonatal Facial Images of Pain , 2005, WILF.

[37]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[38]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Judith Meek,et al.  Cortical Pain Responses in Human Infants , 2006, The Journal of Neuroscience.

[40]  R. Grunau,et al.  Behavioral Responses to Pain Are Heightened After Clustered Care in Preterm Infants Born Between 30 and 32 Weeks Gestational Age , 2006, The Clinical journal of pain.

[41]  Ananth N. Iyer,et al.  Emotion Detection From Infant Facial Expressions And Cries , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[42]  K. Barrington,et al.  Prevention and Management of Pain in the Neonate: An Update , 2006, Pediatrics.

[43]  郑肇葆,et al.  基于Naive Bayes Classifiers的航空影像纹理分类 , 2006 .

[44]  Sheryl Brahnam,et al.  Machine recognition and representation of neonatal facial displays of acute pain , 2006, Artif. Intell. Medicine.

[45]  Hugo Lagercrantz,et al.  Pain activates cortical areas in the preterm newborn brain , 2006, PAIN.

[46]  J. Peters,et al.  Long-term consequences of pain in human neonates. , 2006, Seminars in fetal & neonatal medicine.

[47]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[48]  G. Várallyay,et al.  FUTURE PROSPECTS OF THE APPLICATION OF THE INFANT CRY IN THE MEDICINE , 2006 .

[49]  M. van Dijk,et al.  Pain assessment: current status and challenges. , 2006, Seminars in fetal & neonatal medicine.

[50]  Carly Miller,et al.  Pain perception and expression: the influence of gender, personal self-efficacy, and lifespan socialization. , 2006, Pain management nursing : official journal of the American Society of Pain Management Nurses.

[51]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[52]  K. Prkachin,et al.  Eigenimage Based Pain Expression Recognition , 2007 .

[53]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[54]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[55]  Joseph Beyene,et al.  Comparison of Pain Responses in Infants of Different Gestational Ages , 2007, Neonatology.

[56]  Shu Liao,et al.  Face Recognition by Using Elongated Local Binary Patterns with Average Maximum Distance Gradient Magnitude , 2007, ACCV.

[57]  Assuring Healthy Outcomes,et al.  Preterm Birth : Causes , Consequences , and Prevention , 2005 .

[58]  K. Craig,et al.  Judgments of infant pain: the impact of caregiver identity and infant age. , 2006, Journal of pediatric psychology.

[59]  Loris Nanni,et al.  Introduction to Neonatal Facial Pain Detection Using Common and Advanced Face Classification Techniques , 2007, Advanced Computational Intelligence Paradigms in Healthcare.

[60]  Patrick J. McGrath,et al.  Pain in neonates and infants , 2007 .

[61]  Sridha Sridharan,et al.  Improving pain recognition through better utilisation of temporal information , 2008, AVSP.

[62]  S. Creech,et al.  Clinical reliability and validity of the N-PASS: neonatal pain, agitation and sedation scale with prolonged pain , 2008, Journal of Perinatology.

[63]  Judith Meek,et al.  How Well Do Clinical Pain Assessment Tools Reflect Pain in Infants? , 2008, PLoS medicine.

[64]  Constantine Kotropoulos,et al.  Fast and accurate sequential floating forward feature selection with the Bayes classifier applied to speech emotion recognition , 2008, Signal Process..

[65]  Gwen Littlewort,et al.  Automatic coding of facial expressions displayed during posed and genuine pain , 2009, Image Vis. Comput..

[66]  Daijin Kim,et al.  Natural facial expression recognition using differential-AAM and manifold learning , 2009, Pattern Recognit..

[67]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[68]  Ayoub Al-Hamadi,et al.  Towards Pain Recognition in Post-Operative Phases Using 3D-based Features From Video and Support Vector Machines , 2009, J. Digit. Content Technol. its Appl..

[69]  R. Grunau,et al.  Neonatal pain, parenting stress and interaction, in relation to cognitive and motor development at 8 and 18months in preterm infants , 2009, Pain.

[70]  L. Storme,et al.  Newborn Infant Pain Assessment Using Heart Rate Variability Analysis , 2010, The Clinical journal of pain.

[71]  Wassim M. Haddad,et al.  Relevance Vector Machine Learning for Neonate Pain Intensity Assessment Using Digital Imaging , 2010, IEEE Transactions on Biomedical Engineering.

[72]  Yousra Abdulaziz,et al.  Infant cry recognition system: A comparison of system performance based on mel frequency and linear prediction cepstral coefficients , 2010, 2010 International Conference on Information Retrieval & Knowledge Management (CAMP).

[73]  Lorenzo Fabrizi,et al.  Premature infants display increased noxious-evoked neuronal activity in the brain compared to healthy age-matched term-born infants , 2010, NeuroImage.

[74]  Dror Lederman,et al.  Estimation of Infants' Cry Fundamental Frequency using a Modified SIFT algorithm , 2010, ArXiv.

[75]  R. Grunau,et al.  Cortisol, Behavior, and Heart Rate Reactivity to Immunization Pain at 4 Months Corrected Age in Infants Born Very Preterm , 2010, The Clinical journal of pain.

[76]  Janaina Mourão Miranda,et al.  Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes , 2010, NeuroImage.

[77]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[78]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[79]  Loris Nanni,et al.  A local approach based on a Local Binary Patterns variant texture descriptor for classifying pain states , 2010, Expert Syst. Appl..

[80]  Sridha Sridharan,et al.  Automatically Detecting Pain in Video Through Facial Action Units , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[81]  Xia Li-min,et al.  Pain Expression Recognition Based on SLPP and MKSVM , 2011 .

[82]  Barry M. Lester,et al.  Infant Crying: Theoretical And Research Perspectives , 2011 .

[83]  S. Mackey,et al.  Towards a Physiology-Based Measure of Pain: Patterns of Human Brain Activity Distinguish Painful from Non-Painful Thermal Stimulation , 2011, PloS one.

[84]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[85]  Catherine Limperopoulos,et al.  Cerebral near-infrared spectroscopy as a measure of nociceptive evoked activity in critically ill infants. , 2011, Pain research & management.

[86]  Jeffrey F. Cohn,et al.  Painful data: The UNBC-McMaster shoulder pain expression archive database , 2011, Face and Gesture 2011.

[87]  Enzo Pasquale Scilingo,et al.  Eye tracking and pupil size variation as response to affective stimuli: A preliminary study , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[88]  Ruth E. Grunau,et al.  Neonatal pain in relation to postnatal growth in infants born very preterm , 2012, PAIN.

[89]  Vann Chau,et al.  Procedural pain and brain development in premature newborns , 2012, Annals of neurology.

[90]  B. O. Valeri,et al.  Pain in preterm infants: effects of sex, gestational age, and neonatal illness severity , 2012 .

[91]  Maja Pantic,et al.  Continuous Pain Intensity Estimation from Facial Expressions , 2012, ISVC.

[92]  K. S. Rao,et al.  Characterization of infant cries using spectral and prosodic features , 2012, 2012 National Conference on Communications (NCC).

[93]  Rashid Ansari,et al.  Automated detection of pain from facial expressions: a rule-based approach using AAM , 2012, Medical Imaging.

[94]  Lorenzo Scalise,et al.  Heart rate measurement in neonatal patients using a webcamera , 2012, 2012 IEEE International Symposium on Medical Measurements and Applications Proceedings.

[95]  Zakia Hammal,et al.  Pain monitoring: A dynamic and context-sensitive system , 2012, Pattern Recognit..

[96]  Carlo Valerio Bellieni,et al.  Pain Assessment in Human Fetus and Infants , 2012, The AAPS Journal.

[97]  W. Wong,et al.  Supervised optimal locality preserving projection , 2012, Pattern Recognit..

[98]  Areej Al-Wabil,et al.  Using Pupil Size Variation during Visual Emotional Stimulation in Measuring Affective States of Non Communicative Individuals , 2013, HCI.

[99]  Ayoub Al-Hamadi,et al.  Towards Pain Monitoring: Facial Expression, Head Pose, a new Database, an Automatic System and Remaining , 2013, BMVC.

[100]  Utpal Bhattacharjee,et al.  A Comparative Study Of LPCC And MFCC Features For The Recognition Of Assamese Phonemes , 2013 .

[101]  Marian Stewart Bartlett,et al.  Weakly supervised pain localization using multiple instance learning , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[102]  Thomas Heldt,et al.  A Multidimensional Approach to Pain Assessment in Critically Ill Infants During a Painful Procedure , 2013, The Clinical journal of pain.

[103]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[104]  Mohd Nazri Rejab,et al.  A computational model of the infant pain impressions with Gaussian and Nearest Mean Classifier , 2013, 2013 IEEE International Conference on Control System, Computing and Engineering.

[105]  Hubert Konik,et al.  Pain detection through shape and appearance features , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[106]  Ayoub Al-Hamadi,et al.  The biovid heat pain database data for the advancement and systematic validation of an automated pain recognition system , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[107]  Matthew Adam Shreve Automatic Macro- and Micro-Facial Expression Spotting and Applications , 2013 .

[108]  D. Bajic,et al.  Morphine-enhanced apoptosis in selective brain regions of neonatal rats , 2013, International Journal of Developmental Neuroscience.

[109]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[110]  Shaoping Zhu,et al.  Pain Expression Recognition Based on pLSA Model , 2014, TheScientificWorldJournal.

[111]  M. Ranger,et al.  Innovating in pain assessment of the critically ill: exploring cerebral near-infrared spectroscopy as a bedside approach. , 2014, Pain management nursing : official journal of the American Society of Pain Management Nurses.

[112]  Ayoub Al-Hamadi,et al.  Comparative Learning Applied to Intensity Rating of Facial Expressions of pain , 2014, Int. J. Pattern Recognit. Artif. Intell..

[113]  Peter H. N. de With,et al.  Video-based facial discomfort analysis for infants , 2014, Electronic Imaging.

[114]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[115]  Ayoub Al-Hamadi,et al.  Automatic Pain Recognition from Video and Biomedical Signals , 2014, 2014 22nd International Conference on Pattern Recognition.

[116]  Gustavo Moreira da Silva,et al.  Automatic pain quantification using autonomic parameters , 2014 .

[117]  Denise Harrison,et al.  Too many crying babies: a systematic review of pain management practices during immunizations on YouTube , 2014, BMC Pediatrics.

[118]  M. Bartlett,et al.  Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions , 2014, Current Biology.

[119]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[120]  A. Marchant ‘Neonates do not feel pain’: a critical review of the evidence , 2014 .

[121]  Karan Sikka,et al.  Facial Expression Analysis for Estimating Pain in Clinical Settings , 2014, ICMI.

[122]  Albert van der Veen,et al.  Development of a baby friendly non-contact method for measuring vital signs: First results of clinical measurements in an open incubator at a neonatal intensive care unit , 2014, Photonics West - Biomedical Optics.

[123]  Corneliu Florea,et al.  Learning Pain from Emotion: Transferred HoT Data Representation for Pain Intensity Estimation , 2014, ECCV Workshops.

[124]  Jeffrey F. Cohn,et al.  Towards Multimodal Pain Assessment for Research and Clinical Use , 2014, RFMIR '14.

[125]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.

[126]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[127]  Patrick Bouthemy,et al.  Optical flow modeling and computation: A survey , 2015, Comput. Vis. Image Underst..

[128]  Yu Sun,et al.  Pain assessment in infants: Towards spotting pain expression based on infants' facial strain , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[129]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[130]  Ronald M. Summers,et al.  Anatomy-specific classification of medical images using deep convolutional nets , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[131]  Michael Jones,et al.  An improved deep learning architecture for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[132]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[133]  Xing Zhang,et al.  Three dimensional binary edge feature representation for pain expression analysis , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[134]  Mrinal Kanti Bhowmik,et al.  An Approach for Automatic Pain Detection through Facial Expression , 2015, IHCI.

[135]  H. Traue,et al.  Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector Machines , 2015, PloS one.

[136]  Markus Kächele,et al.  Data fusion for automated pain recognition , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[137]  Neeru Rathee,et al.  A novel approach for pain intensity detection based on facial feature deformations , 2015, J. Vis. Commun. Image Represent..

[138]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[139]  Patrick Thiam,et al.  Multimodal Data Fusion for Person-Independent, Continuous Estimation of Pain Intensity , 2015, EANN.

[140]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[141]  Takeo Kanade,et al.  Dense 3D face alignment from 2D videos in real-time , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[142]  Dmitry B. Goldgof,et al.  An approach for automated multimodal analysis of infants' pain , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[143]  R. Melotti,et al.  Medical Evidence Influence on Inpatients and Nurses Pain Ratings Agreement , 2016, Pain research & management.

[144]  L. Holsti,et al.  Beyond Acute Pain: Understanding Chronic Pain in Infancy , 2016, Children.

[145]  Norina Witt,et al.  A Guide to Pain Assessment and Management in the Neonate , 2016, Current Emergency and Hospital Medicine Reports.

[146]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[147]  Neeru Rathee,et al.  Multiview Distance Metric Learning on facial feature descriptors for automatic pain intensity detection , 2016, Comput. Vis. Image Underst..

[148]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[149]  Patrick Thiam,et al.  The SenseEmotion Database: A Multimodal Database for the Development and Systematic Validation of an Automatic Pain- and Emotion-Recognition System , 2016, MPRSS.

[150]  Samuel H. Hawkins,et al.  Deep Feature Transfer Learning in Combination with Traditional Features Predicts Survival Among Patients with Lung Adenocarcinoma , 2016, Tomography.

[151]  Steven P. Miller,et al.  Smaller Cerebellar Growth and Poorer Neurodevelopmental Outcomes in Very Preterm Infants Exposed to Neonatal Morphine. , 2016, The Journal of pediatrics.

[152]  Luigi Celona,et al.  Neonatal Facial Pain Assessment Combining Hand-Crafted and Deep Features , 2017, ICIAP Workshops.

[153]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[154]  Rosalind W. Picard,et al.  338) Automatic detection of nociceptive stimuli and pain intensity from facial expressions , 2017 .

[155]  Kamal Nasrollahi,et al.  Deep Pain: Exploiting Long Short-Term Memory Networks for Facial Expression Classification , 2017, IEEE Transactions on Cybernetics.

[156]  Andrew Shea,et al.  DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain , 2017, AffComp@IJCAI.

[157]  Xiaofeng Wang,et al.  Human action recognition using transfer learning with deep representations , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[158]  Andrey V. Savchenko,et al.  Group-level emotion recognition using transfer learning from face identification , 2017, ICMI.

[159]  Patrick Thiam,et al.  Adaptive confidence learning for the personalization of pain intensity estimation systems , 2017, Evol. Syst..

[160]  S. Walker Translational studies identify long-term impact of prior neonatal pain experience , 2017, Pain.

[161]  Nikhil Ketkar,et al.  Introduction to Keras , 2017 .

[162]  Yu Sun,et al.  Automated Pain Assessment in Neonates , 2017, SCIA.

[163]  Rangachar Kasturi,et al.  A Review of Automated Pain Assessment in Infants: Features, Classification Tasks, and Databases , 2018, IEEE Reviews in Biomedical Engineering.

[164]  Yu Sun,et al.  Infants' Pain Recognition Based on Facial Expression: Dynamic Hybrid Descriptions , 2018, IEICE Trans. Inf. Syst..

[165]  Heng Yang,et al.  Facial feature point detection: A comprehensive survey , 2014, Neurocomputing.

[166]  Samuel H. Hawkins,et al.  Predicting malignant nodules by fusing deep features with classical radiomics features , 2018, Journal of medical imaging.