Video and audio processing in paediatrics: a review

OBJECTIVE Video and sound acquisition and processing technologies have seen great improvements in recent decades, with many applications in the biomedical area. The aim of this paper is to review the overall state of the art of advances within these topics in paediatrics and to evaluate their potential application for monitoring in the neonatal intensive care unit (NICU). APPROACH For this purpose, more than 150 papers dealing with video and audio processing were reviewed. For both topics, clinical applications are described according to the considered cohorts-full-term newborns, infants and toddlers or preterm newborns. Then, processing methods are presented, in terms of data acquisition, feature extraction and characterization. MAIN RESULTS The paper first focuses on the exploitation of video recordings; these began to be automatically processed in the 2000s and we show that they have mainly been used to characterize infant motion. Other applications, including respiration and heart rate estimation and facial analysis, are also presented. Audio processing is then reviewed, with a focus on the analysis of crying. The first studies in this field focused on induced-pain cries and the newest ones deal with spontaneous cries; the analyses are mainly based on frequency features. Then, some papers dealing with non-cry signals are also discussed. SIGNIFICANCE Finally, we show that even if recent improvements in digital video and signal processing allow for increased automation of processing, the context of the NICU makes a fully automated analysis of long recordings problematic. A few proposals for overcoming some of the limitations are given.

[1]  S. Blackburn,et al.  Comparison between time-lapse video recordings of behavior and polygraphic state determinations in premature infants. , 1978, Psychophysiology.

[2]  Mounya Elhilali,et al.  Computerized Lung Sound Screening for Pediatric Auscultation in Noisy Field Environments , 2018, IEEE Transactions on Biomedical Engineering.

[3]  Xi Long,et al.  An efficient heuristic method for infant in/out of bed detection using video-derived motion estimates , 2018 .

[4]  Kenneth D. Craig,et al.  Developmental changes in pain expression in premature, full-term, two- and four-month-old infants , 1993, Pain.

[5]  Michael J. Black,et al.  A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them , 2013, International Journal of Computer Vision.

[6]  Peter H. N. de With,et al.  Behavioral State Detection of Newborns Based on Facial Expression Analysis , 2009, ACIVS.

[7]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[8]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[9]  Claudia Manfredi,et al.  Automated detection and classification of basic shapes of newborn cry melody , 2018, Biomed. Signal Process. Control..

[10]  Nicolaos B. Karayiannis,et al.  Automated extraction of temporal motor activity signals from video recordings of neonatal seizures based on adaptive block matching , 2005, IEEE Transactions on Biomedical Engineering.

[11]  B. Lester,et al.  Spectrum analysis of the cry sounds of well-nourished and malnourished infants. , 1976, Child development.

[12]  R. Horne,et al.  Validation of actigraphy for determining sleep and wake in preterm infants , 2009, Acta paediatrica.

[13]  L. Goldman,et al.  Nasal airflow and thoracoabdominal motion in children using infrared thermographic video processing , 2012, Pediatric pulmonology.

[14]  B. Tharp,et al.  Neonatal Seizures and Syndromes , 2002, Epilepsia.

[15]  Florian B. Pokorny,et al.  A Novel Way to Measure and Predict Development: A Heuristic Approach to Facilitate the Early Detection of Neurodevelopmental Disorders , 2017, Current Neurology and Neuroscience Reports.

[16]  Chakib Tadj,et al.  A fully automated approach for baby cry signal segmentation and boundary detection of expiratory and inspiratory episodes , 2017, The Journal of the Acoustical Society of America.

[17]  Dror Lederman,et al.  Classification of cries of infants with cleft-palate using parallel hidden Markov models , 2008, Medical & Biological Engineering & Computing.

[18]  L. Mazzone,et al.  The General Movements in children with Down syndrome. , 2004, Early human development.

[19]  Claudia Manfredi,et al.  AVIM - A contactless system for infant data acquisition and analysis: Software architecture and first results , 2015, Biomed. Signal Process. Control..

[20]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[21]  Geraldine B. Boylan,et al.  Neonatal EEG Interpretation and Decision Support Framework for Mobile Platforms , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  A. K. Majumdar,et al.  Toward Automating Hammersmith Pulled-To-Sit Examination of Infants Using Feature Point Based Video Object Tracking , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Björn W. Schuller,et al.  Recent developments in openSMILE, the munich open-source multimedia feature extractor , 2013, ACM Multimedia.

[24]  Jonathan H. Smith,et al.  When Headache Warns of Homeostatic Threat: the Metabolic Headaches , 2017, Current Neurology and Neuroscience Reports.

[25]  Tuomas Virtanen,et al.  Automatic segmentation of infant cry signals using hidden Markov models , 2018, EURASIP Journal on Audio, Speech, and Music Processing.

[26]  B. Fuller,et al.  The Effect of Pain on Infant Behaviors , 1995, Clinical nursing research.

[27]  K. Michelsson,et al.  Newborn infants' cry after heel‐prick: analysis with sound spectrogram , 2000, Acta paediatrica.

[28]  B. Lester,et al.  A Biobehavioral Perspective on Crying in Early Infancy , 1982 .

[29]  Xiaoxue Li,et al.  A flexible analysis tool for the quantitative acoustic assessment of infant cry. , 2013, Journal of speech, language, and hearing research : JSLHR.

[30]  G. Ferrari,et al.  A wire-free, non-invasive, low-cost video processing-based approach to neonatal apnoea detection , 2014, 2014 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS) Proceedings.

[31]  Carlos A. Reyes García,et al.  A Study on the Recognition of Patterns of Infant Cry for the Identification of Deafness in Just Born Babies with Neural Networks , 2003, CIARP.

[32]  L. Tarassenko,et al.  Continuous non-contact vital sign monitoring in neonatal intensive care unit , 2014, Healthcare technology letters.

[33]  Carlo V Bellieni,et al.  Cry Features Reflect Pain Intensity in Term Newborns: An Alarm Threshold , 2004, Pediatric Research.

[34]  G. Várallyay,et al.  FUTURE PROSPECTS OF THE APPLICATION OF THE INFANT CRY IN THE MEDICINE , 2006 .

[35]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[36]  B. Thach.  Maturation of cough and other reflexes that protect the fetal and neonatal airway. , 2007, Pulmonary pharmacology & therapeutics.

[37]  G. Várallyay.  The melody of crying. , 2007, International journal of pediatric otorhinolaryngology.

[38]  Eli M. Mizrahi,et al.  Characterization and classification of neonatal seizures , 1987, Neurology.

[39]  Yasunari Yoshitomi,et al.  Recognition of a Baby's Emotional Cry towards Robotics Baby Caregiver , 2013 .

[40]  Carlos A. Reyes García,et al.  A Fuzzy Relational Neural Network for Pattern Classification , 2004, CIARP.

[41]  Y Horii,et al.  Differences in fundamental frequency, jitter, and shimmer among four types of infant vocalizations. , 1986, Journal of communication disorders.

[42]  Christian Gargour,et al.  Expiratory and Inspiratory Cries Detection Using Different Signals' Decomposition Techniques , 2017, Journal of voice : official journal of the Voice Foundation.

[43]  Volker Hesse,et al.  Fundamental Frequency of Crying in Two-month-old Boys and Girls: Do Sex Hormones During Mini-puberty Mediate Differences? , 2017, Journal of voice : official journal of the Voice Foundation.

[44]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[45]  J. Allan Hobson,et al.  A manual of standardized terminology, techniques and criteria for scoring of states of sleep and wakefulness in newborn infants , 1972 .

[46]  Florian B. Pokorny,et al.  Typical vs. atypical: Combining auditory Gestalt perception and acoustic analysis of early vocalisations in Rett syndrome. , 2018, Research in developmental disabilities.

[47]  Leonardo Bocchi,et al.  Automatic newborn cry analysis: A Non-invasive tool to help autism early diagnosis , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  B. Lester,et al.  Acoustic features and auditory perceptions of the cries of newborns with prenatal and perinatal complications. , 1978, Child development.

[49]  Kenneth D. Craig,et al.  Pain in the preterm neonate: behavioural and physiological indices , 1993, Pain.

[50]  Daniel S. Messinger,et al.  Jointly detecting infants' multiple facial action units expressed during spontaneous face-to-face communication , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[51]  Sergio Daniel Cano-Ortiz,et al.  A Radial Basis Function Network Oriented for Infant Cry Classification , 2004, CIARP.

[52]  N.B. Karayiannis,et al.  Quantifying motion in video recordings of neonatal seizures by feature trackers based on predictive block matching , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[53]  Guozhi Tao,et al.  Quantifying motion in video recordings of neonatal seizures by regularized optical flow methods , 2005, IEEE Transactions on Image Processing.

[54]  P. S. Zeskind.  Adult responses to cries of low and high risk infants , 1980 .

[55]  Manolis Tsiknakis,et al.  Vision-based motion detection, analysis and recognition of epileptic seizures - A systematic review , 2012, Comput. Methods Programs Biomed..

[56]  M. Myowa-Yamakoshi,et al.  Preterm birth is associated with an increased fundamental frequency of spontaneous crying in human infants at term-equivalent age , 2014, Biology Letters.

[57]  Sabine Van Huffel,et al.  Automatic video detection of body movement during sleep based on optical flow in pediatric patients with epilepsy , 2010, Medical & Biological Engineering & Computing.

[58]  C. Manfredi,et al.  Testing software tools for newborn cry analysis using synthetic signals , 2017, Biomed. Signal Process. Control..

[59]  K. Michelsson,et al.  Sound Spectrographic Cry Analysis of Pain Cry in Prematures , 1985 .

[60]  A. Bos,et al.  Quality of general movements in preterm infants with transient periventricular echodensities , 1998, Acta paediatrica.

[61]  Carlos A. Reyes García,et al.  Classification of Infant Crying to Identify Pathologies in Recently Born Babies with ANFIS , 2004, ICCHP.

[62]  Emilio Arch-Tirado,et al.  Análisis espectrográfico del llanto en recién nacidos con hipoacusia profunda y en productos de alto riesgo , 2012 .

[63]  Kiyohiro Shikano,et al.  Julius - an open source real-time large vocabulary recognition engine , 2001, INTERSPEECH.

[64]  Climent Nadeu,et al.  A Knowledge-Based Approach to Automatic Detection of Equipment Alarm Sounds in a Neonatal Intensive Care Unit Environment , 2017, IEEE Journal of Translational Engineering in Health and Medicine.

[65]  A Fort,et al.  Acoustic analysis of newborn infant cry signals. , 1998, Medical engineering & physics.

[66]  B. Lester,et al.  Atypical Cry Acoustics in 6‐Month‐Old Infants at Risk for Autism Spectrum Disorder , 2012, Autism research : official journal of the International Society for Autism Research.

[67]  Daniel S. Messinger,et al.  A comparison of alternative classifiers for detecting occurrence and intensity in spontaneous facial expression of infants with their mothers , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[68]  Claudia Manfredi,et al.  Effective pre-processing of long term noisy audio recordings: An aid to clinical monitoring , 2013, Biomed. Signal Process. Control..

[69]  Rami Cohen,et al.  Baby cry detection in domestic environment using deep learning , 2016, 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE).

[70]  Kris Cuppens,et al.  Towards automatic detection of movement during sleep in pediatric patients with epilepsy by means of video recordings and the optical flow algorithm , 2009 .

[71]  Chuan-Yu Chang,et al.  Application of deep learning for recognizing infant cries , 2016, 2016 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[72]  M Peucker,et al.  Neurobehavioral syndromes in cocaine-exposed newborn infants. , 1991, Child development.

[73]  Sabine Van Huffel,et al.  Automated Respiration Detection from Neonatal Video Data , 2015, ICPRAM.

[74]  Stefano Squartini,et al.  Infant Cry Detection in Adverse Acoustic Environments by Using Deep Neural Networks , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[75]  S. Pearce,et al.  Time-frequency analysis of infant cry: measures that identify individuals. , 1993, Physiological measurement.

[76]  Betty Vohr,et al.  Importance of Parent Talk on the Development of Preterm Infant Vocalizations , 2011, Pediatrics.

[77]  Atsue Ishii,et al.  Monitoring preterm infants' body movement to improve developmental care for their health , 2017, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE).

[78]  Wim Verkruysse,et al.  Near-continuous non-contact cardiac pulse monitoring in a neonatal intensive care unit in near darkness , 2018, BiOS.

[79]  Steffen Leonhardt,et al.  Infrared thermography for detailed registration of thermoregulation in premature infants , 2013, Journal of perinatal medicine.

[80]  Jorge Brieva,et al.  Phase-based motion magnification video for monitoring of vital signals using the Hermite transform , 2017, Symposium on Medical Information Processing and Analysis.

[81]  Chakib Tadj,et al.  Automatic detection of the expiratory and inspiratory phases in newborn cry signals , 2015, Biomed. Signal Process. Control..

[82]  B. Fuller.  Acoustic Discrimination of Three Types of Infant Cries , 1991, Nursing research.

[83]  Gianluigi Ferrari,et al.  Respiratory Rate Monitoring by Video Processing Using Local Motion Magnification , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[84]  H. Prechtl.  Qualitative changes of spontaneous movements in fetus and preterm infant are a marker of neurological dysfunction. , 1990, Early human development.

[85]  A Ismaelli,et al.  Computerized cry analysis in infants affected by severe protein energy malnutrition , 1994, Acta paediatrica.

[86]  Rasmus R. Paulsen,et al.  Model-Based Motion Tracking of Infants , 2014, ECCV Workshops.

[87]  K. Michelsson,et al.  Twenty-Five Years of Scandinavian Cry Research , 1985 .

[88]  C Manfredi,et al.  High-resolution cry analysis in preterm newborn infants. , 2009, Medical engineering & physics.

[89]  Z. Benyo,et al.  Acoustic analysis of the infant cry: classical and new methods , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[90]  S. Higuchi,et al.  Influence of light exposure at nighttime on sleep development and body growth of preterm infants , 2016, Scientific Reports.

[91]  Hugo Jair Escalante,et al.  Classifying infant cry patterns by the Genetic Selection of a Fuzzy Model , 2015, Biomed. Signal Process. Control..

[92]  Carlos A. Reyes García,et al.  Analysis of an Infant Cry Recognizer for the Early Identification of Pathologies , 2004, Summer School on Neural Networks.

[93]  B. Stevens,et al.  Factors that influence the behavioral pain responses of premature infants , 1994, Pain.

[94]  J. Huvanandana,et al.  Advanced analyses of physiological signals in the neonatal intensive care unit , 2017, Physiological measurement.

[95]  Gianluigi Ferrari,et al.  Monitoring infants by automatic video processing: A unified approach to motion analysis , 2017, Comput. Biol. Medicine.

[96]  K. Michelsson,et al.  Sound spectrographic analysis of pain cry in preterm infants. , 1983, Early human development.

[97]  Y. Sivan,et al.  Screening obstructive sleep apnoea syndrome by home videotape recording in children. , 1996, The European respiratory journal.

[98]  L. Lagasse,et al.  Assessment of infant cry: acoustic cry analysis and parental perception. , 2005, Mental retardation and developmental disabilities research reviews.

[99]  P. Buckley,et al.  Actigraphy Correctly Predicts Sleep Behavior in Infants Who Are Younger than Six Months, When Compared with Polysomnography , 2005, Pediatric Research.

[100]  M. Wailoo,et al.  Use of thermographic imaging to study babies sleeping at home. , 1990, Archives of disease in childhood.

[101]  Sei-Wang Chen,et al.  A Vision-Based Infant Respiratory Frequency Detection System , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[102]  R. Schönweiler,et al.  Neuronal networks and self-organizing maps: new computer techniques in the acoustic evaluation of the infant cry. , 1996, International journal of pediatric otorhinolaryngology.

[103]  James R. Green,et al.  Segmentation of Patient Images in the Neonatal Intensive Care Unit , 2018, 2018 IEEE Life Sciences Conference (LSC).

[104]  Steffen Leonhardt,et al.  Intelligent neonatal monitoring based on a virtual thermal sensor , 2014, BMC Medical Imaging.

[105]  Lorenzo Scalise,et al.  Assessment of cardio-respiratory rates by non-invasive measurement methods in hospitalized preterm neonates , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[106]  A N Popper,et al.  Cepstral and stationarity analyses of full-term and premature infants' cries. , 1974, The Journal of the Acoustical Society of America.

[107]  Øyvind Stavdahl,et al.  Video-based early cerebral palsy prediction using motion segmentation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[108]  H L Golub,et al.  Infant cry: a clue to diagnosis. , 1982, Pediatrics.

[109]  Sazali Yaacob,et al.  Pathological infant cry analysis using wavelet packet transform and probabilistic neural network , 2011, Expert Syst. Appl..

[110]  Kenneth D. Craig,et al.  Neonatal facial and cry responses to invasive and non-invasive procedures , 1990, Pain.

[111]  Carlos A. Reyes García,et al.  Automatic infant cry analysis for the identification of qualitative features to help opportune diagnosis , 2012, Biomed. Signal Process. Control..

[112]  Yaohua Xiong,et al.  Quantifying motion in video recordings of neonatal seizures by robust motion trackers based on block motion models , 2005, IEEE Transactions on Biomedical Engineering.

[113]  Nicolaos B. Karayiannis,et al.  Automated tracking of multiple body parts in video recordings of neonatal seizures , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[114]  T. Anders,et al.  The use of time lapse video recording of sleep-wake behavior in human infants. , 1976, Psychophysiology.

[115]  Geraldine B. Boylan,et al.  On sound-based interpretation of neonatal EEG , 2018, 2018 29th Irish Signals and Systems Conference (ISSC).

[116]  Rafael Torres,et al.  Baby Cry Sound Detection: A Comparison of Hand Crafted Features and Deep Learning Approach , 2017, EANN.

[117]  Leonardo Bocchi,et al.  Central blood oxygen saturation vs crying in preterm newborns , 2012, Biomed. Signal Process. Control..

[118]  Y Horii,et al.  Spectral energy distribution in four types of infant vocalizations. , 1988, Journal of communication disorders.

[119]  O. M. Aamo,et al.  An Optical Flow-Based Method to Predict Infantile Cerebral Palsy , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[120]  S Pearce,et al.  Energy distribution in the spectrograms of the cries of normal and birth asphyxiated infants. , 1993, Physiological measurement.

[121]  Guozhi Tao,et al.  Automated detection of videotaped neonatal seizures based on motion segmentation methods , 2006, Clinical Neurophysiology.

[122]  K. Wermke,et al.  Developmental aspects of infant's cry melody and formants. , 2002, Medical engineering & physics.

[123]  G Cioni,et al.  General movements detect early signs of hemiplegia in term infants with neonatal cerebral infarction. , 2003, Neuropediatrics.

[124]  B. Lester,et al.  Effects of marijuana use during pregnancy on newborn cry. , 1989, Child development.

[125]  F. Ducharme,et al.  Can sleep and wakefulness be distinguished in children by cardiorespiratory and videotape recordings? , 1996, Chest.

[126]  Antoine Simon,et al.  Motion Estimation and Characterization in Premature Newborns Using Long Duration Video Recordings , 2017 .

[127]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[128]  Claudia Manfredi,et al.  Application of Pattern Recognition Techniques to the Classification of Full-Term and Preterm Infant Cry. , 2016, Journal of voice : official journal of the Voice Foundation.

[129]  Björn W. Schuller,et al.  Manual versus Automated: The Challenging Routine of Infant Vocalisation Segmentation in Home Videos to Study Neuro(mal)development , 2016, INTERSPEECH.

[130]  Climent Nadeu,et al.  Pre-processing techniques for improved detection of vocalization sounds in a neonatal intensive care unit , 2018, Biomed. Signal Process. Control..

[131]  Nicolaos B. Karayiannis,et al.  Extraction of motion strength and motor activity signals from video recordings of neonatal seizures , 2001, IEEE Transactions on Medical Imaging.

[132]  R. Chervin,et al.  The visual scoring of sleep and arousal in infants and children. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[133]  L. E. Jones,et al.  Perception of cries by parents and nonparents: Relation to cry acoustics. , 1987 .

[134]  A. Jensenius,et al.  Early prediction of cerebral palsy by computer‐based video analysis of general movements: a feasibility study , 2010, Developmental medicine and child neurology.

[135]  M. Hariharan,et al.  Automatic Infant Cry Pattern Classification for a Multiclass Problem , 2016 .

[136]  K. Michelsson,et al.  Phonation in the newborn, infant cry. , 1999, International journal of pediatric otorhinolaryngology.

[137]  Sandra E. Barajas-Montiel,et al.  Fuzzy Support Vector Machines for Automatic Infant Cry Recognition , 2006 .

[138]  Yu Sun,et al.  Pain assessment in infants: Towards spotting pain expression based on infants' facial strain , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[139]  P. S. Zeskind,et al.  The Relation between Variations in Pitch and Maternal Perceptions of Infant Crying. , 1988 .

[140]  Giovanni Cioni,et al.  An early marker for neurological deficits after perinatal brain lesions , 1997, The Lancet.

[141]  A. Rechtschaffen.  A manual of Standardized Terminology , 1968 .

[142]  Guozhi Tao,et al.  An improved procedure for the extraction of temporal motion strength signals from video recordings of neonatal seizures , 2006, Image Vis. Comput..

[143]  Øyvind Stavdahl,et al.  Weakly supervised motion segmentation with particle matching , 2015, Comput. Vis. Image Underst..

[144]  M Robb,et al.  Acoustic examination of preterm and full-term infant cries: the long-time average spectrum. , 1999, Journal of speech, language, and hearing research : JSLHR.

[145]  Alexander Refsum Jensenius,et al.  Using computer-based video analysis in the study of fidgety movements. , 2009, Early human development.

[146]  Carlos A. Reyes García,et al.  Infant Cry Classification to Identify Hypo Acoustics and Asphyxia Comparing an Evolutionary-Neural System with a Neural Network System , 2005, MICAI.

[147]  K. Christensson,et al.  Separation distress call in the human neonate in the absence of maternal body contact , 1995, Acta paediatrica.

[148]  Roslyn N Boyd,et al.  Quality of General Movements Is Related to White Matter Pathology in Very Preterm Infants , 2008, Pediatrics.

[149]  H. Prechtl,et al.  Qualitative assessment of general movements in high-risk preterm infants with chronic lung disease requiring dexamethasone therapy. , 1998, The Journal of pediatrics.

[150]  Werner Mende,et al.  Musical elements in human infants’ cries: In the beginning is the melody , 2009 .

[151]  J. Markel,et al.  The SIFT algorithm for fundamental frequency estimation , 1972 .

[152]  Kenneth D. Craig,et al.  Pain expression in neonates: facial action and cry , 1987, Pain.

[153]  Yaohua Xiong,et al.  Computerized Motion Analysis of Videotaped Neonatal Seizures of Epileptic Origin , 2005, Epilepsia.

[154]  Gianluigi Ferrari,et al.  Low-complexity image processing for real-time detection of neonatal clonic seizures , 2010, 2010 3rd International Symposium on Applied Sciences in Biomedical and Communication Technologies (ISABEL 2010).

[155]  R. Barr,et al.  Rhythmic organization of the sound of infant crying. , 1993, Developmental psychobiology.

[156]  Arindam Sikdar,et al.  Contactless vision-based pulse rate detection of Infants Under Neurological Examinations , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[157]  J. Hirschberg.  Acoustic analysis of pathological cries, stridors and coughing sounds in infancy. , 1980, International journal of pediatric otorhinolaryngology.