AVIM - A contactless system for infant data acquisition and analysis: Software architecture and first results

Abstract Traditional techniques for the diagnosis of neurological disorders are recently complemented by contact-less methods that provide a semi-quantitative assessment of the patient status. In this framework, the assessment of infant's behaviour based on the analysis of audio and video recordings is appealing thanks to its unobtrusiveness and to the affordable costs of the equipment. This paper presents the architecture of a system, named AVIM, conceived for supporting clinical diagnosis in newborns with contact-less techniques. Its most innovative aspect is the ability of merging in a single tool the management of medical records and reports, audio/video data acquisition, handling and analysis, editing and filling out customized tests. Moreover, unlike other commercial or open source software tools, AVIM allows adding markers and notes while recording audio and video signals and provides detailed reports with both perceptual scores and acoustical and kinematical parameters of clinical interest computed through dedicated innovative techniques. AVIM is therefore a unique and flexible system that could successfully support the clinician during the entire process from the acquisition of the signals to the results. In addition to providing an appreciable decrease in investigation time, costs and errors, AVIM could support the diagnosis integrating clinicians’ qualitative analysis, based on subjective skills, with objective measurements. To highlight its capabilities, AVIM is applied here to the management and analysis of personal and clinical data of newborns audio/video recorded in 5 time points from 10 days to the 24th week of age, according to a specific protocol. Patient data, results of customized tests, tables and plots are provided in a user-friendly environment.

[1]  Gianluca Esposito,et al.  Developmental changes in the fundamental frequency (f0) of infants’ cries: a study of children with Autism Spectrum Disorder , 2010 .

[2]  Claudia Manfredi,et al.  Testing software tools with synthesized deviant voices for medicolegal assessment of occupational dysphonia , 2014, Biomed. Signal Process. Control..

[3]  Leonardo Bocchi,et al.  Automatic newborn cry analysis: A Non-invasive tool to help autism early diagnosis , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Thomas Schmitz-Rode,et al.  Introduction of a method for quantitative evaluation of spontaneous motor activity development with age in infants , 2012, Experimental Brain Research.

[5]  Stiliyan Kalitzin,et al.  Automatic Segmentation of Episodes Containing Epileptic Clonic Seizures in Video Sequences , 2012, IEEE Transactions on Biomedical Engineering.

[6]  Xiaoxue Li,et al.  A flexible analysis tool for the quantitative acoustic assessment of infant cry. , 2013, Journal of speech, language, and hearing research : JSLHR.

[7]  Leonardo Bocchi,et al.  Early Diagnosis of Autism Spectrum Disorders – Design of the Data Acquisition and Management System , 2011 .

[8]  Alexander Refsum Jensenius,et al.  Using computer-based video analysis in the study of fidgety movements. , 2009, Early human development.

[9]  A. Christophe,et al.  Newborns' Cry Melody Is Shaped by Their Native Language , 2009, Current Biology.

[10]  Michael P. Robb,et al.  Acoustic estimates of respiration in the pain cries of newborns. , 2011, International journal of pediatric otorhinolaryngology.

[11]  B. Hopkins,et al.  A qualitative approach to the development of movements during early infancy , 1984 .

[12]  Gentaro Taga,et al.  Increasing selectivity of interlimb coordination during spontaneous movements in 2- to 4-month-old infants , 2012, Experimental Brain Research.

[13]  Claudia Manfredi,et al.  Effective pre-processing of long term noisy audio recordings: An aid to clinical monitoring , 2013, Biomed. Signal Process. Control..

[14]  K. Wermke,et al.  Developmental aspects of infant's cry melody and formants. , 2002, Medical engineering & physics.

[15]  Christa Einspieler,et al.  Prechtl's assessment of general movements: a diagnostic tool for the functional assessment of the young nervous system. , 2005, Mental retardation and developmental disabilities research reviews.

[16]  Susan Goldin-Meadow,et al.  Learning to talk in a gesture-rich world: Early communication in Italian vs. American children , 2008, First language.

[17]  Richard Kronland-Martinet,et al.  Analysis of Sound Patterns through Wavelet transforms , 1987, Int. J. Pattern Recognit. Artif. Intell..

[18]  Peter Wermke,et al.  Cry Melody in 2-Month-Old Infants with and without Clefts , 2011, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[19]  G Rau,et al.  Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. , 2006, Human movement science.

[20]  Claudia Manfredi,et al.  Advanced Tools for Clinical Diagnosis of Autism Spectrum Disorders , 2014, HEALTHINF 2014.

[21]  Giovanni Cioni,et al.  Comprar Prechtls Method on the Qualitative Assessment of General Movements in Preterm, Term and Young Infants + CDROM | Giovanni Cioni | 9781898683629 | Mac Keith Press , 2008 .

[22]  Matti Lehtihalmes,et al.  Early vocalization of preterm infants with extremely low birth weight (ELBW), part II: from canonical babbling up to the appearance of the first word , 2012, Clinical linguistics & phonetics.

[23]  Peter B Marschik,et al.  Does a detailed assessment of poor repertoire general movements help to identify those infants who will develop normally? , 2006, Early human development.

[24]  Gentaro Taga,et al.  Specific characteristics of spontaneous movements in preterm infants at term age are associated with developmental delays at age 3 years , 2013, Developmental medicine and child neurology.

[25]  Chakib Tadj,et al.  Resonance frequencies behavior in pathologic cries of newborns. , 2015, Journal of voice : official journal of the Voice Foundation.

[26]  Esther Thelen,et al.  Three-Month-Old Infants Can Learn Task-Specific Patterns of Interlimb Coordination , 1994 .

[27]  R. Landa,et al.  Head lag in infants at risk for autism: a preliminary study. , 2012, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[28]  Dror Lederman,et al.  Classification of cries of infants with cleft-palate using parallel hidden Markov models , 2008, Medical & Biological Engineering & Computing.

[29]  G Cioni,et al.  General movements in infants with autism spectrum disorders. , 2008, Georgian medical news.

[30]  Markus Gugatschka,et al.  Early speech–language development in females with Rett syndrome: focusing on the preserved speech variant , 2012, Developmental medicine and child neurology.

[31]  Sven Bölte,et al.  Eye tracking in early autism research , 2013, Journal of Neurodevelopmental Disorders.

[32]  Daniel S. Messinger,et al.  Brief Report: Atypical Expression of Distress During the Separation Phase of the Strange Situation Procedure in Infant Siblings at High Risk for ASD , 2014, Journal of autism and developmental disorders.

[33]  Gianluca Esposito,et al.  A qualitative analysis of crying and vocal distress in children with autism , 2004 .

[34]  Mijna Hadders-Algra,et al.  General movements: A window for early identification of children at high risk for developmental disorders. , 2004, The Journal of pediatrics.

[35]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[36]  Leonardo Bocchi,et al.  Central blood oxygen saturation vs crying in preterm newborns , 2012, Biomed. Signal Process. Control..

[37]  L. Bocchi,et al.  A Robust Tool for Newborn Infant Cry Analysis , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Michael P Robb,et al.  Sudden infant death syndrome: cry characteristics. , 2013, International journal of pediatric otorhinolaryngology.

[39]  J. Price,et al.  Language and communication development in Down syndrome. , 2007, Mental retardation and developmental disabilities research reviews.

[40]  Jean Schoentgen,et al.  Low-frequency vocal modulations in vowels produced by Parkinsonian subjects , 2008, Speech Commun..

[41]  Gianluca Esposito,et al.  Componential deconstruction of infant distress vocalizations via tree-based models: a study of cry in autism spectrum disorder and typical development. , 2013, Research in developmental disabilities.

[42]  G. Baranek.  Autism During Infancy: A Retrospective Video Analysis of Sensory-Motor and Social Behaviors at 9–12 Months of Age , 1999, Journal of autism and developmental disorders.

[43]  C. Manfredi,et al.  Tridimensional assessment of adductor spasmodic dysphonia pre- and post-treatment with Botulinum toxin , 2011, European Archives of Oto-Rhino-Laryngology.

[44]  K. Wermke,et al.  Development of the vocal fundamental frequency of spontaneous cries during the first 3 months. , 2002, International journal of pediatric otorhinolaryngology.

[45]  Marcio Nogueira de Souza,et al.  Longitudinal study of the fundamental frequency of hunger cries along the first 6 months of healthy babies. , 2007, Journal of voice : official journal of the Voice Foundation.

[46]  Lars Adde,et al.  Inter-observer reliability of the "Assessment of Motor Repertoire--3 to 5 Months" based on video recordings of infants. , 2009, Early human development.

[47]  Giovanni Cioni,et al.  Prechtl's Method on the Qualitative Assessment of General Movements in Preterm, Term and Young Infants , 2004 .

[48]  Carlos A. Reyes García,et al.  Automatic infant cry analysis for the identification of qualitative features to help opportune diagnosis , 2012, Biomed. Signal Process. Control..

[49]  Craig Newschaffer,et al.  The Study to Explore Early Development (SEED): A Multisite Epidemiologic Study of Autism by the Centers for Autism and Developmental Disabilities Research and Epidemiology (CADDRE) Network , 2012, Journal of Autism and Developmental Disorders.

[50]  G Cioni,et al.  Qualitative changes of general movements in preterm infants with brain lesions. , 1990, Early human development.

[51]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[52]  C Manfredi,et al.  A comparative analysis of fundamental frequency estimation methods with application to pathological voices. , 2000, Medical engineering & physics.

[53]  Yaohua Xiong,et al.  Computerized Motion Analysis of Videotaped Neonatal Seizures of Epileptic Origin , 2005, Epilepsia.

[54]  C Manfredi,et al.  High-resolution cry analysis in preterm newborn infants. , 2009, Medical engineering & physics.

[55]  A Fort,et al.  Acoustic analysis of newborn infant cry signals. , 1998, Medical engineering & physics.

[56]  B. Lester,et al.  Atypical Cry Acoustics in 6‐Month‐Old Infants at Risk for Autism Spectrum Disorder , 2012, Autism research : official journal of the International Society for Autism Research.

[57]  Øyvind Stavdahl,et al.  ENIGMA - Enhanced interactive general movement assessment , 2008, Expert Syst. Appl..

[58]  M Robb,et al.  Vocal fundamental frequency characteristics of infant hunger cries: birth to 12 months. , 1996, International journal of pediatric otorhinolaryngology.

[59]  A Fort,et al.  Parametric and non-parametric estimation of speech formants: application to infant cry. , 1996, Medical engineering & physics.

[60]  J. Iverson,et al.  Variation in Vocal-Motor Development in Infant Siblings of Children with Autism , 2007, Journal of autism and developmental disorders.

[61]  H. Rothgänger,et al.  Analysis of the sounds of the child in the first year of age and a comparison to the language. , 2003, Early human development.