Automatic Assessment of Infants' Levels-of-Distress from the Cry Signals

It has long been an attractive prospect to monitor and assess infants' physical and emotional well-being by analyz- ing their cries. The feasibility of such an approach depends on the introduction of modern computer signal processing technology into infant cry research. In this paper, we first discuss the issue of quantifying the distress level of infants. We propose the use of a single item-the level of distress (L0D)-to describe parents' perceptual assess- ment of infants' distress situation from cry sounds. Then, we introduce the concept of cry modes and cry mode sequences to efficiently represent the time-frequency characteristics of infant cries. With the introduction of the cry mode representation scheme, a composite parameter-the H -value-is established as a descrip- tor of the LOD. The H-value can be derived from the cry sound signal. In our experiment, the H-value showed strong consistency with the parents' LOD rating. Finally, an automatic cry analysis system based on hidden Markov models (HMM's) is explained. This system automatically estimates the W-value from a cry sound signal. Testing with 58 different cries uttered by infants under various degrees of stimulation has shown that this HMM-based system is able to give assessments of the distress level of infants consistent with the perceptions of experienced parents. This work provides the basis for the design of automated devices for the monitoring and evaluation of cries of normal and sick infants.

[1]  Kenneth D. Craig,et al.  Neonatal facial and cry responses to invasive and non-invasive procedures , 1990, Pain.

[2]  K. Craig,et al.  Judgment of pain in newborns: Facial activity and cry as determinants. , 1988 .

[3]  M. E. Owens.  Pain in infancy: Conceptual and methodological issues , 1984, Pain.

[4]  John Lind,et al.  CRY MOTIONS OF THE NEWBORN INFANT , 1965 .

[5]  G. Gustafson,et al.  On the importance of fundamental frequency and other acoustic features in cry perception and infant development. , 1989, Child development.

[6]  Y Horii,et al.  Spectral energy distribution in four types of infant vocalizations. , 1988, Journal of communication disorders.

[7]  K. Michelsson,et al.  Cry analysis in congenital hypothyroidism. , 1976, Folia phoniatrica.

[8]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[9]  K S Harris,et al.  Newborn infant cry and nonhuman primate vocalization. , 1971, Journal of speech and hearing research.

[10]  J. Levine,et al.  Pain in prelingual children and its evaluation by pain-induced vocalization , 1982, Pain.

[11]  Barry M. Lester,et al.  A biosocial model of infant crying , 1984 .

[12]  J. Kirkland,et al.  Discrimination of Infants' Cry-Signals , 1979, Perceptual and motor skills.

[13]  K. Michelsson,et al.  CRY ANALYSES OF SYMPTOMLESS LOW BIRTH WEIGHT NEONATES AND OF ASPHYXIATED NEWBORN INFANTS , 1971, Acta paediatrica Scandinavica. Supplement.

[14]  J. Lind,et al.  CRY SOUNDS OF THE NEWBORN INFANT 1, 2 , 1965 .

[15]  Peter F. Ostwald,et al.  The Communicative and Diagnostic Significance of Infant Sounds , 1985 .

[16]  Kai-Fu Lee,et al.  Automatic Speech Recognition , 1989 .

[17]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[18]  Y Horii,et al.  Differences in fundamental frequency, jitter, and shimmer among four types of infant vocalizations. , 1986, Journal of communication disorders.

[19]  B. Lester,et al.  Acoustic features and auditory perceptions of the cries of newborns with prenatal and perinatal complications. , 1978, Child development.

[20]  Michael J. Corwin,et al.  A Physioacoustic Model of the Infant Cry , 1985 .

[21]  Kenneth D. Craig,et al.  Pain in the preterm neonate: behavioural and physiological indices , 1993, Pain.

[22]  K. Craig,et al.  Neonatal pain perception and behavioral measurement , 1993 .

[23]  R Prescott,et al.  Infant cry sound; developmental features. , 1975, The Journal of the Acoustical Society of America.

[24]  A. Murray.  Infant crying as an elicitor of parental behavior: an examination of two models. , 1979, Psychological bulletin.

[25]  J. Picone,et al.  Continuous speech recognition using hidden Markov models , 1990, IEEE ASSP Magazine.

[26]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[27]  M. Brennan,et al.  Perceptual Dimensions of Infant Cry Signals: A Semantic Differential Analysis , 1983, Perceptual and motor skills.

[28]  K. Michelsson,et al.  Sound-spectrographic cry analysis of normal and abnormal newborn infants. A review and a recommendation for standardization of the cry characteristics. , 1976, Folia phoniatrica.

[29]  K. Michelsson,et al.  Sound Spectrographic Cry Analysis of Infants with Bacterial Meningitis , 1977, Developmental medicine and child neurology.