HomeBank: An Online Repository of Daylong Child-Centered Audio Recordings

HomeBank is introduced here. It is a public, permanent, extensible, online database of daylong audio recorded in naturalistic environments. HomeBank serves two primary purposes. First, it is a repository for raw audio and associated files: one database requires special permissions, and another redacted database allows unrestricted public access. Associated files include metadata such as participant demographics and clinical diagnostics, automated annotations, and human-generated transcriptions and annotations. Many recordings use the child-perspective LENA recorders (LENA Research Foundation, Boulder, Colorado, United States), but various recordings and metadata can be accommodated. The HomeBank database can have both vetted and unvetted recordings, with different levels of accessibility. Additionally, HomeBank is an open repository for processing and analysis tools for HomeBank or similar data sets. HomeBank is flexible for users and contributors, making primary data available to researchers, especially those in child development, linguistics, and audio engineering. HomeBank facilitates researchers' access to large-scale data and tools, linking the acoustic, auditory, and linguistic characteristics of children's environments with a variety of variables including socioeconomic status, family characteristics, language trajectories, and disorders. Automated processing applied to daylong home audio recordings is now becoming widely used in early intervention initiatives, helping parents to provide richer speech input to at-risk children.

[1]  Brian MacWhinney,et al.  The Talkbank Project , 2007 .

[2]  John H. L. Hansen,et al.  Automatic childhood autism detection by vocalization decomposition with phone-like units , 2009, WOCCI.

[3]  B. MacWhinney.  The CHILDES project: tools for analyzing talk , 1992 .

[4]  D K Oller,et al.  Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development , 2010, Proceedings of the National Academy of Sciences.

[5]  Umit Yapanel,et al.  The LENA TM Language Environment Analysis System: The Interpreted Time Segments (ITS) File , 2009 .

[6]  Christine Yoshinaga-Itano,et al.  Using Language ENvironment Analysis to Improve Outcomes for Children Who Are Deaf or Hard of Hearing , 2012, Seminars in Speech and Language.

[7]  J. Iverson,et al.  Maternal verbal responses to communication of infants at low and heightened risk of autism , 2014, Autism : the international journal of research and practice.

[8]  Jill Gilkerson,et al.  A Social Feedback Loop for Speech Development and Its Reduction in Autism , 2014, Psychological science.

[9]  R. Brown,et al.  A First Language , 1973 .

[10]  Campbell Leaper,et al.  Mothers' and Fathers' Questions to Their Child in Mexican-Descent Families: Moderators of Cognitive Demand During Play , 1997 .

[11]  C. A. Ferguson,et al.  Talking to Children: Language Input and Acquisition , 1979 .

[12]  D. Suskind,et al.  Parent-Directed Approaches to Enrich the Early Language Environments of Children Living in Poverty , 2013, Seminars in Speech and Language.

[13]  D. Oller,et al.  Infant babbling and speech , 1976, Journal of Child Language.

[14]  Mary Pat Moeller,et al.  Linguistic Input, Electronic Media, and Communication Outcomes of Toddlers With Hearing Loss , 2014, Ear and hearing.

[15]  John H. L. Hansen,et al.  UT-Scope: Towards LVCSR under Lombard effect induced by varying types and levels of noisy background , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Mark VanDam.  Acoustic characteristics of the clothes used for a wearable recording device. , 2014, The Journal of the Acoustical Society of America.

[17]  J. Gilkerson,et al.  Teaching by Listening: The Importance of Adult-Child Conversations to Language Development , 2009, Pediatrics.

[18]  A. Fernald,et al.  A cross-language study of prosodic modifications in mothers' and fathers' speech to preverbal infants , 1989, Journal of Child Language.

[19]  Sebastian Wallot,et al.  Using nonlinear methods to quantify changes in infant limb movements and vocalizations , 2014, Front. Psychol..

[20]  S. Suter.  Meaningful differences in the everyday experience of young American children , 2005, European Journal of Pediatrics.

[21]  Hung Thai-Van,et al.  Reliability of the Language ENvironment Analysis system (LENA™) in European French , 2015, Behavior Research Methods.

[22]  Campbell Leaper,et al.  Parent-child conversations about science: the socialization of gender inequities? , 2003, Developmental psychology.

[23]  Sara Harkness.  Cultural Variation in Mothers’ Language , 1971 .

[24]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[25]  Paul De Palma,et al.  Fathers' use of fundamental frequency in motherese , 2015 .

[26]  J. Gilkerson,et al.  Vocal interaction dynamics of children with and without autism , 2010 .

[27]  Dongxin Xu,et al.  The LENA TM Automatic Vocalization Assessment , 2009 .

[28]  Dongxin Xu,et al.  Automated Vocal Analysis of Children With Hearing Loss and Their Typical and Atypical Peers , 2015, Ear and hearing.

[29]  Anne Fernald,et al.  Talking to Children Matters , 2013, Psychological science.

[30]  M. Soderstrom,et al.  When Do Caregivers Talk? The Influences of Activity and Time of Day on Caregiver Speech and Child Vocalizations in Two Childcare Environments , 2013, PloS one.

[31]  Mary Pat Moeller,et al.  Analyses of fundamental frequency in infants and preschoolers with hearing loss. , 2010 .

[32]  A W LYNIP,et al.  The use of magnetic devices in the collection and analysis of the preverbal utterances of an infant. , 1951, Genetic psychology monographs.

[33]  Paul Boersma.  The use of Praat in corpus research , 2014 .

[34]  Robyn Fivush,et al.  Parental Styles of Talking About the Past , 1993 .

[35]  Campbell Leaper,et al.  Gender effects on Mexican-descent parents' questions and scaffolding during toy play: a sequential analysis , 1998 .

[36]  Rebecca J. Panagos.  Meaningful Differences in the Everyday Experience of Young American Children , 1998 .

[37]  Betty Vohr,et al.  Importance of Parent Talk on the Development of Preterm Infant Vocalizations , 2011, Pediatrics.

[38]  Noah H. Silbert,et al.  Precision and error of automatic speech recognition , 2013 .

[39]  Michael C. Frank,et al.  Predicting the birth of a spoken word , 2015, Proceedings of the National Academy of Sciences.

[40]  C. Berends,et al.  The LENA System in Parent-Child Interaction in Dutch Preschool Children with Language Delay , 2015 .

[41]  John H. L. Hansen,et al.  Automatic assessment of language background in toddlers through phonotactic and pitch pattern modeling of short vocalizations , 2014, WOCCI.

[42]  Todd Wareham,et al.  Introducing Phon: A Software Solution for the Study of Phonological Acquisition. , 2006, Proceedings of the ... Annual Boston University Conference on Language Development. Boston University Conference on Language Development.

[43]  C. A. Ferguson,et al.  Talking to Children , 1977 .

[44]  Betty Vohr,et al.  Gender Differences in Adult-Infant Communication in the First Months of Life , 2014, Pediatrics.

[45]  John H. L. Hansen,et al.  Signal processing for young child speech language development , 2008, WOCCI.

[46]  E. Hoff-Ginsberg,et al.  Some contributions of mothers' speech to their children's syntactic growth , 1985, Journal of Child Language.

[47]  Dongxin Xu,et al.  The LENA , 2009 .

[48]  A. Karmiloff-Smith.  Development itself is the key to understanding developmental disorders , 1998, Trends in Cognitive Sciences.

[49]  Dongxin Xu,et al.  Automated analysis of child phonetic production using naturalistic recordings. , 2014, Journal of speech, language, and hearing research : JSLHR.

[50]  Clinton Freeman,et al.  Toward Open Behavioral Science , 2012, Psychological inquiry.

[51]  D. Oller.  The emergence of the speech capacity , 2000 .

[52]  Paul De Palma,et al.  Fundamental frequency of child-directed speech using automatic speech recognition , 2014, 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS).

[53]  Lynip Aw,et al.  The use of magnetic devices in the collection and analysis of the preverbal utterances of an infant. , 1951 .

[54]  G. Wells.  Describing Children's Linguistic Development at Home and at School , 1979 .

[55]  J. Michael.  Verbal behavior. , 1984, Journal of the experimental analysis of behavior.

[56]  M. Soderstrom,et al.  Entrainment of prosody in the interaction of mothers with their young children* , 2015, Journal of Child Language.

[57]  J. Brady,et al.  The Belmont Report. Ethical principles and guidelines for the protection of human subjects of research. , 2014, The Journal of the American College of Dentists.

[58]  Noam Chomsky,et al.  A Review of B. F. Skinner's Verbal Behavior , 1980 .

[59]  Michelle M. Garrison,et al.  Audible television and decreased adult words, infant vocalizations, and conversational turns: a population-based study. , 2009, Archives of pediatrics & adolescent medicine.

[60]  L. Petitto,et al.  Biological Foundations of Language , 1967, Neurology.

[61]  Dwight W. Irvin,et al.  Using the Language Environment Analysis (LENA) system in preschool classrooms with children with autism spectrum disorders , 2013, Autism : the international journal of research and practice.

[62]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[63]  Deb Roy,et al.  Fast transcription of unstructured audio recordings , 2009, INTERSPEECH.

[64]  Hal Hodson.  Automatic voice coach gives conversation tips to parents , 2014 .

[65]  S. Warren,et al.  What Automated Vocal Analysis Reveals About the Vocal Production and Language Learning Environment of Young Children with Autism , 2010, Journal of autism and developmental disorders.

[66]  Michael C. Frank,et al.  Relating Activity Contexts to Early Word Learning in Dense Longitudinal Data , 2012, CogSci.