A Simple Web Utility for Automatic Speech Quantification in Dyadic Reading Interactions

Adult-child reading interactions can produce efficient childhood learning outcomes when formal methods of adult-initiated prompting and dialog are employed. In order to quantify instances of such prompting, child development researchers often manually code speech recordings or transcripts taken from adult-child readings, which can be a laborious process. For researchers, it would therefore be valuable to have the capacity to automatically capture quantitative measures of communication from adult-child reading interactions. This paper introduces SoundCount, a new open-source utility for extracting descriptive features from recordings of speech during communication between an adult and child reading an eBook together. In a simple web-based framework, SoundCount consolidates functionalities for speech analysis and quantification in the context of dyadic reading interactions, specifically providing measures related to word count and speaker differentiation. Our preliminary results demonstrate the functional feasibility of SoundCount, and our technical discussion will enable readers to use SoundCount in their own research. Given the technical viability of SoundCount, future work will include the implementation of additional measures for the system, new features such as automated audio segmentation based on speaker, and a test of the efficacy of real-time feedback systems based on speech measures.

[1]  Tim Green,et al.  The Use of eReaders in the Classroom and at Home to Help Third-grade Students Improve their Reading and English/ Language Arts Standardized Test Scores , 2015, TechTrends.

[2]  P. Veugelers,et al.  The use of entertainment and communication technologies before sleep could affect sleep and weight status: a population-based study among children , 2017, International Journal of Behavioral Nutrition and Physical Activity.

[3]  Joshua W. Wade,et al.  A new measure of child vocal reciprocity in children with autism spectrum disorder , 2018, Autism research : official journal of the International Society for Autism Research.

[4]  Paul D. Ellis,et al.  The essential guide to effect sizes : statistical power, meta-analysis, and the interpretation of research results , 2010 .

[5]  Monique Sénéchal,et al.  A book reading intervention with preschool children who have limited vocabularies: the benefits of regular reading and dialogic reading , 2000 .

[6]  G. Whitehurst,et al.  Accelerating Language Development through Picture Book Reading. , 1988 .

[7]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[8]  Ilene S. Schwartz,et al.  A Modified Dialogic Reading Intervention for Preschool Children With Autism Spectrum Disorder , 2017 .

[9]  Alexander I. Rudnicky,et al.  Pocketsphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[10]  Grover J. Whitehurst,et al.  Dialogic reading: A shared picture book reading intervention for preschoolers. , 2003 .