TalkLIME: mobile system intervention to improve parent-child interaction for children with language delay

Parent-training is commonly used to support intervention of children with language delay. Unfortunately, parents find it difficult to apply the training to their child in everyday life and often give up on their parent-child interaction. In this work, we propose and evaluate TalkLIME -- a mobile system that provides real-time feedback to improve the parent-child interaction and reinforce parent-training intervention. We first conduct a survey to understand parents' feedback preference for the mobile system and determine that a non-invasive feedback using the mobile phones screen is preferable. TalkLIME was developed to provide real-time feedback through the mobile phone screen while also providing motivation to the parents to consistently continue parent-child interaction through both short-term and long-term goals. A six-weeks user study was conducted with eight parents and their children with language delay. Our results show that the experimental group who used TalkLIME showed a significant improvement in the child's initiation ratio, an important metric in the language development of children.

[1]  Inseok Hwang,et al.  TalkBetter: family-driven mobile intervention care for children with language delay , 2014, CSCW.

[2]  Umit Yapanel,et al.  Reliability of the LENA Language Environment Analysis System in Young Children’s Natural Home Environment , 2009 .

[3]  Eric C. Larson,et al.  BiliCam: using mobile phones to monitor newborn jaundice , 2014, UbiComp Adjunct.

[4]  Svetha Venkatesh,et al.  TOBY: early intervention in autism through technology , 2013, CHI.

[5]  Ann P. Kaiser,et al.  Training Parents as Milieu Language Teachers , 1992 .

[6]  Jörg Müller,et al.  Changing Family Practices with Assistive Technology: MOBERO Improves Morning and Bedtime Routines for Children with ADHD , 2016, CHI.

[7]  김윤정,et al.  한국어 불규칙용언의 형태 정보 , 2001 .

[8]  이윤경,et al.  표현언어발달지체 영유아의 대화차례 주고받기 특성 , 2013 .

[9]  Gerald Friedland,et al.  Live speaker identification in conversations , 2008, ACM Multimedia.

[10]  A. Eriks-Brophy,et al.  Issues in Research on Children With Early Language Delay , 2007 .

[12]  Ann P. Kaiser,et al.  The Effects of Parent-Implemented Enhanced Milieu Teaching on the Social Communication of Children Who Have Autism , 2000 .

[13]  Yi Zhang,et al.  Robust Children and Adults Speech Classification , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[14]  김영태,et al.  단순언어장애 아동의 대화 말차례 특성 , 2001 .

[15]  John Kim,et al.  Robot-based augmentative and alternative communication for nonverbal children with communication disorders , 2014, UbiComp.

[16]  Rhea Paul,et al.  Communicative initiations in normal and late-talking toddlers , 1991, Applied Psycholinguistics.

[17]  M J Moseley,et al.  Mother-child interaction with preschool language-delayed children: structuring conversations. , 1990, Journal of communication disorders.

[18]  Jonathan M. Campbell,et al.  Peabody Picture Vocabulary Test , 2010 .

[19]  Matthew S. Goodwin,et al.  Exploring speech therapy games with children on the autism spectrum , 2009, INTERSPEECH.

[20]  Mickael Rouvier,et al.  An open-source state-of-the-art toolbox for broadcast news diarization , 2013, INTERSPEECH.

[21]  Lynne E. Hewitt,et al.  Children with Specific Language Impairment , 2002 .

[22]  Uichin Lee,et al.  FamiLync: facilitating participatory parental mediation of adolescents' smartphone use , 2015, UbiComp.

[23]  Leslie Rescorla,et al.  Age 13 language and reading outcomes in late-talking toddlers. , 2005, Journal of speech, language, and hearing research : JSLHR.

[24]  J. Reznick,et al.  Early lexical acquisition: rate, content, and the vocabulary spurt , 1990, Journal of Child Language.

[25]  Brooke Ingersoll,et al.  Including Parent Training in the Early Childhood Special Education Curriculum for Children With Autism Spectrum Disorders , 2006 .

[26]  Leslie S. Liu,et al.  Improving communication and social support for caregivers of high-risk infants through mobile technologies , 2011, CSCW.

[27]  L. Siegel,et al.  The behavioral and linguistic interactions of specifically language-delayed and normal boys with their mothers. , 1985, Child development.

[28]  Douglas A. Reynolds,et al.  Speaker identification and verification using Gaussian mixture speaker models , 1995, Speech Commun..

[29]  Larry P. Heck,et al.  MSR Identity Toolbox v1.0: A MATLAB Toolbox for Speaker Recognition Research , 2013 .

[30]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[31]  Driss Matrouf,et al.  State-of-the-Art Performance in Text-Independent Speaker Verification Through Open-Source Software , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[32]  Christopher Frauenberger,et al.  Scaffolding the scaffolding: Supporting children's social-emotional learning at home , 2016, CSCW.

[33]  J. Law,et al.  Speech and language therapy interventions for children with primary speech and language delay or disorder. , 2003, The Cochrane database of systematic reviews.

[34]  Paul Johns,et al.  In situ cues for ADHD parenting strategies using mobile technology , 2014, PervasiveHealth.