Effects of robots’ intonation and bodily appearance on robot-mediated communicative treatment outcomes for children with autism spectrum disorder

Previous research has suggested that robot-mediated therapy is effective in the treatment of children with Autism Spectrum Disorder (ASD), but not all robots seem equally appropriate for this purpose. We investigated in an exploratory study whether a robot’s intonation (monotonous vs. normal) and bodily appearance (mechanical vs. humanized) influence the treatment outcomes of Pivotal Response Treatment (PRT) sessions for children with ASD. The children (age range 4–8 years) played puzzle games with a robot which required communication with the robot. The treatment outcomes were measured in terms of both task performance and affective states. We have found that intonation and bodily appearance have an effect on children’s affective states but not on task performance. Specifically, humanized bodily appearance leads to more positive affective states in general and a higher degree of interest in the interaction than mechanical bodily appearance. Congruence between bodily appearance and intonation triggers a higher degree of happiness in children with ASD than incongruence between these two factors.

[1]  D. Cicchetti.  Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[2]  Emilia I. Barakova,et al.  End-user programming architecture facilitates the uptake of robots in social therapies , 2013, Robotics Auton. Syst..

[3]  Aude Billard,et al.  Robota: Clever toy and educational tool , 2003, Robotics Auton. Syst..

[4]  L. Trainor,et al.  Use of Prosody and Information Structure in High Functioning Adults with Autism in Relation to Language Ability , 2012, Front. Psychology.

[5]  L. Koegel,et al.  Improving Motivation for Academics in Children with Autism , 2010, Journal of autism and developmental disorders.

[6]  Aubyn C. Stahmer,et al.  Child Demographics Associated With Outcomes in a Community-Based Pivotal Response Training Program , 2007 .

[7]  B. Robins,et al.  Does appearance matter in the interaction of children with autism with a humanoid robot , 2006 .

[8]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[9]  Brian Scassellati,et al.  How Social Robots Will Help Us to Diagnose, Treat, and Understand Autism , 2005, ISRR.

[10]  Rachel A Robbins,et al.  A Review and Clarification of the Terms “holistic,” “configural,” and “relational” in the Face Perception Literature , 2012, Front. Psychology.

[11]  D. Geschwind,et al.  Disentangling the heterogeneity of autism spectrum disorder through genetic findings , 2014, Nature Reviews Neurology.

[12]  F. Passetti,et al.  Discrimination in Autism Within Different Sensory Modalities , 2006, Journal of autism and developmental disorders.

[13]  R. Horner,et al.  The relationship between predictability and problem behavior for students with severe disabilities , 1994 .

[14]  M. H. Charlop-Christy,et al.  A Comparison of Video Modeling with In Vivo Modeling for Teaching Children with Autism , 2000, Journal of autism and developmental disorders.

[15]  Aoju Chen,et al.  Acquiring Complex Focus-Marking: Finnish 4- to 5-Year-Olds Use Prosody and Word Order in Interaction , 2016, Front. Psychol..

[16]  A. Billard,et al.  Building Robota, a Mini-Humanoid Robot for the Rehabilitation of Children With Autism , 2007, Assistive technology : the official journal of RESNA.

[17]  J. Hendriksen,et al.  WPPSI-III-NL Wechsler Preschool and Primary Scale of Intelligence; Nederlandse bewerking , 2009 .

[18]  Maja J. Matarić,et al.  Towards Socially Assistive Robotics , 2006 .

[19]  Maja J. Mataric,et al.  Toward Socially Assistive Robotics for Augmenting Interventions for Children with Autism Spectrum Disorders , 2008, ISER.

[20]  Emilia I. Barakova,et al.  Long‐term LEGO therapy with humanoid robot for children with ASD , 2015, Expert Syst. J. Knowl. Eng..

[21]  Cindy L. Bethel,et al.  A Survey of Using Vocal Prosody to Convey Emotion in Robot Speech , 2016, Int. J. Soc. Robotics.

[22]  Russell Lang,et al.  Pivotal Response Treatment for Children with Autism Spectrum Disorders: A Systematic Review , 2013, Review Journal of Autism and Developmental Disorders.

[23]  Emilia I. Barakova,et al.  User-Friendly Robot Environment for Creation of Social Scenarios , 2011, IWINAC.

[24]  Bram Vanderborght,et al.  How do typically developing children and children with autism perceive different social robots? , 2014, Comput. Hum. Behav..

[25]  R. Koegel,et al.  Motivating autistic children. , 1979, Journal of abnormal psychology.

[26]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[27]  Wayne W. Fisher,et al.  Handbook of Applied Behavior Analysis , 2011, Autism and Child Psychopathology Series.

[28]  Juhani Järvikivi,et al.  Intonational marking of focus in different word orders in German children , 2011 .

[29]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[30]  N. Russo.  Running Head: MULTISENSORY PROCESSING AMONG PERSONS WITH ASD BARKING DOGS AND CHIRPING FROGS: A BEHAVIOUR AND BRAIN EEG STUDY OF MULTISENSORY MATCHING AMONG PERSONS WITH AUTISM SPECTRUM DISORDERS , 2007 .

[31]  F. Ramus,et al.  Enhanced perceptual processing of speech in autism. , 2008, Developmental science.

[32]  C. Dissanayake,et al.  Social Skills and Problem Behaviours in School Aged Children with High-Functioning Autism and Asperger’s Disorder , 2006, Journal of autism and developmental disorders.

[33]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[34]  J. Snedeker,et al.  The use of prosody during syntactic processing in children and adolescents with autism spectrum disorders , 2014, Development and Psychopathology.

[35]  B. Garcia-Zapirain,et al.  Technologies as Support Tools for Persons with Autistic Spectrum Disorder: A Systematic Review , 2014, International journal of environmental research and public health.

[36]  Sue Peppé,et al.  Prosody in autism spectrum disorders: a critical review. , 2003, International journal of language & communication disorders.

[37]  C. Johnson,et al.  Identification and Evaluation of Children With Autism Spectrum Disorders , 2007, Pediatrics.

[38]  L. Kanner.  Autistic disturbances of affective contact. , 1968, Acta paedopsychiatrica.

[39]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[40]  T. Lourens,et al.  Improving Collaborative Play Between Children with Autism Spectrum Disorders and Their Siblings: The Effectiveness of a Robot-Mediated Intervention Based on Lego® Therapy , 2014, Journal of Autism and Developmental Disorders.

[41]  H. Kozima,et al.  Interactive Robots as Facilitators of Childrens Social Development , 2006 .

[42]  K. Dautenhahn,et al.  Towards interactive robots in autism therapy: background, motivation and challenges , 2004 .

[43]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[44]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .