Robot-Assisted Joint Attention: A Comparative Study Between Children With Autism Spectrum Disorder and Typically Developing Children in Interaction With NAO

Robots have been used in joint attention (JA) tasks with children with autism spectrum disorder (ASD). However, very few studies compared JA performance of children with ASD with typically developing children (TD) when interacting with a robotic partner and a traditional human partner. This study aims to: (a) to explore whether there are differences in response to and initiation of JA between ASD and TD children with two interactive partners: an adult and a social robot (NAO); and (b) to explore which characteristics of ASD children predicting their performance in robot-assisted JA tasks. Twenty-seven ASD and forty TD children were involved in this study in which they were exposed to diffident JA tasks. Mixed results were found per type of JA behavior over groups and conditions. Our results show that both ASD and TD children performed better with the human partner than with the robot in response to JA tasks. Among the characteristics of ASD children, ADOS total score is associated with response to JA performance. No significant result related to initiation of JA was found.

[1]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[2]  L. Carver,et al.  Research review: Social motivation and oxytocin in autism--implications for joint attention development and intervention. , 2013, Journal of child psychology and psychiatry, and allied disciplines.

[3]  Connie Kasari,et al.  Joint attention, developmental level, and symptom presentation in autism , 1994, Development and Psychopathology.

[4]  L. Billeci,et al.  Autism and social robotics: A systematic review , 2016, Autism research : official journal of the International Society for Autism Research.

[5]  Tony Charman,et al.  Why is joint attention a pivotal skill in autism? , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  Helen I Cannella-Malone,et al.  Initiating and responding to joint attention bids in children with autism: a review of the literature. , 2011, Research in developmental disabilities.

[7]  N. Sarkar,et al.  Can Robotic Interaction Improve Joint Attention Skills? , 2015, Journal of autism and developmental disorders.

[8]  A. Gulsrud,et al.  Randomized Controlled Caregiver Mediated Joint Engagement Intervention for Toddlers with Autism , 2010, Journal of autism and developmental disorders.

[9]  Tom Ziemke,et al.  How to Build a Supervised Autonomous System for Robot-Enhanced Therapy for Children with Autism Spectrum Disorder , 2017, Paladyn J. Behav. Robotics.

[10]  K. Lowe Effect of a Humanoid Robot During Therapy on Responding to Joint Attention with Children with Autism Spectrum Disorder , 2012 .

[11]  A. Tapus,et al.  Children with Autism Social Engagement in Interaction with Nao, an Imitative Robot - A Series of Single Case Experiments , 2012 .

[12]  Paula K. Shear,et al.  The Relationship Between Joint Attention and Language in Children With Autism Spectrum Disorders , 2008 .

[13]  Pierre Blazevic,et al.  Mechatronic design of NAO humanoid , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  François Michaud,et al.  Assistive Technologies and Children-Robot Interaction , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[15]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[16]  A. Pick,et al.  Effects of gesture and target on 12- and 18-month-olds' joint visual attention to objects in front of or behind them. , 2000, Developmental psychology.

[17]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[18]  G. Dawson Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder , 2008, Development and Psychopathology.

[19]  Daniel O. David,et al.  Developing Joint Attention for Children with Autism in Robot-Enhanced Therapy , 2018, Int. J. Soc. Robotics.

[20]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[21]  Peter Wittenburg,et al.  Annotation by Category: ELAN and ISO DCR , 2008, LREC.

[22]  S. Levy,et al.  Brief Report: The ADOS Calibrated Severity Score Best Measures Autism Diagnostic Symptom Severity in Pre-School Children , 2019, Journal of autism and developmental disorders.

[23]  F Poustka,et al.  [Diagnostic Observation Scale for Autistic Disorders: initial results of reliability and validity]. , 2004, Zeitschrift fur Kinder- und Jugendpsychiatrie und Psychotherapie.

[24]  T. Kanda,et al.  Can we talk to robots? Ten-month-old infants expected interactive humanoid robots to be talked to by persons , 2005, Cognition.

[25]  Early Childhood Predictors of the Social Competence of Adults with Autism , 2011, Journal of autism and developmental disorders.

[26]  Kerstin Dautenhahn,et al.  The effectiveness of using a robotics class to foster collaboration among groups of children with autism in an exploratory study , 2010, Personal and Ubiquitous Computing.

[27]  R. Landa,et al.  Response to Joint Attention in Toddlers at Risk for Autism Spectrum Disorder: A Prospective Study , 2007, Journal of autism and developmental disorders.

[28]  Beatrice Sbriscia-Fioretti,et al.  An integrated EEG and eye-tracking approach for the study of responding and initiating joint attention in Autism Spectrum Disorders , 2017, Scientific Reports.

[29]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[30]  M. Tomasello,et al.  Joint attention, cultural learning, and language acquisition: Implications for autism , 2000 .

[31]  D. Lefeber,et al.  Using the social robot probo as a social story telling agent for children with ASD , 2012 .

[32]  R. Schultz,et al.  The social motivation theory of autism , 2012, Trends in Cognitive Sciences.

[33]  P. Mundy Joint attention and social-emotional approach behavior in children with autism , 1995, Development and Psychopathology.

[34]  Hui Yu,et al.  Robot-Enhanced Therapy: Development and Validation of Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy , 2019, IEEE Robotics & Automation Magazine.

[35]  Herbert Roeyers,et al.  Exploring the Nature of Joint Attention Impairments in Young Children with Autism Spectrum Disorder: Associated Social and Cognitive Skills , 2012, Journal of autism and developmental disorders.

[36]  Holly A. Yanco,et al.  Are Robots Ready to Deliver Autism Interventions? A Comprehensive Review , 2016, International Journal of Social Robotics.

[37]  P. Mundy,et al.  Defining the social deficits of autism: the contribution of non-verbal communication measures. , 1986, Journal of child psychology and psychiatry, and allied disciplines.

[38]  E. Carr,et al.  Multiple Effects of Joint Attention Intervention for Children With Autism , 2006, Behavior modification.

[39]  G. Dawson,et al.  Early Predictors of Communication Development in Young Children with Autism Spectrum Disorder: Joint Attention, Imitation, and Toy Play , 2006, Journal of autism and developmental disorders.

[40]  C. Jacques,et al.  Combined frequency-tagging EEG and eye tracking reveal reduced social bias in boys with autism spectrum disorder , 2019, Cortex.

[41]  Dare A. Baldwin,et al.  Do children with autism use the speaker's direction of gaze strategy to crack the code of language? , 1997, Child development.

[42]  Claire A. G. J. Huijnen,et al.  Mapping Robots to Therapy and Educational Objectives for Children with Autism Spectrum Disorder , 2016, Journal of Autism and Developmental Disorders.

[43]  G. Dawson,et al.  Early social attention impairments in autism: social orienting, joint attention, and attention to distress. , 2004, Developmental psychology.

[44]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[45]  B. Vanderborght,et al.  Enhancing play skills, engagement and social skills in a play task in ASD children by using robot-based interventions. A pilot study , 2014 .

[46]  Rajesh P. N. Rao,et al.  "Social" robots are psychological agents for infants: A test of gaze following , 2010, Neural Networks.

[47]  Andrea C. Pierno,et al.  Robotic movement elicits visuomotor priming in children with autism , 2008, Neuropsychologia.

[48]  B. E. Gridley,et al.  Review of the Bayley Scales of Infant Development—Second edition , 1994 .

[49]  Connie Kasari,et al.  Language outcome in autism: randomized comparison of joint attention and play interventions. , 2008, Journal of consulting and clinical psychology.

[50]  Agnieszka Wykowska,et al.  Robot-Assisted Training of Joint Attention Skills in Children Diagnosed with Autism , 2015, ICSR.

[51]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[52]  François Michaud,et al.  Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism , 2008, Auton. Robots.

[53]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[54]  Bruno Maisonnier,et al.  Choregraphe: a graphical tool for humanoid robot programming , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[55]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[56]  Luthffi Idzhar Ismail,et al.  Initial Response in HRI- a Case Study on Evaluation of Child with Autism Spectrum Disorders Interacting with a Humanoid Robot NAO , 2012 .

[57]  Nilanjan Sarkar,et al.  Pilot clinical application of an adaptive robotic system for young children with autism , 2014, Autism : the international journal of research and practice.

[58]  M. Gernsbacher,et al.  A comparison of contexts for assessing joint attention in toddlers on the autism spectrum , 2008, Autism : the international journal of research and practice.

[59]  Azusa Saito,et al.  The development of an assistive robot for improving the joint attention of autistic children , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[60]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.