Differences in Spontaneous Interactions of Autistic Children in an Interaction With an Adult and Humanoid Robot

Robots are promising tools for promoting engagement of autistic children in interventions and thereby increasing the amount of learning opportunities. However, designing deliberate robot behavior aimed at engaging autistic children remains challenging. Our current understanding of what interactions with a robot, or facilitated by a robot, are particularly motivating to autistic children is limited to qualitative reports with small sample sizes. Translating insights from these reports to design is difficult due to the large individual differences among autistic children in their needs, interests, and abilities. To address these issues, we conducted a descriptive study and report on an analysis of how 31 autistic children spontaneously interacted with a humanoid robot and an adult within the context of a robot-assisted intervention, as well as which individual characteristics were associated with the observed interactions. For this analysis, we used video recordings of autistic children engaged in a robot-assisted intervention that were recorded as part of the DE-ENIGMA database. The results showed that the autistic children frequently engaged in exploratory and functional interactions with the robot spontaneously, as well as in interactions with the adult that were elicited by the robot. In particular, we observed autistic children frequently initiating interactions aimed at making the robot do a certain action. Autistic children with stronger language ability, social functioning, and fewer autism spectrum-related symptoms, initiated more functional interactions with the robot and more robot-elicited interactions with the adult. We conclude that the children's individual characteristics, in particular the child's language ability, can be indicative of which types of interaction they are more likely to find interesting. Taking these into account for the design of deliberate robot behavior, coupled with providing more autonomy over the robot's behavior to the autistic children, appears promising for promoting engagement and facilitating more learning opportunities.

[1]  Katherine Demuth,et al.  Effects of Type of Agreement Violation and Utterance Position on the Auditory Processing of Subject-Verb Agreement: An ERP Study , 2016, Front. Psychol..

[2]  U. Frith,et al.  An islet of ability in autistic children: a research note. , 1983, Journal of child psychology and psychiatry, and allied disciplines.

[3]  Holly A. Yanco,et al.  Are Robots Ready to Deliver Autism Interventions? A Comprehensive Review , 2016, International Journal of Social Robotics.

[4]  L. Koegel,et al.  Pivotal Response Treatments for Autism: Communication, Social, and Academic Development , 2006 .

[5]  B. Vanderborght,et al.  Enhancing play skills, engagement and social skills in a play task in ASD children by using robot-based interventions. A pilot study , 2014 .

[6]  Claire E. Foster,et al.  Emotional robot to examine different play patterns and affective responses of children with and without ASD , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  L. Koegel,et al.  Pivotal Response Intervention I: Overview of Approach , 1999 .

[8]  Susan C. Johnson Detecting agents. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  Karen Stagnitti,et al.  Understanding play: The Implications for play assessment , 2004 .

[10]  Jan K. Buitelaar,et al.  Play Behavior and Attachment in Toddlers with Autism , 2007, Journal of autism and developmental disorders.

[11]  Emma Williams,et al.  A Comparative Review of Early Forms of Object-Directed Play and Parent-Infant Play in Typical Infants and Young Children with Autism , 2003, Autism : the international journal of research and practice.

[12]  Gunilla Stenberg,et al.  Social referencing in infancy , 1998 .

[13]  A. Lillard,et al.  Predictors and Moderators of Spontaneous Pretend Play in Children with and without Autism Spectrum Disorder , 2016, Front. Psychol..

[14]  Elizabeth S. Kim,et al.  Social Robots as Embedded Reinforcers of Social Behavior in Children with Autism , 2012, Journal of Autism and Developmental Disorders.

[15]  Brian Scassellati,et al.  Effects of form and motion on judgments of social robots' animacy, likability, trustworthiness and unpleasantness , 2016, Int. J. Hum. Comput. Stud..

[16]  Chrystopher L. Nehaniv,et al.  Title of paper : KASPAR – A Minimally Expressive Humanoid Robot for Human-Robot Interaction Research , 2009 .

[17]  Tanya N. Beran,et al.  Understanding how children understand robots: Perceived animism in child-robot interaction , 2011, Int. J. Hum. Comput. Stud..

[18]  Brian Scassellati,et al.  How Social Robots Will Help Us to Diagnose, Treat, and Understand Autism , 2005, ISRR.

[19]  A. Lillard,et al.  Pretend Play as Twin Earth: A Social-Cognitive Analysis☆ , 2001 .

[20]  Maja J. Mataric,et al.  Automated detection and classification of positive vs. negative robot interactions with children with autism using distance-based features , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  S. Vig Young Children’s Object Play: A Window on Development , 2007 .

[22]  Robert Wirth,et al.  On Teaching Children , 1955 .

[23]  G. Dawson,et al.  Early Predictors of Communication Development in Young Children with Autism Spectrum Disorder: Joint Attention, Imitation, and Toy Play , 2006, Journal of autism and developmental disorders.

[24]  C. Corsello,et al.  Early Intervention in Autism , 2005 .

[25]  L. Koegel,et al.  Pivotal Response Intervention II: Preliminary Long-Term Outcome Data , 1999 .

[26]  Ronald H. Heck,et al.  Variables Affecting Engagement in Inclusive Preschool Classrooms , 1998 .

[27]  C. Heyes,et al.  Intact automatic imitation of human and robot actions in autism spectrum disorders , 2007, Proceedings of the Royal Society B: Biological Sciences.

[28]  Marek P. Michalowski,et al.  Keepon : A Playful Robot for Research, Therapy, and Entertainment (Original Paper) , 2009 .

[29]  Bram Vanderborght,et al.  How do typically developing children and children with autism perceive different social robots? , 2014, Comput. Hum. Behav..

[30]  Y. S. Kim,et al.  Global Prevalence of Autism and Other Pervasive Developmental Disorders , 2012, Autism research : official journal of the International Society for Autism Research.

[31]  P. Heaton,et al.  Pitch memory, labelling and disembedding in autism. , 2003, Journal of child psychology and psychiatry, and allied disciplines.

[32]  A. Tapus,et al.  Children with Autism Social Engagement in Interaction with Nao, an Imitative Robot - A Series of Single Case Experiments , 2012 .

[33]  T Sherman,et al.  Nonverbal communication and play correlates of language development in autistic children , 1987, Journal of autism and developmental disorders.

[34]  Kerstin Dautenhahn,et al.  Tactile Interactions with a Humanoid Robot: Novel Play Scenario Implementations with Children with Autism , 2014, Int. J. Soc. Robotics.

[35]  Thierry Chaminade,et al.  Anthropomorphic bias found in typically developing children is not found in children with autistic spectrum disorder , 2015, Autism : the international journal of research and practice.

[36]  P J Yoder,et al.  Nonverbal Communication in Two- and Three-Year-Old Children with Autism , 1997, Journal of autism and developmental disorders.

[37]  C. Greenwood,et al.  Longitudinal Analysis of Time, Engagement, and Achievement in At-Risk versus Non-Risk Students , 1991, Exceptional children.

[38]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[39]  Angela B. Barber,et al.  Play Assessments and Developmental Skills in Young Children With Autism Spectrum Disorders , 2015 .

[40]  Daniel O. David,et al.  Developing Joint Attention for Children with Autism in Robot-Enhanced Therapy , 2018, Int. J. Soc. Robotics.

[41]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[42]  W. Alexander American psychiatric association. , 2008, P & T : a peer-reviewed journal for formulary management.

[43]  Connie Kasari,et al.  Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder , 2015, Autism : the international journal of research and practice.

[44]  D. Sarko,et al.  Improving therapeutic outcomes in autism spectrum disorders: Enhancing social communication and sensory processing through the use of interactive robots. , 2017, Journal of psychiatric research.

[45]  Massimiliano Malavasi,et al.  Using a Humanoid Robot as a Complement to Interventions for Children with Autism Spectrum Disorder: a Pilot Study , 2018 .

[46]  A. Leslie Pretense and representation: The origins of "theory of mind." , 1987 .

[47]  Vicky Charisi,et al.  Dialogue Design for a Robot-Based Face-Mirroring Game to Engage Autistic Children with Emotional Expressions , 2017, ICSR.

[48]  P. Whiteley,et al.  MMR and Autism: C. Gillberg & H. Heijdal, Autism, 1998, 2(4), 423-4 , 1999 .

[49]  M. Rutter,et al.  Adult outcome for children with autism. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[50]  H. Meltzer,et al.  Epidemiology of autism spectrum disorders in adults in the community in England. , 2011, Archives of general psychiatry.

[51]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[52]  Nilanjan Sarkar,et al.  Pilot clinical application of an adaptive robotic system for young children with autism , 2014, Autism : the international journal of research and practice.

[53]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[54]  Kerstin Dautenhahn,et al.  Eliciting Requirements for a Robotic Toy for Children with Autism - Results from User Panels , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[55]  S. Baron-Cohen,et al.  Teaching Children with Autism to Mind-Read: A Practical Guide for Teachers and Parents , 1998 .

[56]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[57]  Dirk Heylen,et al.  Affect bursts to constrain the meaning of the facial expressions of the humanoid robot Zeno , 2018 .

[58]  V. Lewis,et al.  Play and Language in Children with Autism , 2003, Autism : the international journal of research and practice.

[59]  B. Robins,et al.  Where the action is: A conversation analytic perspective on interaction between a humanoid robot, a co-present adult and a child with an ASD , 2013 .

[60]  Jennifer A. Fredricks,et al.  School Engagement: Potential of the Concept, State of the Evidence , 2004 .

[61]  G. Baranek,et al.  Object play in infants with autism spectrum disorder: A longitudinal retrospective video analysis , 2017, Autism & developmental language impairments.

[62]  Michael W. Casby,et al.  Developmental Assessment of Play , 2003 .

[63]  Björn W. Schuller,et al.  Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study , 2017, Front. Robot. AI.

[64]  Kate Krasileva,et al.  Understanding definitions of minimally verbal across instruments: evidence for subgroups within minimally verbal children and adolescents with autism spectrum disorder. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[65]  D Feil-Seifer,et al.  Socially Assistive Robotics , 2011, IEEE Robotics & Automation Magazine.

[66]  C. Jarrold A Review of Research into Pretend Play in Autism , 2003, Autism : the international journal of research and practice.

[67]  D. Messer,et al.  Spontaneous Play in Children with Autism: A Reappraisal , 1998, Journal of autism and developmental disorders.

[68]  Coral Kemp,et al.  A measure of engagement for children with intellectual disabilities in early childhood settings: A preliminary study , 2006, Journal of intellectual & developmental disability.

[69]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[70]  T. Lourens,et al.  Improving Collaborative Play Between Children with Autism Spectrum Disorders and Their Siblings: The Effectiveness of a Robot-Mediated Intervention Based on Lego® Therapy , 2014, Journal of Autism and Developmental Disorders.

[71]  François Michaud,et al.  Exploring the use of a mobile robot as an imitation agent with children with low-functioning autism , 2008, Auton. Robots.

[72]  Maja J. Matarić,et al.  Understanding agency in interactions between children with autism and socially assistive robots , 2017, HRI 2017.

[73]  Jelle Saldien,et al.  On the Design of the Huggable Robot Probo , 2008 .

[74]  Jeff Sigafoos,et al.  Verifying Teacher Perceptions of the Potential Communicative Acts of Children with Autism , 2002 .

[75]  Rebecca Lytle,et al.  Pivotal Response Treatments for Autism , 2006 .

[76]  Kerstin Dautenhahn,et al.  From Isolation to Communication: A Case Study Evaluation of Robot Assisted Play for Children with Autism with a Minimally Expressive Humanoid Robot , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[77]  Sudha M. Srinivasan,et al.  The Effect of Robot-Child Interactions on Social Attention and Verbalization Patterns of Typically Developing Children and Children with Autism between 4 and 8 Years , 2013 .

[78]  Maja J. Mataric,et al.  Toward Socially Assistive Robotics for Augmenting Interventions for Children with Autism Spectrum Disorders , 2008, ISER.

[79]  Pete Smith,et al.  Symbolic play in autism: A review , 1993, Journal of autism and developmental disorders.

[80]  L. Koegel,et al.  Teaching Children with Autism Self‐Initiations as a Pivotal Response , 2003 .

[81]  David Wicks,et al.  The Coding Manual for Qualitative Researchers (3rd edition) , 2017 .

[82]  Nancy C. Brady,et al.  Symbolic Play of Preschoolers with Severe Communication Impairments with Autism and Other Developmental Delays: More Similarities than Differences , 2012, Journal of autism and developmental disorders.

[83]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[84]  A. Costall,et al.  Taking a Closer Look at Functional Play in Children with Autism , 2001, Journal of autism and developmental disorders.

[85]  B. Vanderborght,et al.  Children with Autism Spectrum Disorders Make a Fruit Salad with Probo, the Social Robot: An Interaction Study , 2015, Journal of Autism and Developmental Disorders.

[86]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[87]  S. Baron-Cohen,et al.  Enhanced discrimination of novel, highly similar stimuli by adults with autism during a perceptual learning task. , 1998, Journal of child psychology and psychiatry, and allied disciplines.

[88]  C. Michael Nelson,et al.  Aversive Stimuli in Academic Interactions between Students with Serious Emotional Disturbance and their Teachers , 1993 .

[89]  Kerstin Dautenhahn,et al.  Using a Humanoid Robot to Elicit Body Awareness and Appropriate Physical Interaction in Children with Autism , 2015, Int. J. Soc. Robotics.

[90]  Agata Rozga,et al.  Play and Developmental Outcomes in Infant Siblings of Children with Autism , 2010, Journal of autism and developmental disorders.

[91]  Craig Newnes,et al.  Diagnostic and Statistical Manual , 2014, The SAGE Encyclopedia of Trans Studies.

[92]  Catherine Lord,et al.  DSM-5 and autism spectrum disorders (ASDs): an opportunity for identifying ASD subtypes , 2013, Molecular Autism.

[93]  Gerald Mahoney,et al.  The Effects of Mother's Style of Interaction on Children's Engagement , 2004 .

[94]  K. Lifter,et al.  Overview of Play: Its Uses and Importance in Early Intervention/Early Childhood Special Education. , 2011 .

[95]  C. Lord,et al.  The Autism Diagnostic Observation Schedule: Revised Algorithms for Improved Diagnostic Validity , 2007, Journal of autism and developmental disorders.

[96]  B. Robins,et al.  Robot-mediated joint attention in children with autism : A case study in robot-human interaction , 2004 .

[97]  Geethu Mohan,et al.  Play and Language in Children with Autism Spectrum Disorder , 2011 .

[98]  Jim Euchner,et al.  Spectrum Disorder , 2012 .

[99]  Andrew Pickles,et al.  Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC) , 2016, Journal of autism and developmental disorders.

[100]  C. Lord,et al.  Standardizing ADOS Scores for a Measure of Severity in Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.