Understanding Performance and Verbal-Communication of Children with ASD in a Collaborative Virtual Environment

Collaborative virtual environments (CVEs), which allow naturalistic communication between two or more individuals in a shared virtual environment, hold promise as a tool for measuring and promoting social communication between peers. In this work, a CVE platform and a set of CVE-based collaborative games are designed for children with autism spectrum disorder (ASD). Two groups (7 ASD/TD pairs; 7 TD/TD pairs) participated in a pilot study to establish system feasibility and tolerability. We also designed a methodology for capturing meaningful metrics of social communication. Based on these metrics, we found improved game performance and trends in communication of these participants over time. Although preliminary, these results provide important insights on CVE-based interaction for ASD intervention.

[1]  Stephanie D. Teasley.  The role of talk in children's peer collaborations. , 1995 .

[2]  Fabio Pianesi,et al.  Enhancing Social Communication Through Story-Telling Among High-Functioning Children with Autism , 2005, INTETAIN.

[3]  Connie Kasari,et al.  Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder , 2015, Autism : the international journal of research and practice.

[4]  Kristin S. Lierheimer,et al.  An Initial Investigation of the Generalization of a School-Based Social Competence Intervention for Youth with High-Functioning Autism , 2011, Autism research and treatment.

[5]  E. Carr,et al.  Promoting Social Interactions Between Students With Autism Spectrum Disorders and Their Peers in Inclusive School Settings , 2008 .

[6]  A. Bailey,et al.  Self-reported sense of presence and responses to social stimuli by adolescents with autism spectrum disorder in a collaborative virtual reality environment , 2017 .

[7]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[8]  Christina Whalen,et al.  Efficacy of TeachTown: Basics computer-assisted intervention for the Intensive Comprehensive Autism Program in Los Angeles Unified School District , 2010, Autism : the international journal of research and practice.

[9]  S. Lane,et al.  A Pilot Study Examining Activity Participation, Sensory Responsiveness, and Competence in Children with High Functioning Autism Spectrum Disorder , 2011, Journal of autism and developmental disorders.

[10]  C. Boxtel,et al.  Collaborative learning tasks and the elaboration of conceptual knowledge. , 2000 .

[11]  Fabio Pianesi,et al.  Collaborative puzzle game: a tabletop interface for fostering collaborative skills in children with autism spectrum disorders , 2010 .

[12]  D. Moore,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005 .

[13]  Stefan Kopp,et al.  A Conversational Agent as Museum Guide - Design and Evaluation of a Real-World Application , 2005, IVA.

[14]  Iván Martínez-Ortiz,et al.  Educational game design for online education , 2008, Comput. Hum. Behav..

[15]  Nilanjan Sarkar,et al.  Design of a Mobile Collaborative Virtual Environment for Autism Intervention , 2016, HCI.

[16]  Massimo Zancanaro,et al.  Collaborative technologies for children with autism , 2011, IDC.

[17]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[18]  S. Fletcher‐Watson.  A Targeted Review of Computer-Assisted Learning for People with Autism Spectrum Disorder: Towards a Consistent Methodology , 2013, Review Journal of Autism and Developmental Disorders.

[19]  P. Mitchell,et al.  Using Virtual Environments for Teaching Social Understanding to 6 Adolescents with Autistic Spectrum Disorders , 2007, Journal of autism and developmental disorders.

[20]  N. Sarkar,et al.  Design of a Virtual Reality Based Adaptive Response Technology for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  P. J. Brooks,et al.  Use of Computer-Assisted Technologies (CAT) to Enhance Social, Communicative, and Language Development in Children with Autism Spectrum Disorders , 2012, Journal of Autism and Developmental Disorders.

[22]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[23]  Michael J. Lawson,et al.  EXPLORING COLLABORATIVE ONLINE LEARNING , 2019, Online Learning.

[24]  N. Rummel,et al.  Learning to Collaborate: An Instructional Approach to Promoting Collaborative Problem Solving in Computer-Mediated Settings , 2005 .

[25]  David W. Johnson,et al.  Cooperation and the Use of Technology , 2007 .

[26]  Steve Benford,et al.  Collaborative virtual environments , 2001, CACM.

[27]  M. Silver,et al.  Evaluation of a New Computer Intervention to Teach People with Autism or Asperger Syndrome to Recognize and Predict Emotions in Others , 2001, Autism : the international journal of research and practice.

[28]  Patrick J. Leman,et al.  How Do Groups Work? Age Differences in Performance and the Social Outcomes of Peer Collaboration , 2015, Cogn. Sci..

[29]  D. Wechsler.  Wechsler Intelligence Scale for Children , 2020, Definitions.

[30]  S. Bain.  Differential Ability Scales , 1991 .

[31]  G. Dawson,et al.  Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorder , 2015, Autism : the international journal of research and practice.

[32]  Catherine Lord,et al.  The Social Communication Questionnaire Manual , 2003 .

[33]  S. Baron-Cohen,et al.  Systemizing empathy: Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia , 2006, Development and Psychopathology.

[34]  Deborah C. Beidel,et al.  Social Skills Interventions for Children with Asperger’s Syndrome or High-Functioning Autism: A Review and Recommendations , 2008, Journal of autism and developmental disorders.

[35]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[36]  R. Pennington.  Computer-Assisted Instruction for Teaching Academic Skills to Students With Autism Spectrum Disorders: A Review of Literature , 2010 .