Design and Evaluation of a Collaborative Virtual Environment (CoMove) for Autism Spectrum Disorder Intervention

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder characterized in part by core deficits in social interaction and communication. A collaborative virtual environment (CVE), which is a computer-based, distributed, virtual space for multiple users to interact with one another and/or with virtual items, has the potential to support flexible, safe, and peer-based social interactions. In this article, we presented the design of a CVE system, called CoMove, with the ultimate goals of measuring and potentially enhancing collaborative interactions and verbal communication of children with ASD when they play collaborative puzzle games with their typically developing (TD) peers in remote locations. CoMove has two distinguishing characteristics: (i) the ability to promote important collaborative behaviors (including information sharing, sequential interactions, and simultaneous interactions) and to provide real-time feedback based on users’ game performance; as well as (ii) an objective way to measure and index important aspects of collaboration and verbal-communication skills during system interaction. A feasibility study with 14 pairs—7 ASD/TD pairs and 7 TD/TD pairs—was conducted to initially test the feasibility of CoMove. The results of the study validated the system feasibility and suggested its potential to index important aspects of collaboration and verbal communication.

[1]  David H. Jonassen,et al.  Handbook of Research on Educational Communications and Technology : A Project of the Association for Educational Communications and Technology , 1996 .

[2]  A. Bailey,et al.  Self-reported sense of presence and responses to social stimuli by adolescents with ASD in a collaborative virtual reality environment , 2015 .

[3]  Uttama Lahiri,et al.  A Physiologically Informed Virtual Reality Based Social Communication System for Individuals with Autism , 2014, Journal of Autism and Developmental Disorders.

[4]  Xianhui Wang,et al.  Developing methods for understanding social behavior in a 3D virtual learning environment , 2012, Comput. Hum. Behav..

[5]  Chao Mei,et al.  How 3D Virtual Humans Built by Adolescents with ASD Affect Their 3D Interactions , 2015, ASSETS.

[6]  Michael J. Lawson,et al.  EXPLORING COLLABORATIVE ONLINE LEARNING , 2019, Online Learning.

[7]  N. Rummel,et al.  Learning to Collaborate: An Instructional Approach to Promoting Collaborative Problem Solving in Computer-Mediated Settings , 2005 .

[8]  John Bowers,et al.  Talk and embodiment in collaborative virtual environments , 1996, CHI.

[9]  Stephanie D. Teasley.  The role of talk in children's peer collaborations. , 1995 .

[10]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[11]  Sergio Caltagirone,et al.  Architecture for a massively multiplayer online role playing game engine , 2002 .

[12]  Deborah C. Beidel,et al.  Social Skills Interventions for Children with Asperger’s Syndrome or High-Functioning Autism: A Review and Recommendations , 2008, Journal of autism and developmental disorders.

[13]  Anne P. Massey,et al.  Collaborative Virtual Environments : Exploring the Link between Collaborative Behaviors and Team Performance , 2011 .

[14]  L. LeBlanc,et al.  Using the picture exchange communication system (PECS) with children with autism: assessment of PECS acquisition, speech, social-communicative behavior, and problem behavior. , 2002, Journal of applied behavior analysis.

[15]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[16]  Jun Ye,et al.  Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment - The pilot study , 2010, Comput. Educ..

[17]  Yulei Fan,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[18]  Daniel Livingstone,et al.  From Multi-User Virtual Environment to 3D Virtual Learning Environment , 2008 .

[19]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[20]  James Laffey,et al.  iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth with High Functioning Autism , 2013, Journal of Autism and Developmental Disorders.

[21]  Thierry Duval,et al.  Architectures and Mechanisms to Maintain efficiently Consistency in Collaborative Virtual Environments , 2010 .

[22]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[23]  E Shafer,et al.  A Review of Sundberg and Partington’s Teaching Language to Children with Autism or Other Developmental Disabilities , 1999, The Analysis of verbal behavior.

[24]  Carman Neustaedter,et al.  Exploring How a Co-dependent Tangible Tool Design Supports Collaboration in a Tabletop Activity , 2014, GROUP.

[25]  Dennis Beck,et al.  Computational Thinking and Social Skills in Virtuoso: An Immersive, Digital Game-Based Learning Environment for Youth with Autism Spectrum Disorder , 2016, iLRN.

[26]  A. Bailey,et al.  Self-reported sense of presence and responses to social stimuli by adolescents with autism spectrum disorder in a collaborative virtual reality environment , 2017 .

[27]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[28]  Gillian R. Hayes,et al.  Evaluating a Collaborative iPad Game's Impact on Social Relationships for Children with Autism Spectrum Disorder , 2015, TACC.

[29]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[30]  Daniel Thalmann,et al.  A Taxonomy of Networked Virtual Environments , 1999 .

[31]  N. C. Pee,et al.  Serious Game for Autism Children: Review of Literature , 2012 .

[32]  Steve Benford,et al.  Collaborative virtual environments , 2001, CACM.

[33]  Robert E. Kraut,et al.  Social use of computer-mediated communication by adults on the autism spectrum , 2010, CSCW '10.

[34]  Juan Pablo Hourcade,et al.  Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders , 2012, Personal and Ubiquitous Computing.

[35]  N. Bauminger,et al.  The Facilitation of Social-Emotional Understanding and Social Interaction in High-Functioning Children with Autism: Intervention Outcomes , 2002, Journal of autism and developmental disorders.

[36]  Gillian R. Hayes,et al.  SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism , 2016, CHI.

[37]  Fabio Pianesi,et al.  Collaborative puzzle game: a tabletop interface for fostering collaborative skills in children with autism spectrum disorders , 2010 .

[38]  Nilanjan Sarkar,et al.  Cognitive Load Measurement in a Virtual Reality-Based Driving System for Autism Intervention , 2017, IEEE Transactions on Affective Computing.

[39]  James M. Laffey,et al.  Smart 3D collaborative virtual learning environments: A preliminary framework , 2012, J. Ambient Intell. Smart Environ..

[40]  C. Boxtel,et al.  Collaborative learning tasks and the elaboration of conceptual knowledge. , 2000 .

[41]  Connie Kasari,et al.  Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder , 2015, Autism : the international journal of research and practice.

[42]  T. Stanford,et al.  The neural basis of multisensory integration in the midbrain: Its organization and maturation , 2009, Hearing Research.

[43]  S. Cobb,et al.  Collaborative virtual environment for conducting design sessions with students with autism spectrum conditions , 2012 .

[44]  E. Carr,et al.  Promoting Social Interactions Between Students With Autism Spectrum Disorders and Their Peers in Inclusive School Settings , 2008 .

[45]  S. Lane,et al.  A Pilot Study Examining Activity Participation, Sensory Responsiveness, and Competence in Children with High Functioning Autism Spectrum Disorder , 2011, Journal of autism and developmental disorders.

[46]  Jim Euchner,et al.  Spectrum Disorder , 2012 .

[47]  Daniel D. Suthers,et al.  Architectures for computer supported collaborative learning , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[48]  Lynn Dombrowski,et al.  "Will I always be not social?": Re-Conceptualizing Sociality in the Context of a Minecraft Community for Autism , 2016, CHI.

[49]  Allyson Hadwin,et al.  Measurement and assessment in computer-supported collaborative learning , 2010, Comput. Hum. Behav..

[50]  Fabio Pianesi,et al.  Enhancing social communication of children with high-functioning autism through a co-located interface , 2009, AI & SOCIETY.

[51]  Stéphane Natkin,et al.  User model in multiplayer mixed reality entertainment applications , 2006, ACE '06.

[52]  Massimo Zancanaro,et al.  Collaborative technologies for children with autism , 2011, IDC.

[53]  M. Zancanaro,et al.  Increasing social engagement in children with high-functioning autism spectrum disorder using collaborative technologies in the school environment , 2013, Autism : the international journal of research and practice.

[54]  Kristy Elizabeth Boyer,et al.  Learner characteristics and dialogue: recognising effective and student-adaptive tutorial strategies , 2013, Int. J. Learn. Technol..

[55]  Elvis S. Liu,et al.  Interest management for distributed virtual environments , 2014, ACM Comput. Surv..

[56]  D Strickland,et al.  Virtual reality for the treatment of autism. , 1997, Studies in health technology and informatics.

[57]  Changchun Liu,et al.  Dynamic Difficulty Adjustment in Computer Games Through Real-Time Anxiety-Based Affective Feedback , 2009, Int. J. Hum. Comput. Interact..

[58]  Eynat Gal,et al.  To enforce or not to enforce? The use of collaborative interfaces to promote social skills in children with high functioning autism spectrum disorder , 2013, Autism : the international journal of research and practice.

[59]  Xianhui Wang,et al.  Exploring embodied social presence of youth with Autism in 3D collaborative virtual learning environment: A case study , 2016, Comput. Hum. Behav..

[60]  Fabio Pianesi,et al.  Enforcing cooperative storytelling: first studies , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[61]  Brian Reichow,et al.  Sensitivity and specificity of proposed DSM-5 diagnostic criteria for autism spectrum disorder. , 2012, Journal of the American Academy of Child and Adolescent Psychiatry.

[62]  Christophe Diot,et al.  Design and evaluation of MiMaze a multi-player game on the Internet , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[63]  Lawrence Scahill,et al.  Social Skills Development in Children with Autism Spectrum Disorders: A Review of the Intervention Research , 2007, Journal of autism and developmental disorders.

[64]  Fabio Pianesi,et al.  Enhancing Social Communication Through Story-Telling Among High-Functioning Children with Autism , 2005, INTETAIN.

[65]  M J Weiss,et al.  Teaching Social Skills to People with Autism , 2001, Behavior modification.

[66]  Sigal Eden,et al.  Usability of technology supported social competence training for children on the Autism Spectrum , 2011, 2011 International Conference on Virtual Rehabilitation.

[67]  Angel A. Juan,et al.  Providing effective feedback, monitoring and evaluation to on-line collaborative learning discussions , 2011, Comput. Hum. Behav..

[68]  Fabio Pianesi,et al.  Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD) , 2009, ITS '09.

[69]  Patrick J. Leman,et al.  How Do Groups Work? Age Differences in Performance and the Social Outcomes of Peer Collaboration , 2015, Cogn. Sci..

[70]  Hiroshi G. Okuno,et al.  A Two-Stage Domain Selection Framework for Extensible Multi-Domain Spoken Dialogue Systems , 2011, SIGDIAL Conference.

[71]  Pierre Dillenbourg,et al.  Over-scripting CSCL: The risks of blending collaborative learning with instructional design , 2002 .

[72]  Fabio Pianesi,et al.  Enhancing Social Communication in High-Functioning Children with Autism through a Co-Located Interface , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[73]  Fabio Pianesi,et al.  Children in the Museum: an Environment for Collaborative Storytelling , 2007, PEACH - Intelligent Interfaces for Museum Visits.