Assessing Children’s Perceptions of Live Interactions With Avatars: Preparations for Use in ASD Therapy in a Multi-Ethnic Context

Avatars have been found to be useful tools to overcome communication barriers in people affected by Autistic Spectrum Disorders (ASD) and to help them understand and express emotions. However, it has been shown that the success of the interactions is highly dependent on the subject’s identification with the avatar. In this study, we assess the variables that may influence that perception in children under 10, in the context of the largely multi-ethnic Ecuadorean society. The results reveal that, unlike previous studies showed for young adults, the ethnic traits displayed by the avatars are not a critical factor, as the the quality of the interactions was more influenced by the perception of the avatars’ appearance, their similarity with the kids’ peers and, above all, the ability of the human model who controls the avatar to use a pleasant voice, to succeed in making his/her questions and responses fully understood, and to master the non-verbal communication transmitted through gestures and voice.

[1]  B. Garcia-Zapirain,et al.  Technologies as Support Tools for Persons with Autistic Spectrum Disorder: A Systematic Review , 2014, International journal of environmental research and public health.

[2]  Sebastian Möller,et al.  Evaluating embodied conversational agents in multimodal interfaces , 2015 .

[3]  Adriana Tapus,et al.  Impact of sensory preferences of individuals with autism on the recognition of emotions expressed by two robots, an avatar, and a human , 2016, Autonomous Robots.

[4]  Xiong Luo,et al.  Virtual Avatar-Based Life Coaching for Children With Autism Spectrum Disorder , 2020, Computer.

[5]  Mack D. Burke,et al.  Embedding Interests of Individuals with Autism Spectrum Disorder: a Quality Review , 2018 .

[6]  Xianhui Wang,et al.  Autistic youth in 3D game-based collaborative virtual learning: Associating avatar interaction patterns with embodied social presence , 2018, Br. J. Educ. Technol..

[7]  Niksha Federico,et al.  Virtual Humans and Avatars - Healthcare Personal Agents in the Palm of Your Hand (LB855) , 2014 .

[8]  P. Stallard,et al.  Innovations in Practice: Avatar-based virtual reality in CAMHS talking therapy: two exploratory case studies. , 2019, Child and adolescent mental health.

[9]  Fengfeng Ke,et al.  Virtual-Reality-Based Social Interaction Training for Children with High-Functioning Autism , 2013 .

[10]  Rob Cover,et al.  Digital Difference: Theorizing Frameworks of Bodies, Representation and Stereotypes in Digital Games , 2016 .

[11]  C. Lord,et al.  Restricted and Repetitive Behaviors in Young Children with Autism Spectrum Disorders , 2007, Journal of autism and developmental disorders.

[12]  Abdulmotaleb El-Saddik,et al.  A Quality of Experience Model for Haptic Virtual Environments , 2014, TOMCCAP.

[13]  Patrick Kenny,et al.  SimCoach: an intelligent virtual human system for providing healthcare information and support , 2011 .

[14]  Aaron J. Krasner,et al.  Avatar therapy: where technology, symbols, culture, and connection collide. , 2012, Journal of psychiatric practice.

[15]  Jasmin Ilyani Ahmad,et al.  Multimedia Learning Tools for Autism Children , 2019, Proceedings of the Third International Conference on Computing, Mathematics and Statistics (iCMS2017).

[16]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for children with high functioning autism , 2016, Comput. Hum. Behav..

[17]  Kristine L. Nowak,et al.  Avatars and computer-mediated communication: a review of the definitions, uses, and effects of digital representations , 2018 .

[18]  Bretagne Abirached,et al.  Improving communication skills of children with ASDs through interaction with virtual characters , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[19]  K. Vogeley,et al.  The Use of Virtual Characters to Assess and Train Non-Verbal Communication in High-Functioning Autism , 2014, Front. Hum. Neurosci..

[20]  Sarah Parsons,et al.  The Use and Understanding of Virtual Environments by Adolescents with Autistic Spectrum Disorders , 2004, Journal of autism and developmental disorders.

[21]  N. Newbutt,et al.  The potential of virtual reality technologies to support people with an autism condition: A case study of acceptance, presence and negative effects , 2016 .

[22]  B. Reichow,et al.  That’s what I like: The use of circumscribed interests within interventions for individuals with autism spectrum disorder. A systematic review , 2019, Research in Autism Spectrum Disorders.

[23]  David M. W. Powers,et al.  Personalisation and automation in a virtual conversation skills tutor for children with autism , 2018, Journal on Multimodal User Interfaces.

[24]  Charles K. Kinzer,et al.  The Effects of Avatar: Based Customization on Player Identification , 2014, Int. J. Gaming Comput. Mediat. Simulations.

[25]  K. Sheehy,et al.  A virtual tutor for children with autism , 2017 .

[26]  Roman Egger,et al.  Virtual reality in tourism: a state-of-the-art review , 2019, Tourism Review.

[27]  Fady Alnajjar,et al.  Avatar based interaction therapy: A potential therapeutic approach for children with Autism , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[28]  The study of ethnic attitudes during interactions with avatars in virtual environments , 2018 .

[29]  Mohammad Ali Fteiha Effectiveness of assistive technology in enhancing language skills for children with autism , 2017 .

[30]  W. Lawson Autism spectrum conditions: the pathophysiological basis for inattention and the new Diagnostic and Statistical Manual of Mental Disorders (DSM-V) , 2013 .

[31]  Gang Peng,et al.  Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders , 2019, PloS one.

[32]  Martín López-Nores,et al.  AVATAR: Implementation of a Human-Computer Interface Based on an Intelligent Virtual Agent , 2019, 2019 IEEE Colombian Conference on Communications and Computing (COLCOM).

[33]  José Juan Pazos-Arias,et al.  SPELTA: An expert system to generate therapy plans for speech and language disorders , 2015, Expert Syst. Appl..

[34]  B. Benson,et al.  Changes in Restricted Repetitive Behaviors with age: A study of high-functioning adults with Autism Spectrum Disorders , 2010 .

[35]  Alan Wexelblat,et al.  Virtual reality applications and explorations , 1993 .

[36]  Martín López-Nores,et al.  AVATAR: Contribution to Human-Computer interaction processes through the adaptation of semi-personalized virtual agents , 2018, 2018 IEEE Biennial Congress of Argentina (ARGENCON).

[37]  Jenny R. Root,et al.  Establishing Computer-Assisted Instruction to Teach Academics to Students with Autism as an Evidence-Based Practice , 2017, Journal of autism and developmental disorders.

[38]  Jong-Eun Roselyn Lee,et al.  Does virtual diversity matter?: Effects of avatar-based diversity representation on willingness to express offline racial identity and avatar customization , 2014, Comput. Hum. Behav..

[39]  Martin A. Giese,et al.  Prejudiced interactions: implicit racial bias reduces predictive simulation during joint action with an out-group avatar , 2015, Scientific Reports.

[40]  Sarah Parsons,et al.  Authenticity in virtual reality for assessment and intervention in Autism: a conceptual review , 2016 .

[41]  Jill Boberg,et al.  Do Avatars that Look Like Their Users Improve Performance in a Simulation? , 2016, IVA.

[42]  Mao H. Vang,et al.  Race in Virtual Environments: Competitive Versus Cooperative Games with Black or White Avatars , 2014, Cyberpsychology Behav. Soc. Netw..

[43]  D. Dietrich,et al.  Avatars of Whiteness: Racial Expression in Video Game Characters , 2013 .

[44]  Darin E. Hughes,et al.  Improving perspective taking and empathy in children with autism spectrum disorder , 2016, 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH).

[45]  Eleonora Bilotta,et al.  An emotional learning environment for subjects with Autism Spectrum Disorder , 2013, 2013 International Conference on Interactive Collaborative Learning (ICL).

[46]  Sen-Ching S. Cheung Integrating Multimedia into Autism Intervention , 2015, IEEE MultiMedia.

[47]  Francisco J. Serón,et al.  Smart tourist information points by combining agents, semantics and AI techniques , 2017, Comput. Sci. Inf. Syst..

[48]  Fady Alnajjar,et al.  Personalized Robot Interventions for Autistic Children: An Automated Methodology for Attention Assessment , 2020, International Journal of Social Robotics.

[49]  Donald E. Brown,et al.  Design and evaluation of an avatar-based cultural training system , 2018, The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology.

[50]  Oliver Deussen,et al.  Interactive testbed for research in autism—the SARA project , 2018, Universal Access in the Information Society.

[51]  N. Bauminger,et al.  The Development and Maintenance of Friendship in High-Functioning Children with Autism , 2003, Autism : the international journal of research and practice.

[52]  M. Graber,et al.  Black, white or green: ‘race’, gender and avatars within the therapeutic space , 2011, Medical Humanities.

[53]  Gnanathusharan Rajendran,et al.  Virtual environments and autism: a developmental psychopathological approach , 2013, J. Comput. Assist. Learn..

[54]  Garry Falloon,et al.  Using avatars and virtual environments in learning: What do they have to offer? , 2010, Br. J. Educ. Technol..

[55]  Andrea Gaggioli,et al.  Avatars in Clinical Psychology: A Framework for the Clinical Use of Virtual Humans , 2003, Cyberpsychology Behav. Soc. Netw..

[56]  Amy S. Weitlauf,et al.  Assessing Social Communication and Collaboration in Autism Spectrum Disorder Using Intelligent Collaborative Virtual Environments , 2019, Journal of Autism and Developmental Disorders.

[58]  Trent W. Lewis,et al.  Development of a virtual agent based social tutor for children with autism spectrum disorders , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[59]  Nilanjan Sarkar,et al.  Assessing the Utility of a Virtual Environment for Enhancing Facial Affect Recognition in Adolescents with Autism , 2014, Journal of autism and developmental disorders.

[60]  J. P. Smith,et al.  Using a Virtual Manipulative Intervention Package to Support Maintenance in Teaching Subtraction with Regrouping to Students with Developmental Disabilities , 2020, Journal of autism and developmental disorders.

[61]  Daniela Pacella,et al.  Assessing children's interpersonal emotion regulation with virtual agents: The serious game Emodiscovery , 2018, Comput. Educ..

[62]  Alexandra Petrakou,et al.  Interacting through avatars: Virtual worlds as a context for online education , 2010, Comput. Educ..

[63]  F. Tordo,et al.  AVATARS ET MOI ! LA FONCTION PSYCHOLOGIQUE DE LA MULTIPLICITÉ DES AVATARS DANS LES JEUX VIDÉO , 2009 .

[64]  F. Boven Special interests and inclusive academic learning: an autistic perspective , 2018, Advances in Autism.

[65]  Sunhwa Jung,et al.  Teaching games to young children with autism spectrum disorder using special interests and video modelling , 2015 .

[66]  J. Elison,et al.  A quantitative measure of restricted and repetitive behaviors for early childhood , 2016, Journal of Neurodevelopmental Disorders.