Authenticity in virtual reality for assessment and intervention in Autism: a conceptual review

Abstract Virtual Reality (VR) technologies have shown potential for learning and assessment for children, adolescents, and adults with autism. Much of the research in this area has taken a conceptual stance of veridicality; that is, that VR offers promise because it can provide authenticity and levels of realism alongside stimulus or environmental control, or both, which may first facilitate learning and the generalization of skills to the real world, and secondly can provide experimental contexts with strong ecological validity for assessment. This conceptual review raises questions about the assumption of veridicality of VR for autism research by examining research literature that has used VR to support learning and to investigate social responding. In so doing, it provides a framework for examining the assumed relationship between virtual and real contexts in order to highlight particular features of design and interaction, as well as background characteristics of participants, that may help or hinder learning and understanding in virtual environments. The conclusions suggest there is a need for the field to systematically examine the different factors that influence responding in VR in order to understand when, and under what circumstances, the responses of individuals with autism can be considered appropriately authentic. There are also opportunities for thinking more radically about research directions by focusing on the strengths and preferences of people with autism, and promoting more participatory and inclusive approaches to research.

[1]  G. Baird,et al.  Prevalence of disorders of the autism spectrum in a population cohort of children in South Thames: the Special Needs and Autism Project (SNAP) , 2006, The Lancet.

[2]  Rosa María Baños,et al.  Positive Technology: Using Interactive Technologies to Promote Positive Functioning , 2012, Cyberpsychology Behav. Soc. Netw..

[3]  Gnanathusharan Rajendran,et al.  Virtual environments and autism: a developmental psychopathological approach , 2013, J. Comput. Assist. Learn..

[4]  Samuel S. Silva,et al.  Head-mounted display versus desktop for 3D navigation in virtual reality: a user study , 2008, Multimedia Tools and Applications.

[5]  Tassos A. Mikropoulos,et al.  Educational virtual environments: A ten-year review of empirical research (1999-2009) , 2011, Comput. Educ..

[6]  Florence D. DiGennaro Reed,et al.  Applications of technology to teach social skills to children with autism , 2011 .

[7]  Sofiane Boucenna,et al.  Interactive Technologies for Autistic Children: A Review , 2014, Cognitive Computation.

[8]  J. Russell,et al.  Action memory and self-monitoring in children with autism: self versus other , 2002 .

[9]  Peter Chapman,et al.  Processing of Spontaneous Emotional Responses in Adolescents and Adults with Autism Spectrum Disorders: Effect of Stimulus Type , 2015, Autism research : official journal of the International Society for Autism Research.

[10]  L. Vasil,et al.  The Social Construction of Asperger Syndrome: The pathologising of difference? , 2002 .

[11]  Atypical Social Judgment and Sensitivity to Perceptual Cues in Autism Spectrum Disorders , 2016, Journal of autism and developmental disorders.

[12]  Van Looy Jan,et al.  State of play of digital games for empowerment and inclusion: a review of the literature and empirical cases , 2012 .

[13]  L. Eaves,et al.  Young Adult Outcome of Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[14]  Sharif Razzaque,et al.  The Responses of People to Virtual Humans in an Immersive Virtual Environment , 2005, Presence: Teleoperators & Virtual Environments.

[15]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[16]  David Jacobson,et al.  Presence Revisited: Imagination, Competence, and Activity in Text-Based Virtual Worlds , 2001, Cyberpsychology Behav. Soc. Netw..

[17]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[18]  Ralph Schroeder The Social Life of Avatars , 2002, Computer Supported Cooperative Work.

[19]  J. Loomis,et al.  Interpersonal Distance in Immersive Virtual Environments , 2003, Personality & social psychology bulletin.

[20]  S. Wass,et al.  The uses of cognitive training technologies in the treatment of autism spectrum disorders , 2014, Autism : the international journal of research and practice.

[21]  P. Mitchell,et al.  Using Virtual Environments for Teaching Social Understanding to 6 Adolescents with Autistic Spectrum Disorders , 2007, Journal of autism and developmental disorders.

[22]  J. Russell,et al.  Error-Correction Problems in Autism: Evidence for a Monitoring Impairment? , 1998, Journal of autism and developmental disorders.

[23]  Jun Ye,et al.  Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment - The pilot study , 2010, Comput. Educ..

[24]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[25]  Anthony E. Richardson,et al.  Video game experience predicts virtual, but not real navigation performance , 2011, Comput. Hum. Behav..

[26]  M. O'Reilly,et al.  Use of Computer-Based Interventions to Teach Communication Skills to Children with Autism Spectrum Disorders: A Systematic Review , 2011 .

[27]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[28]  P. Hobson,et al.  The cradle of thought : exploring the origins of thinking , 2004 .

[29]  Gerardo Herrera,et al.  Agency and Presence: A Common Dependence on Subjectivity? , 2006, PRESENCE: Teleoperators and Virtual Environments.

[30]  Sarah Parsons,et al.  Sense of presence and atypical social judgments in immersive virtual environments , 2010, Autism : the international journal of research and practice.

[31]  Tony Charman,et al.  What should autism research focus upon? Community views and priorities from the United Kingdom , 2014, Autism : the international journal of research and practice.

[32]  Giuseppe Riva,et al.  Virtual Reality in Psychotherapy: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[33]  Katerina Mania,et al.  Exploring the effect of diverse technologies incorporated in virtual museums on visitors' perceived sense of presence , 2013, Intelligent Environments.

[34]  J. Bailenson,et al.  Social Attention in a Virtual Public Speaking Task in Higher Functioning Children With Autism , 2013, Autism research : official journal of the International Society for Autism Research.

[35]  Moon J. Lee,et al.  Do shy people feel less communication apprehension online? The effects of virtual reality on the relationship between personality characteristics and communication outcomes , 2011, Comput. Hum. Behav..

[36]  C. Deruelle,et al.  Typical Emotion Processing for Cartoon but not for Real Faces in Children with Autistic Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[37]  Rhidian Hughes,et al.  Social Model of Disability , 2021, Encyclopedia of Gerontology and Population Aging.

[38]  Jeremy N. Bailenson,et al.  The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments , 2007, Cyberpsychology Behav. Soc. Netw..

[39]  A. Lewis,et al.  ‘Why should I be like bloody Rain Man?!’ Navigating the autistic identity , 2013 .

[40]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for Young Adults with High-Functioning Autism , 2012, Journal of autism and developmental disorders.

[41]  T. Parsons Ecological Validity in Virtual Reality-Based Neuropsychological Assessment , 2015 .

[42]  D. Moore,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005 .

[43]  Jennifer Abramson,et al.  Applying Technology to Visually Support Language and Communication in Individuals with Autism Spectrum Disorders , 2012, Journal of autism and developmental disorders.

[44]  Cheryl Trepagnier,et al.  Virtual environments for the investigation and rehabilitation of cognitive and perceptual impairments , 1999 .

[45]  P. Mundy,et al.  Joint Attention and Early Social Communication: Implications for Research on Intervention with Autism , 1997, Journal of autism and developmental disorders.

[46]  Vic Lally,et al.  Researching the ethical dimensions of mobile, ubiquitous and immersive technology enhanced learning (MUITEL): a thematic review and dialogue , 2012, Interact. Learn. Environ..

[47]  Elizabeth S Spelke,et al.  Infants' developing understanding of social gaze. , 2012, Child development.

[48]  Mel Slater,et al.  Building Characters: Lessons Drawn from Virtual Environments , 2005 .

[49]  Tilo Hartmann,et al.  Influence of individual factors on presence , 2008, Comput. Hum. Behav..

[50]  Frank Biocca,et al.  The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[51]  C. Barthélémy,et al.  Exploration of core features of a human face by healthy and autistic adults analyzed by visual scanning , 2009, Neuropsychologia.

[52]  Peter Mitchell,et al.  Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder , 2006, Comput. Educ..

[53]  D. Freeman Studying and Treating Schizophrenia Using Virtual Reality: A New Paradigm , 2007, Schizophrenia bulletin.

[54]  A. Bailey,et al.  Self-reported sense of presence and responses to social stimuli by adolescents with autism spectrum disorder in a collaborative virtual reality environment , 2017 .

[55]  D Waller,et al.  Individual differences in spatial learning from computer-simulated environments. , 2000, Journal of experimental psychology. Applied.

[56]  J. Nadel,et al.  A new virtual environment paradigm for high functioning autism intended to help attentional disengagement in a social context Bridging the gap between relevance theory and executive dysfunction , 2009 .

[57]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[58]  P. Mitchell,et al.  Do adolescents with autistic spectrum disorders adhere to social conventions in virtual environments? , 2005, Autism : the international journal of research and practice.

[59]  G. Riva,et al.  Extending the self through the tools and the others: A general framework for presence and social presence in mediated interactions , 2014 .

[60]  M. Rutter,et al.  Adult outcome for children with autism. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[61]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[62]  J. Galen Buckwalter,et al.  A Controlled Clinical Comparison of Attention Performance in Children with ADHD in a Virtual Reality Classroom Compared to Standard Neuropsychological Methods , 2007, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[63]  G. Bente,et al.  Avatar-Mediated Networking: Increasing Social Presence and Interpersonal Trust in Net-Based Collaborations , 2008 .

[64]  James Laffey,et al.  iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth with High Functioning Autism , 2013, Journal of Autism and Developmental Disorders.

[65]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[66]  David Fowler,et al.  Virtual Environments Using Video Capture for Social Phobia with Psychosis , 2013, Cyberpsychology Behav. Soc. Netw..

[67]  M. Bellani,et al.  Virtual reality in autism: state of the art , 2011, Epidemiology and Psychiatric Sciences.

[68]  J. Russell,et al.  Memory for actions in children with autism: self versus other. , 1999, Cognitive neuropsychiatry.

[69]  Giuseppe Riva,et al.  11 The Experience of Presence in Persuasive Virtual Environments , 2014 .

[70]  Penny Standen,et al.  The internet: a comfortable communication medium for people with Asperger syndrome (AS) and high functioning autism (HFA)? , 2009 .

[71]  S. Parsons,et al.  Inclusive research in education: contributions to method and debate , 2014 .

[72]  Dianne M. Murray,et al.  Interacting with Presence. HCI and the Sense of Presence in Computer-mediated Environments , 2014 .

[73]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[74]  Daniel Gepner,et al.  Self-Monitoring of Gaze in High Functioning Autism , 2012, Journal of autism and developmental disorders.

[75]  Matthew S. Goodwin,et al.  Enhancing and Accelerating the Pace of Autism Research and Treatment , 2008 .

[76]  B. Mineo,et al.  Engagement with Electronic Screen Media Among Students with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[77]  Sue Cobb,et al.  Reflections on the role of the ‘users’: challenges in a multi-disciplinary context of learner-centred design for children on the autism spectrum , 2014 .

[78]  M. O'Reilly,et al.  Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review , 2012, Developmental neurorehabilitation.

[79]  B. Ingersoll,et al.  The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders , 2011 .

[80]  Julio Abascal,et al.  Moving towards inclusive design guidelines for socially and ethically aware HCI , 2005, Interact. Comput..

[81]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[82]  J. Russell,et al.  Action-monitoring and intention reporting in children with autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[83]  A. E. Cook,et al.  Face processing in children with autism , 2007, Autism : the international journal of research and practice.

[84]  H. McConachie,et al.  Reducing Specific Phobia/Fear in Young People with Autism Spectrum Disorders (ASDs) through a Virtual Reality Environment Intervention , 2014, PloS one.

[85]  Ralph Schroeder,et al.  The social life of avatars: presence and interaction in shared virtual environments , 2002 .

[86]  Patrice L. Weiss,et al.  Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism , 2008 .

[87]  O. Grynszpan,et al.  Innovative technology-based interventions for autism spectrum disorders: A meta-analysis , 2014, Autism : the international journal of research and practice.

[88]  Fengfeng Ke,et al.  Virtual-Reality-Based Social Interaction Training for Children with High-Functioning Autism , 2013 .

[89]  Gamal Weheba,et al.  A Virtual Approach to Teaching Safety Skills to Children With Autism Spectrum Disorder , 2007 .

[90]  Christopher Gillberg,et al.  Autism after Adolescence: Population-based 13- to 22-year Follow-up Study of 120 Individuals with Autism Diagnosed in Childhood , 2005, Journal of autism and developmental disorders.

[91]  P. Hancock,et al.  Looking at movies and cartoons: eye-tracking evidence from Williams syndrome and autism. , 2009, Journal of intellectual disability research : JIDR.

[92]  José Gutiérrez-Maldonado,et al.  Influence of personality and individual abilities on the sense of presence experienced in anxiety triggering virtual environments , 2010, Int. J. Hum. Comput. Stud..

[93]  Xianhui Wang,et al.  Developing methods for understanding social behavior in a 3D virtual learning environment , 2012, Comput. Hum. Behav..

[94]  Kai Vogeley,et al.  Responses to Nonverbal Behaviour of Dynamic Virtual Characters in High-Functioning Autism , 2010, Journal of autism and developmental disorders.

[95]  Kristine L. Nowak The Influence of Anthropomorphism and Agency on Social Judgment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[96]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[97]  Thomas A. Brush,et al.  Student perceptions of collaborative learning, social presence and satisfaction in a blended learning environment: Relationships and critical factors , 2008, Comput. Educ..

[98]  P. Weiss,et al.  Design and testing of a virtual environment to train stroke patients with unilateral spatial neglect to cross a street safely. , 2003, Occupational therapy international.

[99]  David J. Brown,et al.  Virtual Reality in the Rehabilitation of People with Intellectual Disabilities: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[100]  Lauren E. Sherman,et al.  Deficit, difference, or both? Autism and neurodiversity. , 2013, Developmental psychology.

[101]  N. Sarkar,et al.  Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[102]  F. Amthor,et al.  Avatar Assistant: Improving Social Skills in Students with an ASD Through a Computer-Based Intervention , 2011, Journal of autism and developmental disorders.

[103]  Sarah Parsons,et al.  The Use and Understanding of Virtual Environments by Adolescents with Autistic Spectrum Disorders , 2004, Journal of autism and developmental disorders.

[104]  P. J. Brooks,et al.  Use of Computer-Assisted Technologies (CAT) to Enhance Social, Communicative, and Language Development in Children with Autism Spectrum Disorders , 2012, Journal of Autism and Developmental Disorders.

[105]  S. Parsons,et al.  International review of the evidence on best practice in educational provision for children on the autism spectrum , 2011 .

[106]  K. Vogeley,et al.  The Use of Virtual Characters to Assess and Train Non-Verbal Communication in High-Functioning Autism , 2014, Front. Hum. Neurosci..

[107]  D. Moore,et al.  Public School–Based Interventions for Adolescents and Young Adults With an Autism Spectrum Disorder , 2013 .

[108]  S. Parsons,et al.  State-of-the-art of virtual reality technologies for children on the autism spectrum , 2011 .

[109]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[110]  Mary Lynn Boscardin,et al.  Telepractice in the assessment and treatment of individuals with autism spectrum disorders: A systematic review , 2010, Developmental neurorehabilitation.