Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with Asperger syndrome

This paper presents the use of immersive virtual reality systems in the educational intervention with Asperger students. The starting points of this study are features of these students' cognitive style that requires an explicit teaching style supported by visual aids and highly structured environments. The proposed immersive virtual reality system, not only to assess the student's behavior and progress, but also is able to adapt itself to the student's specific needs. Additionally, the immersive reality system is equipped with sensors that can determine certain behaviors of the students. This paper determines the possible inclusion of immersive virtual reality as a support tool and learning strategy in these particular students' intervention. With this objective two task protocols have been defined with which the behavior and interaction situations performed by participant students are recorded. The conclusions from this study talks in favor of the inclusion of these virtual immersive environments as a support tool in the educational intervention of Asperger syndrome students as their social competences and executive functions have improved. Highlights? Use of immersive virtual reality in the educational intervention of Asperger students. ? Design of a multisensorial immersive system to improve social skills. ? Definition and implementation of protocol tasks to evaluate the students' evolution. ? Building immersive virtual environments in a school context.

[1]  David Moore,et al.  The use of emotionally expressive avatars in Collaborative Virtual Environments , 2005 .

[2]  P. Mitchell,et al.  Finding a place to sit: a preliminary investigation into the effectiveness of virtual environments for social skills training for people with autistic spectrum disorders , 2002 .

[3]  Lucila Maria Costi Santarosa,et al.  Autism and digital learning environments: Processes of interaction and mediation , 2008, Comput. Educ..

[4]  Robert E. Kraut,et al.  Social use of computer-mediated communication by adults on the autism spectrum , 2010, CSCW '10.

[5]  Paul J. Eslinger,et al.  Long-term psychological consequences of childhood frontal lobe lesion in patient DT , 1992, Brain and Cognition.

[6]  Fred R. Volkmar,et al.  Issues in the Classification of Autism and Related Conditions , 2005 .

[7]  L. Kanner.  Autistic disturbances of affective contact. , 1968, Acta paedopsychiatrica.

[8]  Christian Küblbeck,et al.  Face detection and tracking in video sequences using the modifiedcensus transformation , 2006, Image Vis. Comput..

[9]  Patrice L. Weiss,et al.  Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism , 2008 .

[10]  H. Shane,et al.  Electronic Screen Media for Persons with Autism Spectrum Disorders: Results of a Survey , 2008, Journal of autism and developmental disorders.

[11]  Stephen Bauer,et al.  What is Asperger syndrome? , 2009, The Journal of practical nursing.

[12]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for Young Adults with High-Functioning Autism , 2012, Journal of autism and developmental disorders.

[13]  John Cromby,et al.  Successful transfer to the real world of skills practised in a virtual environment by students with severe learning difficulties , 1996 .

[14]  S. Parsons,et al.  State-of-the-art of virtual reality technologies for children on the autism spectrum , 2011 .

[15]  P. Mitchell,et al.  Using Virtual Environments for Teaching Social Understanding to 6 Adolescents with Autistic Spectrum Disorders , 2007, Journal of autism and developmental disorders.

[16]  Peter Mitchell,et al.  Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder , 2006, Comput. Educ..

[17]  P. Tanguay.  Pervasive developmental disorders: a 10-year review. , 2000, Journal of the American Academy of Child and Adolescent Psychiatry.

[18]  James R. Miller,et al.  A Virtual Environment for Teaching Social Skills: AViSSS , 2009, IEEE Computer Graphics and Applications.

[19]  Asha V Asher,et al.  Teaching social skills to people with autism , 2014 .

[20]  Ben Xianye.  Face detection and tracking in video , 2011 .

[21]  Natacha S. Santos,et al.  Investigation of Mentalizing and Visuospatial Perspective Taking for Self and Other in Asperger Syndrome , 2010, Journal of autism and developmental disorders.

[22]  David J. Brown,et al.  Virtual reality and its role in removing the barriers that turn cognitive impairments into intellectual disability , 2006, Virtual Reality.

[23]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[24]  H. Asperger,et al.  Die „Autistischen Psychopathen” im Kindesalter , 1944, Archiv für Psychiatrie und Nervenkrankheiten.

[25]  P. Howlin.  Practitioner review: psychological and educational treatments for autism. , 1998, Journal of child psychology and psychiatry, and allied disciplines.

[26]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[27]  Ami Klin,et al.  Brief Report: Social and Communication Abilities and Disabilities in Higher Functioning Individuals with Autism and Asperger Syndrome , 2007, Journal of autism and developmental disorders.

[28]  S Baron-Cohen,et al.  What's inside someone's head? Conceiving of the mind as a camera helps children with autism acquire an alternative to a theory of mind. , 1996, Cognitive neuropsychiatry.

[29]  S. Rogers,et al.  Interventions That Facilitate Socialization in Children with Autism , 2000, Journal of autism and developmental disorders.

[30]  Crystal L. Hoyt,et al.  Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology , 2002 .

[31]  Jorge Pomares,et al.  Adaptive Visual Servoing by Simultaneous Camera Calibration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[32]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[33]  Tharrenos Bratitsis,et al.  Children with Asperger Syndrome and Computer Supported Collaborative Learning Activities: A Case Study in a 3rd Grade Mixed Class , 2010, 2010 International Conference on Intelligent Networking and Collaborative Systems.

[34]  A. Bailey,et al.  Sense of presence and atypical social judgments in immersive virtual environments , 2010, Autism : the international journal of research and practice.

[35]  Sean P. Goggins,et al.  iSocial: a 3D VLE for youth with autism , 2009, CSCL.

[36]  Matthew S. Goodwin,et al.  Enhancing and Accelerating the Pace of Autism Research and Treatment , 2008 .

[37]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[38]  Sharon C. Lyter,et al.  Diagnostic and Statistical Manual of Mental Disorders: Making it Work for Social Work , 2012 .

[39]  Richard M. Eastgate,et al.  Development of social skills amongst adults with Asperger’s Syndrome using virtual environments , 2000 .

[40]  P. Mitchell,et al.  Do adolescents with autistic spectrum disorders adhere to social conventions in virtual environments? , 2005, Autism : the international journal of research and practice.

[41]  Pamela J. Wolfberg,et al.  Play and Imagination in Children with Autism , 2009 .

[42]  M. Shiffrar,et al.  Movement perception and movement production in Asperger's Syndrome , 2012 .

[43]  Patricia Howlin,et al.  Psychological and Educational Treatments for Autism , 1998 .