Natural User Interface to Assess Social Skills in Autistic Population

The children suffering of autism spectrum disorder (ASD) present several limitations in social communication and interactive skills. State of the art showed that Virtual Reality (VR) represents a valid alternative to learn social skills in ASD. In particular VR offers the advantage to simulate daily life interaction in a replicable and controlled environment. In this paper, we present a novel methodology to evaluate social competence in ASD based on the immersive VR system, featuring natural interaction. The VR system is based on the theoretical model which aims to evaluate the intersubjective interchange in everyday relationship between autistic population and the surrounding environment. We suggest that this technological setup can be a useful tool to increase social competence in ASD and it can become a sophisticated outcome measurement tool for studying the improvement of social competence.

[1]  S. Baron-Cohen,et al.  Does the autistic child have a “theory of mind” ? , 1985, Cognition.

[2]  Uta Frith,et al.  Autism spectrum disorder , 2005, Current Biology.

[3]  Massimo Bergamasco,et al.  Immersive Technologies and Natural Interaction to Improve Serious Games Engagement , 2015, GALA.

[4]  L. Wing.  The autistic spectrum , 1997, The Lancet.

[5]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[6]  D. Moore,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005 .

[7]  Matthew S. Goodwin,et al.  What can innovative technologies do for Autism Spectrum Disorders? , 2010, Autism : the international journal of research and practice.

[8]  R. Schultz,et al.  Measuring social attention and motivation in autism spectrum disorder using eye‐tracking: Stimulus type matters , 2015, Autism research : official journal of the International Society for Autism Research.

[9]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[10]  A. Goldman.  To Appear in: , 2008 .

[11]  Massimo Bergamasco,et al.  Evaluating the Impact of Highly Immersive Technologies and Natural Interaction on Player Engagement and Flow Experience in Games , 2015, ICEC.

[12]  G. Mesibov,et al.  Brief report: Two case studies using virtual reality as a learning tool for autistic children , 1996, Journal of autism and developmental disorders.

[13]  Jun Ye,et al.  Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment - The pilot study , 2010, Comput. Educ..

[14]  B. Mineo,et al.  Engagement with Electronic Screen Media Among Students with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[15]  Haylie L. Miller,et al.  Level of Immersion in Virtual Environments Impacts the Ability to Assess and Teach Social Skills in Autism Spectrum Disorder , 2016, Cyberpsychology Behav. Soc. Netw..

[16]  Yangang Wang,et al.  Online modeling for realtime facial animation , 2013, ACM Trans. Graph..

[17]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[18]  Jessica K. Hodgins,et al.  Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database , 2008 .

[19]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[20]  D Strickland,et al.  Virtual reality for the treatment of autism. , 1997, Studies in health technology and informatics.

[21]  Massimo Bergamasco,et al.  Evaluating the effects of competition vs collaboration on user engagement in an immersive game using natural interaction , 2015, VRST.

[22]  S. Gallagher.  Understanding Interpersonal Problems in Autism: Interaction Theory as An Alternative to Theory of Mind , 2004 .

[23]  M. Bellani,et al.  Virtual reality in autism: state of the art , 2011, Epidemiology and Psychiatric Sciences.

[24]  Jorge Pomares,et al.  Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with Asperger syndrome , 2013, Comput. Educ..

[25]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[26]  Yufang Cheng,et al.  Using a 3D Immersive Virtual Environment System to Enhance Social Understanding and Social Skills for Children With Autism Spectrum Disorders , 2015 .

[27]  Luca Chittaro,et al.  Navigation and exploration of an urban virtual environment by children with autism spectrum disorder compared to children with typical development , 2013 .

[28]  Sarah Parsons,et al.  Sense of presence and atypical social judgments in immersive virtual environments , 2010, Autism : the international journal of research and practice.