A Physiologically Informed Virtual Reality Based Social Communication System for Individuals with Autism

Clinical applications of advanced technology may hold promise for addressing impairments associated with autism spectrum disorders (ASD). This project evaluated the application of a novel physiologically responsive virtual reality based technological system for conversation skills in a group of adolescents with ASD. The system altered components of conversation based on (1) performance alone or (2) the composite effect of performance and physiological metrics of predicted engagement (e.g., gaze pattern, pupil dilation, blink rate). Participants showed improved performance and looking pattern within the physiologically sensitive system as compared to the performance based system. This suggests that physiologically informed technologies may have the potential of being an effective tool in the hands of interventionists.

[1]  Uttama Lahiri,et al.  An Approach to the Design of Socially Acceptable Robots for Children with Autism Spectrum Disorders , 2010, Int. J. Soc. Robotics.

[2]  A. Klin,et al.  Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. , 2008, Archives of general psychiatry.

[3]  Sun I. Kim,et al.  A virtual reality application in role-plays of social skills training for schizophrenia: A randomized, controlled trial , 2011, Psychiatry Research.

[4]  Rosalind W. Picard Future affective technology for autism and emotion communication , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  A. Bailey,et al.  Face‐ and gaze‐sensitive neural responses in children with autism: a magnetoencephalographic study , 2006, The European journal of neuroscience.

[6]  Ruth Aylett,et al.  Socially Intelligent Agents - Creating Relationships with Computers and Robots , 2003, J. Documentation.

[7]  Anneli Kylliäinen,et al.  Skin Conductance Responses to Another Person’s Gaze in Children with Autism , 2006, Journal of autism and developmental disorders.

[8]  Georgina Peacock,et al.  Autism Spectrum Disorders and Health Care Expenditures: The Effects of Co-Occurring Conditions , 2012, Journal of developmental and behavioral pediatrics : JDBP.

[9]  M. D. Rutherford,et al.  Scan Path Differences and Similarities During Emotion Perception in those With and Without Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[10]  S. Mostofsky,et al.  Normal Physiological Emotions but Differences in Expression of Conscious Feelings in Children with High-Functioning Autism , 2006, Journal of autism and developmental disorders.

[11]  H. Engeland,et al.  Autonomic and Neuroendocrine Responses to a Psychosocial Stressor in Adults with Autistic Spectrum Disorder , 2006, Journal of autism and developmental disorders.

[12]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[13]  Emily M. Lund Social Communication Questionnaire , 2014 .

[14]  Matthew S. Goodwin,et al.  Enhancing and Accelerating the Pace of Autism Research and Treatment , 2008 .

[15]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[16]  M. Ganz,et al.  The lifetime distribution of the incremental societal costs of autism. , 2007, Archives of pediatrics & adolescent medicine.

[17]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[18]  D Strickland,et al.  Virtual reality for the treatment of autism. , 1997, Studies in health technology and informatics.

[19]  G. Dawson Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder , 2008, Development and Psychopathology.

[20]  Mar Rus-Calafell,et al.  A virtual reality-integrated program for improving social skills in patients with schizophrenia: a pilot study. , 2014, Journal of behavior therapy and experimental psychiatry.

[21]  Ramsey Ad Virtual Reality induced symptoms and effects : a psychophysiological perspective. , 1999 .

[22]  A. Angrilli,et al.  Cardiac responses associated with affective processing of unpleasant film stimuli. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  John Colombo,et al.  Visual Scanning and Pupillary Responses in Young Children with Autism Spectrum Disorder , 2006, Journal of clinical and experimental neuropsychology.

[24]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[25]  U. Lahiri Virtual-reality based gaze-sensitive adaptive response technology for children with autism spectrum disorder , 2011 .

[26]  S. Drucker,et al.  The Role of Eye Gaze in Avatar Mediated Conversational Interfaces , 2000 .

[27]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[28]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[29]  Jonathan M. Campbell,et al.  Peabody Picture Vocabulary Test , 2010 .

[30]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[31]  N. Sarkar,et al.  Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Sarah Parsons,et al.  The Use and Understanding of Virtual Environments by Adolescents with Autistic Spectrum Disorders , 2004, Journal of autism and developmental disorders.

[33]  K. Durkin,et al.  Understanding of Thought Bubbles as Mental Representations in Children with Autism: Implications for Theory of Mind , 2004, Journal of autism and developmental disorders.

[34]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[35]  Rosalind W. Picard,et al.  Affective Social Quest , 2002 .

[36]  Marc M. Sebrechts,et al.  Atypical Face Gaze in Autism , 2002, Cyberpsychology Behav. Soc. Netw..

[37]  C. Freitag,et al.  Diagnostic instruments for autism spectrum disorder (ASD) , 2016, Cochrane Database of Systematic Reviews.

[38]  Bruce Edmonds,et al.  Socially Intelligent Agents: Creating Relationships With Computers And Robots , 2013 .

[39]  John R. Wilson,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999, Presence: Teleoperators & Virtual Environments.