Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention

Independent driving is believed to be an important factor of quality of life for individual with autism spectrum disorder (ASD). In recent years, several computer technologies, particularly Virtual Reality (VR), have been explored to improve driving skills in this population. In this work a VR-based driving environment was developed for skill training for teenagers with ASD. Eight channels of physiological signals were recorded in real time for affect recognition during driving. A large set of physiological features were investigated to determine their correlation with four categories of affective states: engagement, enjoyment, frustration and boredom, of teenagers with ASD. In order to have reliable reference points to link the physiological data with the affective states, the subjective reports from a therapist were recorded and analyzed. Six well-known classifiers were used to develop physiology-based affect recognition models, which yielded reliable predictions. These models could potentially be used in future physiology-based adaptive driving skill training system such that the system could adapt based on individual affective states.

[1]  Nilanjan Sarkar,et al.  Psychophysiological control architecture for human-robot coordination-concepts and initial experiments , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[2]  Nilanjan Sarkar,et al.  Affective communication for implicit human-machine interaction , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[3]  N. Sarkar,et al.  A Step Towards Developing Adaptive Robot-Mediated Intervention Architecture (ARIA) for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[5]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[6]  Uttama Lahiri,et al.  An Affect-Sensitive Social Interaction Paradigm Utilizing Virtual Reality Environments for Autism Intervention , 2009, HCI.

[7]  M. Bradley,et al.  Measuring emotion: Behavior, feeling, and physiology , 2000 .

[8]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction. User and Context Diversity , 2013, Lecture Notes in Computer Science.

[9]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[10]  N. Bauminger,et al.  The Facilitation of Social-Emotional Understanding and Social Interaction in High-Functioning Children with Autism: Intervention Outcomes , 2002, Journal of autism and developmental disorders.

[11]  Jonathan Lazar,et al.  Universal Usability: Designing Computer Interfaces for Diverse User Populations , 2007 .

[12]  Changchun Liu,et al.  Affective State Recognition and Adaptation in Human-Robot Interaction: A Design Approach , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  S. Rogers.  Empirically supported comprehensive treatments for young children with autism. , 1998, Journal of clinical child psychology.

[14]  Dennis R. Durbin,et al.  Factors Associated With Driving in Teens With Autism Spectrum Disorders , 2012, Journal of developmental and behavioral pediatrics : JDBP.

[15]  S. Baron-Cohen,et al.  Enhancing Emotion Recognition in Children with Autism Spectrum Conditions: An Intervention Using Animated Vehicles with Real Emotional Faces , 2010, Journal of autism and developmental disorders.

[16]  Nilanjan Sarkar,et al.  Design of a Virtual Reality Driving Environment to Assess Performance of Teenagers with ASD , 2014, HCI.

[17]  Matthew S. Goodwin,et al.  Enhancing and Accelerating the Pace of Autism Research and Treatment , 2008 .

[18]  Daniel J Cox,et al.  Brief Report: Driving and Young Adults with ASD: Parents’ Experiences , 2012, Journal of autism and developmental disorders.

[19]  Kathryn M. Godfrey,et al.  Brief Report: Examining Driving Behavior in Young Adults with High Functioning Autism Spectrum Disorders: A Pilot Study Using a Driving Simulation Paradigm , 2013, Journal of autism and developmental disorders.

[20]  Nilanjan Sarkar,et al.  A Novel Virtual Reality Driving Environment for Autism Intervention , 2013, HCI.

[21]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[22]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[23]  Tristram H. Smith,et al.  Early Intensive Behavioral Treatment: Replication of the UCLA Model in a Community Setting , 2006, Journal of developmental and behavioral pediatrics : JDBP.

[24]  Ilia Uma.  physiological signals based human emotion recognition a review , 2014 .

[25]  N. Sarkar,et al.  Design of a Virtual Reality Based Adaptive Response Technology for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[27]  David J. Brown,et al.  Virtual Reality in the Rehabilitation of People with Intellectual Disabilities: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[28]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.