iSET: interactive social-emotional toolkit for autism spectrum disorder

Many first-hand accounts from individuals on the autism spectrum highlight the challenges inherent in processing high-speed, complex, and unpredictable social information such as nonverbal cues in real-time. In this paper, we describe iSET (Interactive Social- Emotional Toolkit): a suite of wearable technologies that can enable individuals on the autism spectrum to capture, quantify, analyze, and share aspects of their own and others' social interactions in order to facilitate learning and generalization of social-emotional communication. We present several applications of iSET we are currently piloting, and highlight the technical, usability, and experimental challenges we face in designing, implementing, and evaluating this technology.

[1]  H. Tager-Flusberg,et al.  An Investigation of Attention and Affect in Children with Autism and Down Syndrome , 1997, Journal of autism and developmental disorders.

[2]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[3]  G. McCarthy,et al.  Neural basis of eye gaze processing deficits in autism. , 2005, Brain : a journal of neurology.

[4]  Henry A. Kautz,et al.  Capturing Spontaneous Conversation and Social Dynamics: A Privacy-Sensitive Data Collection Effort , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  U. Frrrh.  Autism: explaining the enigma , 1989 .

[6]  Matthew S. Goodwin,et al.  Lessons learned from a pilot study quantifying face contact and skin conductance in teens with asperger syndrome , 2008, CHI Extended Abstracts.

[7]  Peter Robinson,et al.  Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[8]  U. Frith,et al.  Brief Report: Cognitive Processing of Own Emotions in Individuals with Autistic Spectrum Disorder and in Their Relatives , 2004, Journal of autism and developmental disorders.

[9]  Alea Chandler Teeters,et al.  Use of a wearable camera system in conversation : toward a companion tool for social-emotional learning in autism , 2007 .