Multimedia interfaces for users with high functioning autism: An empirical investigation

This article focuses on issues relevant to human-computer interaction in the case of autism. We designed training software that target specific communicative disorders attributed to autism and defined an empirical protocol to test this software. The experimental software platform that we developed manages each game's interface modalities and logs users' actions, for the purpose of exploring the impact of various human-computer interfaces, which involve text, speech and images. Ten adolescents diagnosed with autism used this software during 13 sessions, at the rate of one session per week. The first and last sessions were dedicated for evaluating participants' skills. The experiment was also performed by a group of 10 typically developing children matched on developmental age and academic level. Results show that participants with autism had poorer performances on the richer multimedia interfaces. They seemed to lack the initiative of organizing the available multimodal sources of information. In this article, we specifically discuss the impact of executive disorders on the use of multimodal interfaces with an emphasis on Animated Conversational Agents.

[1]  L. Mottron,et al.  A Study of Perceptual Analysis in a High-Level Autistic Subject with Exceptional Graphic Abilities , 1993, Brain and Cognition.

[2]  D. Moore,et al.  Collaborative Virtual Environment Technology for People With Autism , 2005 .

[3]  Jacqueline Nadel,et al.  Do Children with Autism have Expectancies about the Social Behaviour of Unfamiliar People? , 2000 .

[4]  J. Nadel,et al.  Emotional development : recent research advances , 2004 .

[5]  Kerstin Dautenhahn,et al.  Design issues on interactive environments for children with autism , 2000 .

[6]  Thimoty Barbieri,et al.  Minus-Two: Multimedia, Sound Spatialization and 3D Representation for Cognitively Impaired Children , 2004, ICCHP.

[7]  S. Rogers,et al.  Evidence-Based Interventions for Language Development in Young Children with Autism. , 2006 .

[8]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[9]  George Mendelson,et al.  Book Reviews , 1995 .

[10]  H. Engeland,et al.  Looking at Images with Human Figures: Comparison Between Autistic and Normal Children , 2002, Journal of autism and developmental disorders.

[11]  M. Simon.  L' enfant face à des expressions robotiques et humaines : étude développementale et comparative dans le cas d'autisme , 2007 .

[12]  A. Mihailidis,et al.  Assistive technology for cognitive rehabilitation: State of the art , 2004 .

[13]  Lili Cheng.  KidTalk: Online Therapy for Asperger's Syndrome , 2002 .

[14]  Tony Attwood,et al.  Asperger's Syndrome: A Guide for Parents and Professionals , 1997 .

[15]  O. Hetzroni,et al.  Effects of a Computer-Based Intervention Program on the Communicative Functions of Children with Autism , 2004, Journal of autism and developmental disorders.

[16]  P. Mitchell,et al.  Finding a place to sit: a preliminary investigation into the effectiveness of virtual environments for social skills training for people with autistic spectrum disorders , 2002 .

[17]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[18]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[19]  P. Ekman.  Emotions revealed , 2004, BMJ.

[20]  T. Ordoña.  Handbook of Autism and Pervasive Developmental Disorders , 1989 .

[21]  J. Russell,et al.  Evidence for executive dysfunction in autism , 1994, Neuropsychologia.

[22]  James A. Russell,et al.  Autistic children's difficulty with mental disengagement from an object: Its implications for theories of autism. , 1993 .

[23]  M. Forrester.  Agency: Its role in mental development , 1999 .

[24]  George Ghinea,et al.  A cognitive approach to user perception of multimedia quality: An empirical investigation , 2006, Int. J. Hum. Comput. Stud..

[25]  E. Hill.  Evaluating the theory of executive dysfunction in autism , 2004 .

[26]  Simon Baron-Cohen,et al.  A test of central coherence theory: linguistic processing in high-functioning adults with autism or Asperger syndrome: is local coherence impaired? , 1999, Cognition.

[27]  Takashi Komeda,et al.  Virtual Reality Based Therapy Application for Developmental Disordered Children , 2004, ICCHP.

[28]  Alex W. W. Wong,et al.  Neuropsychological Function for Accessibility of Computer Program for People with Mental Retardation , 2004, ICCHP.

[29]  S. Baron-Cohen,et al.  Another advanced test of theory of mind: evidence from very high functioning adults with autism or asperger syndrome. , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[30]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[31]  F. Volkmar,et al.  Handbook of Autism and Pervasive Developmental Disorders , 1987 .

[32]  J. Cassell,et al.  Authorable Virtual Peers for Autism Spectrum Disorders , 2006 .

[33]  S. Baron-Cohen,et al.  Systemizing empathy: Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia , 2006, Development and Psychopathology.

[34]  Ralf W Schlosser,et al.  Effects of speech and print feedback on spelling by children with autism. , 2004, Journal of speech, language, and hearing research : JSLHR.

[35]  U. Frith,et al.  The neuropsychology of autism. , 1996, Brain : a journal of neurology.