Supporting narrative understanding of children with autism: A story interface with autonomous autobiographic agents

Recent studies in education for children with autism demonstrated that computer assisted learning can increase children's narrative understanding. However, software interfaces which include autonomous intelligent agents have yet to be explored in this context. In this paper we investigate how a narrative storytelling environment which is populated with virtual characters may help children with autism to understand narrative structure and to remember meaningful events within in a story. The behaviours of characters in the narrative storytelling environment are driven by a cognitive agent architecture and, in particular, a specially designed computational autobiographic memory (AM) which allows the virtual characters to remember and express emotional experiences. An application named Virtual Agent Story Interface (VASI) has been developed to visualise the agents' AMs and to help the children to reconstruct their own version of a story. In this paper we describe related research in the area, the overall design rationale of VASI, details of the VASI software design and the preliminary evaluation study.

[1]  R. Daroff,et al.  An Anthropologist on Mars , 1995, Neurology.

[2]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[3]  Scott G. Paris,et al.  Assessing narrative comprehension in young children , 2003 .

[4]  C. Linde Life Stories: The Creation of Coherence , 1993 .

[5]  Melvyn H. Schreiber,et al.  Thinking in pictures , 1992 .

[6]  Kerstin Dautenhahn,et al.  Towards a Narrative Mind: The Creation of Coherent Life Stories for Believable Virtual Agents , 2008, IVA.

[7]  M. Terwogt,et al.  Attention to facial emotion expressions in children with autism , 2006, Autism : the international journal of research and practice.

[8]  J. Bruner Actual minds, possible worlds , 1985 .

[9]  M. Davis,et al.  TouchStory: Interactive Software Designed to Assist Children with Autism to Understand Narrative , 2009 .

[10]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[11]  Alain Désilets,et al.  Tell Me a Story , 2008, IEEE Software.

[12]  M. Conway,et al.  The construction of autobiographical memories in the self-memory system. , 2000, Psychological review.

[13]  J. Bruner Acts of meaning , 1990 .

[14]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[15]  N. Sriram,et al.  Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction , 2001, Journal of autism and developmental disorders.

[16]  M. Losh,et al.  “The Frog Ate the Bug and Made his Mouth Sad”: Narrative Competence in Children with Autism , 2000, Journal of abnormal child psychology.

[17]  Martin A. Conway,et al.  A Structural Model of Autobiographical Memory , 1992 .

[18]  Wan Ching Ho,et al.  AMIA: A knowledge representation model for computational autobiographic agents , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[19]  Phoebe Sengers,et al.  Schizophrenia and Narrative in Artificial Agents , 2002, Leonardo.

[20]  U. Frith,et al.  Do triangles play tricks? Attribution of mental states to animated shapes in normal and abnormal development , 2000 .

[21]  Ana Paiva,et al.  I Know What I Did Last Summer: Autobiographic Memory in Synthetic Characters , 2007, ACII.

[22]  J. Bruner The Narrative Construction of Reality , 1991, Critical Inquiry.

[23]  S. Baron-Cohen,et al.  Teaching Children with Autism to Mind-Read: A Practical Guide for Teachers and Parents , 1998 .

[24]  S. Baron-Cohen,et al.  Understanding other minds : perspectives from autism , 1994 .

[25]  Chrystopher L. Nehaniv,et al.  The narrative construction of our (social) world: steps towards an interactive learning environment for children with autism , 2007, Universal Access in the Information Society.

[26]  Dorothy V M Bishop,et al.  Narrative skills of children with communication impairments. , 2003, International journal of language & communication disorders.

[27]  Chrystopher L. Nehaniv,et al.  Computational memory architectures for autobiographic agents interacting in a complex virtual environment: a working model , 2008, Connect. Sci..

[28]  D. Rubin Remembering our past : studies in autobiographical memory , 1996 .

[29]  K. Nelson The Psychological and Social Origins of Autobiographical Memory , 1993 .

[31]  Kerstin Dautenhahn,et al.  The origins of narrative: In search of the transactional format of narratives in humans and other social animals , 2002 .

[32]  David C. Rubin,et al.  Autobiographical memory: Introduction , 1986 .