Building an Intelligent, Authorable Serious Game for Autistic Children and Their Carers

This paper introduces the SHARE-IT project, which leverages serious games paradigm to motivate and engage children with autism diagnosis in interactive activities, based on the state-of-the-art autism intervention practices. The aim of SHARE-IT is to formulate, in partnership with schools, parents and industry, the requirements for a robust, intelligent and authorable environment for supporting children in exploring, practicing and acquiring social interaction skills. SHARE-IT focuses on two key challenges: (i) developing robust system architecture and implementation, able to support both continuing development of a serious game for children with autism and its real world use; and (ii) selecting appropriate technologies and techniques to allow for (a) multi-device and operating system deployment, (b) the development of an intelligent serious game for supporting social interaction while (c) allowing the flexibility for the environment to be authored by lay persons. SHARE-IT's architecture is presented and several considerations of importance to enabling the engineering of an intelligent and authorable serious game are discussed. Examples of technologies developed to date are given throughout and a discussion of future challenges offered.

[1]  Patrick Gebhard,et al.  A Software Framework for Social Cue-based Interaction with a Virtual Character , 2013 .

[2]  L. A. Pervin.  Handbook of Personality: Theory and Research , 1992 .

[3]  S. Parsons,et al.  State-of-the-art of virtual reality technologies for children on the autism spectrum , 2011 .

[4]  Liat Sayfan,et al.  Grown-ups are not afraid of scary stuff, but kids are: young children's and adults' reasoning about children's, infants', and adults' fears. , 2008, Child development.

[5]  Katerina Avramides,et al.  Building Autonomous Social Partners for Autistic Children , 2012, IVA.

[6]  Wolfgang L. Zagler,et al.  Computers Helping People with Special Needs, 12th International Conference, ICCHP 2010, Vienna, Austria, July 14-16, 2010, Proceedings, Part II , 2010, ICCHP.

[7]  Tiffany Barnes,et al.  cMotion: A New Game Design to Teach Emotion Recognition and Programming Logic to Children using Virtual Humans , 2009, 2009 IEEE Virtual Reality Conference.

[8]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[9]  Martin Knapp,et al.  The Economic Consequences of Autism in the UK , 2007 .

[10]  Dominic W. Massaro.  Embodied Agents in Language Learning for Children with Language Challenges , 2006, ICCHP.

[11]  Trent W. Lewis,et al.  Development of a virtual agent based social tutor for children with autism spectrum disorders , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[12]  Chek Tien Tan,et al.  Personalised gaming: a motivation and overview of literature , 2012, IE '12.

[13]  Barry M. Prizant,et al.  The SCERTS® Model: A Comprehensive Educational Approach for Children with Autism Spectrum Disorders , 2004 .

[14]  Tristan Cazenave,et al.  Planning and Execution Control Architecture for Infantry Serious Gaming , 2013 .

[15]  Zhi-Hong Chen,et al.  Active Open Learner Models as Animal Companions: Motivating Children to Learn through Interacting with My-Pet and Our-Pet , 2007, Int. J. Artif. Intell. Educ..

[16]  Eric Gans.  Art and Entertainment , 1985 .

[17]  K. Sofronoff,et al.  A multi-component social skills intervention for children with Asperger syndrome: the Junior Detective Training Program. , 2008, Journal of child psychology and psychiatry, and allied disciplines.

[18]  K. Dautenhahn,et al.  Creating a software to promote understanding about narrative in children with autism: Reflecting on the design of feedback and opportunities to reason , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[19]  Jean-Claude Martin,et al.  Multimedia interfaces for users with high functioning autism: An empirical investigation , 2008, Int. J. Hum. Comput. Stud..

[20]  F. Amthor,et al.  Avatar Assistant: Improving Social Skills in Students with an ASD Through a Computer-Based Intervention , 2011, Journal of autism and developmental disorders.

[21]  R. Lazarus.  Emotion and Adaptation , 1991 .

[22]  Emilia I. Barakova,et al.  Using an emergent system concept in designing interactive games for autistic children , 2007, IDC.

[23]  Michi Henning,et al.  A new approach to object-oriented middleware , 2004, IEEE Internet Computing.

[24]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[25]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[26]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[27]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[28]  Sara Bernardini,et al.  Designing an Intelligent Virtual Agent for Social Communication in Autism , 2013, AIIDE.

[29]  Georgios N. Yannakakis,et al.  Modeling and Augmenting Game Entertainment through Challenge and Curiosity , 2007, Int. J. Artif. Intell. Tools.

[30]  Rosalind W. Picard,et al.  Affective learning companions: strategies for empathetic agents with real-time multimodal affective sensing to foster meta-cognitive and meta-affective approaches to learning, motivation, and perseverance , 2006 .

[31]  Md. Mustafizur Rahman,et al.  A Computer Game Based Approach for Increasing Fluency in the Speech of the Autistic Children , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[32]  Md. Mustafizur Rahman,et al.  Speech development of autistic children by interactive computer games , 2011, Interact. Technol. Smart Educ..

[33]  Ana Paiva,et al.  Feeling and Reasoning: A Computational Model for Emotional Characters , 2005, EPIA.

[34]  Fabio Pianesi,et al.  Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD) , 2009, ITS '09.

[35]  S. Wass,et al.  The uses of cognitive training technologies in the treatment of autism spectrum disorders , 2014, Autism : the international journal of research and practice.

[36]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[37]  Thomas W. Malone,et al.  Guidelines for Designing Educational Computer Programs. , 1983 .

[38]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[39]  Robert Michael Young,et al.  Narrative Planning: Balancing Plot and Character , 2010, J. Artif. Intell. Res..

[40]  A. Campbell,et al.  Progress in Artificial Intelligence , 1995, Lecture Notes in Computer Science.

[41]  L. Rothkrantz,et al.  Toward an affect-sensitive multimodal human-computer interaction , 2003, Proc. IEEE.

[42]  K. Dautenhahn,et al.  Towards interactive robots in autism therapy: background, motivation and challenges , 2004 .

[43]  Bretagne Abirached,et al.  Improving communication skills of children with ASDs through interaction with virtual characters , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[44]  Joshua Underwood,et al.  Exploring the Potential of the Homework System and Tablet PCs to Support Continuity of Numeracy Practices between Home and Primary School , 2007 .

[45]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..