Understanding User Needs for Serious Games for Teaching Children with Autism Spectrum Disorders Emotions

Computer technologies, particularly games, are considered promising in assisting children with autism in learning social interactions and developing language skills, but few existing tools target a critical factor in communication, emotions. This study is an effort to analyze user needs for a serious game for teaching children with autism spectrum disorders emotions. Semi-structured interviews with parents and user observations were used in combination to investigate user needs. The results suggest that while parents recognized the importance of teaching children emotions, they do not have effective tools. We recommend that effective intervention tools need to be customizable, adaptive, and contextualized.

[1]  Gillian R. Hayes,et al.  Classroom-based assistive technology: collective use of interactive visual schedules by students with autism , 2011, CHI.

[2]  Rosalind W. Picard,et al.  Broadening accessibility through special interests: a new approach for software customization , 2010, ASSETS '10.

[3]  Helen Tager-Flusberg,et al.  Reading Faces for Information about Words and Emotions in Adolescents with Autism. , 2008, Research in autism spectrum disorders.

[4]  Juan Pablo Hourcade,et al.  Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders , 2012, Personal and Ubiquitous Computing.

[5]  Emma Ashwin,et al.  Can emotion recognition be taught to children with autism spectrum conditions? , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[6]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[7]  Karrie Karahalios,et al.  Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD , 2009, CHI.

[8]  Robert E. Kraut,et al.  Social use of computer-mediated communication by adults on the autism spectrum , 2010, CSCW '10.

[9]  Chrystopher L. Nehaniv,et al.  TouchStory: Towards an Interactive Learning Environment for Helping Children with Autism to Understand Narrative , 2006, ICCHP.

[10]  Marc Fabri,et al.  Teaching severely autistic children to recognise emotions: finding a methodology , 2007, BCS HCI.

[11]  Matthew S. Goodwin,et al.  Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder , 2008, Assets '08.

[12]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[13]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[14]  Christopher Frauenberger,et al.  Supporting children's social communication skills through interactive narratives with virtual characters , 2010, ACM Multimedia.

[15]  Edward M. Hallowell,et al.  Helping Children with Autism Become More Social: 76 Ways to Use Narrative Play , 2007 .

[16]  Verónica Orvalho,et al.  What a Feeling: Learning Facial Expressions and Emotions , 2010 .

[17]  C. Gillberg,et al.  Increasing reading and communication skills in children with autism through an interactive multimedia computer program , 1995, Journal of autism and developmental disorders.

[18]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[19]  Neil R. Smalheiser,et al.  Proceedings of the 1st ACM International Health Informatics Symposium , 2010, IHI 2010.

[20]  Panagiotis D. Bamidis,et al.  Using affective avatars and rich multimedia content for education of children with autism , 2009, PETRA '09.

[21]  Mark Meerum Terwogt,et al.  Emotional competence in children with autism: Diagnostic criteria and empirical evidence , 2008 .

[22]  Ellen Yi-Luen Do,et al.  Facial expression wonderland (FEW): a novel design prototype of information and computer technology (ICT) for children with autism spectrum disorder (ASD) , 2010, IHI.

[23]  Anne Marie Piper,et al.  SIDES: A Cooperative Tabletop Computer Game for Social Skills Development , 2022 .

[24]  Gillian R. Hayes,et al.  vSked: evaluation of a system to support classroom activities for children with autism , 2010, CHI.

[25]  Susana Bernad-Ripoll,et al.  Using a Self-as-Model Video Combined With Social Stories™ to Help a Child With Asperger Syndrome Understand Emotions , 2007 .

[26]  Melissa Dawe,et al.  Desperately seeking simplicity: how young adults with cognitive disabilities and their families adopt assistive technologies , 2006, CHI.

[27]  Geraldine Dawson,et al.  Becoming a Face Expert: A Computerized Face-Training Program for High-Functioning Individuals With Autism Spectrum Disorders , 2007, Developmental neuropsychology.

[28]  S. Baron-Cohen Mindblindness: An Essay on Autism and Theory of Mind , 1997 .

[29]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[30]  Jill Taylor,et al.  Interactive Multimedia Systems for Students with Autism , 2000 .

[31]  R. Joseph,et al.  Holistic and part-based face recognition in children with autism. , 2003, Journal of child psychology and psychiatry, and allied disciplines.

[32]  S. Baron-Cohen Autism: The Empathizing–Systemizing (E‐S) Theory , 2009, Annals of the New York Academy of Sciences.

[33]  C. Deruelle,et al.  Typical Emotion Processing for Cartoon but not for Real Faces in Children with Autistic Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[34]  S. Bölte,et al.  Emotion Recognition in Children and Adolescents with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[35]  Karim Sehaba,et al.  Interactive Educational Games for Autistic Children with Agent-Based System , 2005, ICEC.

[36]  F. Amthor,et al.  Avatar Assistant: Improving Social Skills in Students with an ASD Through a Computer-Based Intervention , 2011, Journal of autism and developmental disorders.

[37]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[38]  Matthew S. Goodwin,et al.  Lessons from participatory design with adolescents on the autism spectrum , 2009, CHI Extended Abstracts.

[39]  S. Baron-Cohen,et al.  Enhancing Emotion Recognition in Children with Autism Spectrum Conditions: An Intervention Using Animated Vehicles with Real Emotional Faces , 2010, Journal of autism and developmental disorders.