A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD)

The use of serious games to help children with autism spectrum disorder (ASD) learn different skills has increased in the recent past. Games, however, have not been exploited to enhance the vocabulary of these children. The serious game design framework (SGDF) and its components provide support throughout the design process, but there are no existing SGDFs that can be used to design serious games for these children to learn vocabulary skills. Therefore, in this research, a SGDF is proposed to overcome the problem of designing serious games for children with ASD. The components of the framework were identified after an extensive review of the literature on ASD and existing SGDFs. The input, process and output model was used as an underlying structure of the framework, and the identified components were logically placed in each phase of the model. The proposed framework was iteratively evaluated through expert reviews with academic experts and researchers working in the area of serious games, as well as game designers. The modified version of the framework was produced based on the comments provided by experts. This modified version was then used in the applicability evaluation of the framework with researchers and game designers. A proposed SGDF was produced based on the comments of experts. The main findings from expert reviews show that the structure, components and details of the proposed framework have been effectively refined. The use of the framework to produce serious game design and the prototype demonstrates its use in real time. The evaluation of the prototype with autistic children shows the improvement in their vocabulary learning before and after using the prototype.

[1]  Gavriel Salvendy,et al.  A proposed index of usability: A method for comparing the relative usability of different software systems , 1997, Behav. Inf. Technol..

[2]  Pierre Jouvelot,et al.  Motivation-driven educational game design: applying best practices to music education , 2005, ACE '05.

[3]  Linda C. Lederman,et al.  Debriefing: A Critical Reexamination of the Postexperience Analytic Process with Implications for Its Effective Use. , 1984 .

[4]  Joëlle Coutaz,et al.  A design space for multimodal systems: concurrent processing and data fusion , 1993, INTERCHI.

[5]  J. Smyth,et al.  Designing Serious Game Interventions for Individuals with Autism , 2014, Journal of Autism and Developmental Disorders.

[6]  K. Kiili Digital game-based learning: Towards an experiential gaming model , 2005, Internet High. Educ..

[7]  O. Hetzroni,et al.  Effects of a Computer-Based Intervention Program on the Communicative Functions of Children with Autism , 2004, Journal of autism and developmental disorders.

[8]  B. Bloom Taxonomy of educational objectives , 1956 .

[9]  Iván Martínez-Ortiz,et al.  Educational game design for online education , 2008, Comput. Hum. Behav..

[10]  Minhua Ma,et al.  A Review of Serious Games for Children with Autism Spectrum Disorders (ASD) , 2014, SGDA.

[11]  S. Wilson What Video Games Have to Teach Us about Learning and Literacy , 2006 .

[12]  Espen Aarseth,et al.  A narrative theory of games , 2012, FDG.

[13]  Gary B. Wills,et al.  A Conceptual Framework for Serious Games , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[14]  Alexis Bosseler,et al.  Read my lips , 2006, Autism : the international journal of research and practice.

[15]  Orit E. Hetzroni,et al.  From Logos to Orthographic Symbols: A Multilevel Fading Computer Program for Teaching Nonverbal Children With Autism , 2005 .

[16]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[17]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[18]  C. Johnson,et al.  Early Clinical Characteristics of Children with Autism , 2004 .

[19]  Richard Rouse,et al.  Game design : theory and practice , 2001 .

[20]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[21]  Karolien Poels,et al.  Digital game design for elderly users , 2007, Future Play.

[22]  Gillian R. Hayes,et al.  Interactive visual supports for children with autism , 2010, Personal and Ubiquitous Computing.

[23]  Jan H. Hulstijn,et al.  Does Training in Second-Language Word Recognition Skills Affect Reading Comprehension? An Experimental Study , 2005 .

[24]  Aki Järvinen,et al.  Game design for social networks: interaction design for playful dispositions , 2009, Sandbox@SIGGRAPH.

[25]  Asadullah Shah,et al.  A systematic review of modalities in computer-based interventions (CBIs) for language comprehension and decoding skills of children with autism spectrum disorder (ASD) , 2019, Universal Access in the Information Society.

[26]  Christina Whalen,et al.  Efficacy of TeachTown: Basics computer-assisted intervention for the Intensive Comprehensive Autism Program in Los Angeles Unified School District , 2010, Autism : the international journal of research and practice.

[27]  Mohamed Chetouani,et al.  GOLIAH: A Gaming Platform for Home-Based Intervention in Autism – Principles and Design , 2016, Front. Psychiatry.

[28]  Siti Salwah Salim,et al.  Design Components for Serious Games of Children with Autism Spectrum Disorder (ASD) , 2014 .

[29]  Siti Salwah Salim,et al.  Serious Game for Children with Autism to Learn Vocabulary: An Experimental Evaluation , 2019, Int. J. Hum. Comput. Interact..

[30]  Amri Yusoff,et al.  A conceptual framework for serious games and its validation , 2010 .

[31]  John W. Rice,et al.  The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education , 2012, Int. J. Gaming Comput. Mediat. Simulations.

[32]  N. Iuppa,et al.  Story and Simulations for Serious Games: Tales from the Trenches , 2006 .

[33]  Jörg Kienzle,et al.  Model-based design of computer-controlled game character behavior , 2007, MODELS'07.

[34]  Deborah I Thompson,et al.  Playing for real: video games and stories for health-related behavior change. , 2008, American journal of preventive medicine.

[35]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[36]  R. Gagne Conditions of Learning , 1965 .

[37]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[38]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[39]  Anita J. Harrow A taxonomy of the psychomotor domain : a guidefor developing behavioral objectives / by Anita J. Harrow , 1972 .

[40]  Sharon Oviatt,et al.  Multimodal Interfaces , 2008, Encyclopedia of Multimedia.

[41]  Siti Salwah Salim,et al.  Components to design serious games for children with autism spectrum disorder (ASD) to learn vocabulary , 2018, 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS).

[42]  Siti Salwah Salim,et al.  A systematic review of strategies and computer-based intervention (CBI) for reading comprehension of children with autism , 2013 .

[43]  Scott Thornbury,et al.  How to Teach Vocabulary , 2002 .

[44]  D. A. Wilkins Linguistics in language teaching , 1972 .

[45]  Joseph A. Maxwell,et al.  Qualitative Research Design: An Interactive Approach , 1996 .

[46]  Steve Love,et al.  A game design framework for avoiding phishing attacks , 2013, Comput. Hum. Behav..

[47]  C Basil,et al.  Acquisition of literacy skills by children with severe disability , 2003 .

[48]  Eduard Barbu,et al.  Open Book: a tool for helping ASD users’ semantic comprehension , 2013 .

[49]  M. O'Reilly,et al.  Use of Computer-Based Interventions to Improve Literacy Skills in Students with Autism Spectrum Disorders: A Systematic Review , 2011 .

[50]  Mohamed Chetouani,et al.  GOLIAH (Gaming Open Library for Intervention in Autism at Home): a 6-month single blind matched controlled exploratory study , 2017, Child and Adolescent Psychiatry and Mental Health.

[51]  Paul Nation,et al.  Teaching and learning vocabulary , 1994 .

[52]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[53]  G. Dawson,et al.  Interventions to Facilitate Auditory, Visual, and Motor Integration in Autism: A Review of the Evidence , 2000, Journal of autism and developmental disorders.

[54]  N. C. Pee,et al.  Serious Game for Autism Children: Review of Literature , 2012 .

[55]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[56]  Laura Malinverni,et al.  An inclusive design approach for developing video games for children with Autism Spectrum Disorder , 2017, Comput. Hum. Behav..

[57]  Jane Case-Smith,et al.  A systematic review of sensory processing interventions for children with autism spectrum disorders , 2015, Autism : the international journal of research and practice.

[58]  B. Winn The Design, Play, and Experience Framework , 2009 .

[59]  L K Miller,et al.  Learning and problem solving by retarded and normal Ss. , 1968, American journal of mental deficiency.

[60]  Eduardo Salas,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[61]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[62]  Stephanie Al Otaiba,et al.  Evidence-Based Reading Instruction for Individuals With Autism Spectrum Disorders , 2009, Focus on autism and other developmental disabilities.

[63]  高橋 栄 Diagnostic and Statistical Manual of Mental Disorders(DSM)-5による分類と診断 (特集 周産期メンタルヘルス : 妊婦の不安とどう立ち向かうか) , 2014 .

[64]  Lester Gilbert,et al.  6 – Front-end analysis , 2007 .

[65]  Declan Kennedy,et al.  Writing and using learning outcomes: a practical guide , 2006 .

[66]  Sara de Freitas,et al.  A framework for developing serious games to meet learner needs , 2006 .

[67]  Kara L. Orvis,et al.  Relationships Between Game Attributes and Learning Outcomes , 2009 .

[68]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[69]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[70]  Hsu-Min Chiang,et al.  Reading Comprehension Instruction for Students With Autism Spectrum Disorders , 2007 .

[71]  Siriwan Mayuree English vocabulary learning strategies employed by rajabhat university students , 2007 .

[72]  Curtiss Murphy,et al.  Why Games Work and the Science of Learning , 2012 .

[73]  Bretagne Abirached,et al.  A framework for designing assistive technologies for teaching children with ASDs emotions , 2012, CHI Extended Abstracts.