A case study of gesture-based games in enhancing the fine motor skills and recognition of children with autism

ABSTRACT Children with Autism Spectrum Disorder (ASD) perform poorly in complex fine motor skills and recognition, and they have difficulties in learning complex and multistep motor skills. Gestures-based games, which enable users to get timely feedback, to learn from failure, to engage in games at every moment, and to interact with computers intuitively have become promising tools. However, relevant empirical research on using gesture-based games to assist the learning of children with ASD is limited. With a case study method, we aim to examine the effects of using gesture-based games on the learning of children with ASD. Two gesture-based matching games were developed to improve the performance of children with ASD with respect to fine motor skills and recognition, and three young children with ASD participated in a three-week experiment. By comparing the participants’ performance before and after the treatment, we found that the participants’ performance in playing the gesture-based games improved greatly during the intervention, and intervention helped improve their performance regarding fine motor skills and recognition. Also, they were able to transfer the rules and skills they had learnt from the first game to completing the tasks in the second game. The findings above suggest the usefulness of using gesture-based games in assisting the learning of children with ASD. Some suggestions and implications for the development of the gesture-based games and future work are also discussed.

[1]  Catherine Lord,et al.  The relationship of motor skills and social communicative skills in school-aged children with autism spectrum disorder. , 2013, Adapted physical activity quarterly : APAQ.

[2]  R. Landa,et al.  Current Perspectives on Motor Functioning in Infants, Children, and Adults With Autism Spectrum Disorders , 2011, Physical Therapy.

[3]  G. Rizzolatti,et al.  Planning actions in autism , 2008, Experimental Brain Research.

[4]  M. Lloyd,et al.  Effectiveness of a fundamental motor skill intervention for 4-year-old children with autism spectrum disorder: A pilot study , 2015, Autism : the international journal of research and practice.

[5]  Evgenia Boutsika,et al.  Kinect in Education: A Proposal for Children with Autism , 2013, DSAI.

[6]  Paul D. Ellsworth,et al.  Diagnostic and Statistical Manual of Mental Disorder , 1980 .

[7]  G. Baird,et al.  The severity and nature of motor impairment in Asperger's syndrome: a comparison with specific developmental disorder of motor function. , 2002, Journal of child psychology and psychiatry, and allied disciplines.

[8]  A. Billard,et al.  Chapter 18 Games Children with Autism Can Play With Robota , a Humanoid Robotic Doll , 1995 .

[9]  Inge-Marie Eigsti,et al.  Brief Report: Generalization Weaknesses in Verbally Fluent Children and Adolescents with Autism Spectrum Disorder , 2015, Journal of autism and developmental disorders.

[10]  Yao-Jen Chang,et al.  A gesture recognition system to transition autonomously through vocational tasks for individuals with cognitive impairments. , 2011, Research in developmental disabilities.

[11]  Stephen B. Richards,et al.  Single Subject Research: Applications in Educational and Clinical Settings , 2013 .

[12]  Melody Tankersley,et al.  Using Single-Subject Research to Establish the Evidence Base of Special Education , 2008 .

[13]  C. Ferrara,et al.  The responsiveness of autistic children to the predictability of social and nonsocial toys , 1980, Journal of autism and developmental disorders.

[14]  Orhan Cakiroglu,et al.  Single subject research: applications to special education , 2012 .

[15]  C. Su,et al.  Effectiveness of virtual reality using Wii gaming technology in children with Down syndrome. , 2011, Research in developmental disabilities.

[16]  R. Haskell.  Transfer of Learning: Cognition, Instruction, and Reasoning , 2000 .

[17]  Tiffany Ya Tang,et al.  Engaging Chinese Children with Autism to Interact with Portable Hand- and Finger-Gesture Based Applications: Experiment and Reflections , 2016, HCI.

[18]  M. Lloyd,et al.  School-Based Fundamental-Motor-Skill Intervention for Children With Autism-Like Characteristics: An Exploratory Study. , 2016, Adapted physical activity quarterly : APAQ.

[19]  Helen Arvidson,et al.  Augmentative and Alternative Communication: A Handbook of Principles and Practices , 1997 .

[20]  Sharon Glennen,et al.  The handbook of augmentative and alternative communication , 1997 .

[21]  A. Bastian,et al.  Children with autism show specific handwriting impairments , 2009, Neurology.

[22]  Kirsten Petrie,et al.  Creating confident, motivated teachers of physical education in primary schools , 2010 .

[23]  S. Mostofsky,et al.  Evidence for a deficit in procedural learning in children and adolescents with autism: Implications for cerebellar contribution , 2000, Journal of the International Neuropsychological Society.

[24]  Paul T. Sowden,et al.  Color Perception in Children with Autism , 2008, Journal of autism and developmental disorders.

[25]  Neil Davey,et al.  Designing & developing QueBall, a robotic device for autism therapy , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[26]  Craig H. Kennedy,et al.  Single-Case Designs for Educational Research , 2004 .

[27]  Calum Hartley,et al.  Brief Report: Generalisation of Word–Picture Relations in Children with Autism and Typically Developing Children , 2014, Journal of autism and developmental disorders.

[28]  Maria del Carmen Juan Lizandra,et al.  Advanced displays and natural user interfaces to support learning , 2017, Interact. Learn. Environ..

[29]  J. Galassi,et al.  Myths, misconceptions, and missed opportunity: single-case designs and counseling psychology , 1993 .

[30]  E. Hill,et al.  A dyspraxic deficit in specific language impairment and developmental coordination disorder? Evidence from hand and arm movements , 1998, Developmental medicine and child neurology.

[31]  Marina Papastergiou,et al.  The impact of an exergame-based intervention on children's fundamental motor skills , 2015, Comput. Educ..

[32]  Gerald Goldstein,et al.  Impaired memory for faces and social scenes in autism: clinical implications of memory dysfunction. , 2005, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[33]  Jyh-Tsorng Jong,et al.  Persistence temperament associated with children playing math games between touch panel and embodied interaction , 2013, J. Comput. Assist. Learn..

[34]  Max Ito,et al.  Relationship between motor skill impairment and severity in children with Asperger syndrome , 2007 .

[35]  E. Fombonne,et al.  Sensori-motor and Daily Living Skills of Preschool Children with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[36]  M. Bannert,et al.  Game Based Learning , 2008 .

[37]  Ting Liu,et al.  Fine and gross motor performance of the MABC-2 by children with autism spectrum disorder and typically developing children , 2013 .

[38]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.