A gesture-controlled serious game for teaching emotion recognition skills to preschoolers with autism

The recognition of facial expressions is important for the perception of emotions. Understanding emotions is essential in human communication and social interaction. Children with autism have been reported to exhibit deficits in the recognition of affective expressions. With the appropriate intervention, elimination of those deficits can be achieved. Interventions are proposed to start as early as possible. Computer-based programs have been widely used with success to teach people with autism to recognize emotions. However, those computer interventions require considerable skills for interaction. Such abilities are beyond very young children with autism as they have major restriction in their ability to interact with computers. Our approach takes account of the specific characteristics of preschoolers with autism and their physical inabilities. By creating an educational computer game which provides physical interaction, we aim to support early intervention and to foster emotion learning.

[1]  Chun-Yan Xi,et al.  Auditory abnormalities in children with autism , 2012 .

[2]  J. Baio Morbidity and Mortality Weekly Report Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, Six Sites, United States, 2000; Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 14 Sites, United States, 2002; , 2007 .

[3]  E. Fombonne,et al.  Sensori-motor and Daily Living Skills of Preschool Children with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[4]  J. Farber,et al.  Understanding Autism , 1984, Clinical pediatrics.

[5]  Katherine B. Martin,et al.  Facial Action Coding System , 2015 .

[6]  Bretagne Abirached,et al.  A framework for designing assistive technologies for teaching children with ASDs emotions , 2012, CHI Extended Abstracts.

[7]  Bretagne Abirached,et al.  Understanding User Needs for Serious Games for Teaching Children with Autism Spectrum Disorders Emotions , 2012 .

[8]  P. J. Brooks,et al.  Use of Computer-Assisted Technologies (CAT) to Enhance Social, Communicative, and Language Development in Children with Autism Spectrum Disorders , 2012, Journal of Autism and Developmental Disorders.

[9]  Lakhmi C. Jain,et al.  Serious Games and Edutainment Applications , 2014 .

[10]  Charalambos Vrasidas,et al.  Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications , 2008 .

[11]  Lawrence Scahill,et al.  Social Skills Development in Children with Autism Spectrum Disorders: A Review of the Intervention Research , 2007, Journal of autism and developmental disorders.

[12]  J. Baio Prevalence of autism spectrum disorders--Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. , 2012, Morbidity and mortality weekly report. Surveillance summaries.

[13]  Jean-Pierre Jessel,et al.  Origins of Serious Games , 2011, Serious Games and Edutainment Applications.

[14]  Paul T. Sowden,et al.  Reduced chromatic discrimination in children with autism spectrum disorders. , 2010, Developmental science.

[15]  Aubyn C. Stahmer,et al.  Inclusion for toddlers with autism spectrum disorders , 2011, Autism : the international journal of research and practice.

[16]  Konstantin Mitgutsch,et al.  Purposeful by design?: a serious game design assessment framework , 2012, FDG.

[17]  S. Baron-Cohen,et al.  Eagle-Eyed Visual Acuity: An Experimental Investigation of Enhanced Perception in Autism , 2009, Biological Psychiatry.