A framework for using games for behavioral analysis of autistic children

Autism spectrum disorder (ASD) draws increasing awareness nowadays. The children with autism suffer different degrees of impairment, but there is, still, no efficient medical detection nor cure methods. It is very urgent and important to develop suitable therapeutic methods to help them make progress in a positive progress. This paper proposes a multimodal integrated system concept for autistic children to enable them to play serious games non-intrusively while the reactions are recorded by Microsoft Kinect color and depth camera, and the emotions are analyzed. The adaptive system provides evaluation for serious game-based therapy sessions, as well as the potential directions of further treatment. Main components of the framework and integration approach are described in the paper. There are also the suggestions of verification and validation for the outcomes of the software.

[1]  J. Bruner,et al.  Play: Its Role in Development and Evolution , 1976 .

[2]  D. Arnone,et al.  Autism, ethnicity and maternal immigration , 2010, British Journal of Psychiatry.

[3]  Adel Said Elmaghraby,et al.  Speech emotion detection using time dependent self organizing maps , 2013, IEEE International Symposium on Signal Processing and Information Technology.

[4]  R. Hobson,et al.  What is autism? , 1991, The Psychiatric clinics of North America.

[5]  Birgitte Holm Sørensen,et al.  Serious Games in language learning and teaching - a theoretical perspective , 2007, DiGRA Conference.

[6]  Johannes Wagner,et al.  Exploring Fusion Methods for Multimodal Emotion Recognition with Missing Data , 2011, IEEE Transactions on Affective Computing.

[7]  N. C. Pee,et al.  Serious Game for Autism Children: Review of Literature , 2012 .

[8]  Yi Li,et al.  Multi-scenario gesture recognition using Kinect , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[9]  M. Milanova,et al.  Recognition of Emotional states in Natural Human-Computer Interaction , 2008, 2008 IEEE International Symposium on Signal Processing and Information Technology.

[10]  Christopher Gillberg,et al.  What is Autism , 1990 .

[11]  Adel Said Elmaghraby,et al.  A framework for interactive generation of music for games , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[12]  Begoña García Zapirain,et al.  Serious games and Health Informatics: A unified framework , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[13]  Shaila Rao,et al.  Learning through Seeing and Doing , 2006 .

[14]  Alain Pruski,et al.  Human-Computer Interaction Using Emotion Recognition from Facial Expression , 2011, 2011 UKSim 5th European Symposium on Computer Modeling and Simulation.

[15]  Yi Li,et al.  Hand gesture recognition using Kinect , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering.

[16]  Shiv Naresh Shivhare,et al.  Emotion Detection from Text , 2012, ArXiv.

[17]  Bob Roehr,et al.  American Psychiatric Association explains DSM-5 , 2013, BMJ.

[18]  Adel Said Elmaghraby,et al.  Intelligent serious games system for children with learning disabilities , 2012, 2012 17th International Conference on Computer Games (CGAMES).

[19]  Franca Garzotto,et al.  Exploring motion-based touchless games for autistic children's learning , 2013, IDC.

[20]  Ajmal S. Mian,et al.  Using Kinect for face recognition under varying poses, expressions, illumination and disguise , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).