An efficient movement and mental classification for children with autism based on motion and EEG features

The early intervention services for the children with autism are labor costly. To settle this problem, some activities classification based rehabilitation training system is developed. However, the mental characteristics of the children with autism are less considered. In this paper, a novel activities classification framework is proposed for the rehabilitation training of the children with autism. The movement and mental based features are obtained using the motion and electroencephalography vectors from Kinect and MindWave. Two support vector machines are integrated to perform a frame-based classification procedure. The proposed methods are tested in a dataset includes 110 recordings from five children (two with autism). The proposed algorithm achieved an accuracy of 96.2, 93.3, 94.06 and 97.40% for the good positive, NG positive, good negative, and NG negative movements, respectively.

[1]  Soman Sen,et al.  Keeping up with video game technology: objective analysis of Xbox Kinect™ and PlayStation 3 Move™ for use in burn rehabilitation. , 2014, Burns : journal of the International Society for Burn Injuries.

[2]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[3]  Z. Warren,et al.  Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. , 2014, Morbidity and mortality weekly report. Surveillance summaries.

[4]  Gregory D. Abowd,et al.  Interactive technologies for autism , 2007, CHI Extended Abstracts.

[5]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[6]  Yao-Jen Chang,et al.  A Kinect-based upper limb rehabilitation system to assist people with cerebral palsy. , 2013, Research in developmental disabilities.

[7]  A. Akrami,et al.  EEG-Based Mental Task Classification: Linear and Nonlinear Classification of Movement Imagery , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[8]  Chin-Teng Lin,et al.  An EEG-based classification system of Passenger's motion sickness level by using feature extraction/selection technologies , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[9]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[10]  Mirko Gelsomini,et al.  Designing and evaluating touchless playful interaction for ASD children , 2014, IDC.

[11]  Soo-Young Lee,et al.  EEG-Based Classification of Implicit Intention During Self-Relevant Sentence Reading , 2016, IEEE Transactions on Cybernetics.

[12]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Valer Jurcak,et al.  10/20, 10/10, and 10/5 systems revisited: Their validity as relative head-surface-based positioning systems , 2007, NeuroImage.

[14]  Mathilde M. Bekker,et al.  Designing Kinect games to train motor skills for mixed ability players , 2013, GFHEU.

[15]  Franca Garzotto,et al.  Exploring motion-based touchless games for autistic children's learning , 2013, IDC.

[16]  S. Baron-Cohen,et al.  Task-related functional connectivity in autism spectrum conditions: an EEG study using wavelet transform coherence , 2013, Molecular Autism.

[17]  Gina Green,et al.  Behavioral intervention for young children with autism: A manual for parents and professionals. , 1996 .

[18]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[19]  N. Yuill,et al.  Social benefits of a tangible user interface for children with Autistic Spectrum Conditions , 2010, Autism.

[20]  Noel Kok Hwee Chia,et al.  Design of a generic questionnaire for reflective evaluation of a virtual reality-based intervention using virtual dolphins for children with autism , 2012 .

[21]  M. Knapp,et al.  Costs of autism spectrum disorders in the United Kingdom and the United States. , 2014, JAMA pediatrics.

[22]  Hai-Son Le,et al.  Kinect Gesture Recognition: SVM vs. RVM , 2015, 2015 Seventh International Conference on Knowledge and Systems Engineering (KSE).

[23]  S. Baron-Cohen,et al.  Prevalence of autism in mainland China, Hong Kong and Taiwan: a systematic review and meta-analysis , 2013, Molecular Autism.

[24]  Junichi Ushiba,et al.  EEG-based classification of imaginary left and right foot movements using beta rebound , 2013, Clinical Neurophysiology.

[25]  Tanja Schultz,et al.  Hybrid fNIRS-EEG based classification of auditory and visual perception processes , 2014, Front. Neurosci..

[26]  W Lang,et al.  Electric and magnetic fields of the brain accompanying internal simulation of movement. , 1996, Brain research. Cognitive brain research.

[27]  Sebastian Bosse,et al.  EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs) , 2015, Journal of neural engineering.

[28]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[29]  Narcís Parés,et al.  Achieving dialogue with children with severe autism in an adaptive multisensory interaction: the "MEDIATE" project , 2005, IEEE Transactions on Visualization and Computer Graphics.

[30]  Weiqin Chen,et al.  Multitouch Tabletop Technology for People with Autism Spectrum Disorder: A Review of the Literature , 2012, DSAI.

[31]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[32]  Juan Pablo Hourcade,et al.  Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders , 2013, CHI.

[33]  Zhaohong Deng,et al.  Semi-Supervised SVM With Extended Hidden Features , 2016, IEEE Transactions on Cybernetics.