Self-Stimulatory Behaviours in the Wild for Autism Diagnosis

Autism Spectrum Disorders (ASD), often referred to as autism, are neurological disorders characterised by deficits in cognitive skills, social and communicative behaviours. A common way of diagnosing ASD is by studying behavioural cues expressed by the children. We introduce a new publicly-available dataset of children videos exhibiting self-stimulatory (stimming) behaviours commonly used for autism diagnosis. These videos, posted by parents/caregivers in public domain websites, are collected and annotated for the stimming behaviours. These videos are extremely challenging for automatic behaviour analysis as they are recorded in uncontrolled natural settings. The dataset contains 75 videos with an average duration of 90 seconds per video, grouped under three categories of stimming behaviours: arm flapping, head banging and spinning. We also provide baseline results of tests conducted on this dataset using a standard bag of words approach for human action recognition. To the best of our knowledge, this is the first attempt in publicly making available a Self-Stimulatory Behaviour Dataset (SSBD) of children videos recorded in natural settings.

[1]  Roland Göcke,et al.  Can body expressions contribute to automatic depression analysis? , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[2]  Jessica Brian,et al.  The Autism Observation Scale for Infants: Scale Development and Reliability Data , 2008, Journal of autism and developmental disorders.

[3]  Andrea Kleinsmith,et al.  Affective Body Expression Perception and Recognition: A Survey , 2013, IEEE Transactions on Affective Computing.

[4]  A. Couteur,et al.  Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders , 1994, Journal of autism and developmental disorders.

[5]  James M. Rehg,et al.  Decoding Children's Social Behavior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[9]  Vassilios Morellas,et al.  A computer vision approach for the assessment of autism-related behavioral markers , 2012, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[10]  Tamás D. Gedeon,et al.  Collecting Large, Richly Annotated Facial-Expression Databases from Movies , 2012, IEEE MultiMedia.

[11]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[12]  J. Brian,et al.  Behavioral manifestations of autism in the first year of life , 2005, International Journal of Developmental Neuroscience.

[13]  James M. Rehg Behavior Imaging: Using Computer Vision to Study Autism , 2011, MVA.