Automatic Detection of ADHD and ASD from Expressive Behaviour in RGBD Data

Attention Deficit Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) are neurodevelopmental conditions which impact on a significant number of children and adults. Currently, the diagnosis of such disorders is done by experts who employ standard questionnaires and look for certain behavioural markers through manual observation. Such methods for their diagnosis are not only subjective, difficult to repeat, and costly but also extremely time consuming. In this work, we present a novel methodology to aid diagnostic predictions about the presence/absence of ADHD and ASD by automatic visual analysis of a persons behaviour. To do so, we conduct the questionnaires in a computer-mediated way while recording participants with modern RGBD (Colour+Depth) sensors. In contrast to previous automatic approaches which have focussed only on detecting certain behavioural markers, our approach provides a fully automatic end-to-end system to directly predict ADHD and ASD in adults. Using state of the art facial expression analysis based on Dynamic Deep Learning and 3D analysis of behaviour, we attain classification rates of 96% for Controls vs Condition (ADHD/ASD) groups and 94% for Comorbid (ADHD+ASD) vs ASD only group. We show that our system is a potentially useful time saving contribution to the clinical diagnosis of ADHD and ASD.

[1]  G. Weiss,et al.  Psychiatric status of hyperactives as adults: a controlled prospective 15-year follow-up of 63 hyperactive children. , 1985, Journal of the American Academy of Child Psychiatry.

[2]  Ronald C Kessler,et al.  Validity of the World Health Organization Adult ADHD Self‐Report Scale (ASRS) Screener in a representative sample of health plan members , 2007, International journal of methods in psychiatric research.

[3]  Roland Göcke,et al.  Detecting self-stimulatory behaviours for autism diagnosis , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Marc Parizeau,et al.  A Comparative Analysis of Regional Correlation, Dynamic Time Warping, and Skeletal Tree Matching for Signature Verification , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  R. Landa,et al.  Association between severity of behavioral phenotype and comorbid attention deficit hyperactivity disorder symptoms in children with autism spectrum disorders , 2014, Autism : the international journal of research and practice.

[6]  F. Happé.  An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults , 1994, Journal of autism and developmental disorders.

[7]  Agata Rozga,et al.  Play with me — Measuring a child's engagement in a social interaction , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[8]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Mohammad H. Mahoor,et al.  Social risk and depression: Evidence from manual and automatic facial expression analysis , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[10]  Maja Pantic,et al.  Fully Automatic Recognition of the Temporal Phases of Facial Actions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Vassilios Morellas,et al.  A multi-sensor visual tracking system for behavior monitoring of at-risk children , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  James M. Rehg.  Behavior Imaging: Using Computer Vision to Study Autism , 2011, MVA.

[14]  Katherine B. Martin,et al.  Facial Action Coding System , 2015 .

[15]  S. Bálint,et al.  Prevalence and correlates of adult attention-deficit hyperactivity disorder: meta-analysis , 2009, British Journal of Psychiatry.

[16]  Henrik Larsson,et al.  Genetic and environmental contributions to stability and change of ADHD symptoms between 8 and 13 years of age: a longitudinal twin study. , 2004, Journal of the American Academy of Child and Adolescent Psychiatry.

[17]  Olga V. Demler,et al.  The World Health Organization adult ADHD self-report scale (ASRS): a short screening scale for use in the general population , 2005, Psychological Medicine.

[18]  Sergio Escalera,et al.  ADHD indicators modelling based on Dynamic Time Warping from RGBD data : A feasibility study , 2011 .

[19]  Lijun Yin,et al.  FERA 2015 - second Facial Expression Recognition and Analysis challenge , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[20]  R. Gur,et al.  Automated video-based facial expression analysis of neuropsychiatric disorders , 2008, Journal of Neuroscience Methods.

[21]  Michel F. Valstar,et al.  Cascaded Continuous Regression for Real-time Incremental Face Tracking , 2016, ECCV.

[22]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[23]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[24]  Michel F. Valstar,et al.  Automatic Behaviour Understanding in Medicine , 2014, RFMIR '14.

[25]  Florence Levy,et al.  Characterizing the ADHD phenotype for genetic studies. , 2005, Developmental science.

[26]  Luc Van Gool,et al.  Face Detection without Bells and Whistles , 2014, ECCV.

[27]  Vassilios Morellas,et al.  Computer vision tools for the non-invasive assessment of autism-related behavioral markers , 2012, ArXiv.

[28]  G. Arbanas.  Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[29]  Fernando De la Torre,et al.  Selective Transfer Machine for Personalized Facial Action Unit Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Joseph Biederman,et al.  Attention-deficit/hyperactivity disorder: diagnosis, lifespan, comorbidities, and neurobiology. , 2007, Journal of pediatric psychology.

[31]  R. Barkley.  Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. , 1997, Psychological bulletin.

[32]  Maja Pantic,et al.  The first facial expression recognition and analysis challenge , 2011, Face and Gesture 2011.

[33]  Subramanian Ramanathan,et al.  A Multi-Task Learning Framework for Head Pose Estimation under Target Motion , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Michel F. Valstar,et al.  Deep learning the dynamic appearance and shape of facial action units , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).