Automated Fine Motor Evaluation for Developmental Coordination Disorder

Developmental coordination disorder (DCD) is a type of motor learning difficulty that affects five to six percent of school-aged children, which may have a negative impact on the life of the sufferers. Timely and objective diagnosis of DCD are important for the success of the intervention. The present evaluation methods of DCD rely heavily on the observational analysis of occupational therapists and physiotherapists, who score the performance when children conduct some designed tasks. However, these methods are expensive, subjective, and are not easy to expand to a larger population. A fine motor evaluation system (FMES) is proposed with two views of cameras to record children’s performance, when they carry out three fine motor tasks. Automated algorithms are developed to perform automated scoring of fine motor skill. The automated algorithms include task localization and individual task evaluation. The purpose of task localization is to detect each task and extract segments belonging to each task from the original video that includes multiple segments of different tasks. A convolutional neural network with temporal filtering is used to do frame-wise classification, and a boundary localization algorithm is proposed to localize each task segment. For individual task evaluation, the extracted video segments of task 1 and task 2 are evaluated based on the proposed feature extraction and time positioning algorithm, and the paper drawings of task 3 are evaluated based on image processing. The proposed methods are validated on a diverse population of children with or without DCD by comparing automated scoring with manual scoring from a professional evaluator. The experimental results suggest that the proposed methods can effectively achieve fine motor evaluation for DCD assessment. Besides, our system is a low-cost solution, and the evaluation methods developed are automated, objective, and can be suited for large population evaluation and analysis.

[1]  Ruimin Li,et al.  Evaluation of the fine motor skills of children with DCD using the digitalised visual-motor tracking system , 2018 .

[2]  Kate Wilmut,et al.  Level walking in adults with and without Developmental Coordination Disorder: An analysis of movement variability. , 2015, Human movement science.

[3]  A. Barnett,et al.  When an object appears unexpectedly: anticipatory movement and object circumvention in individuals with and without Developmental Coordination Disorder , 2017, Experimental Brain Research.

[4]  Li Fei-Fei,et al.  End-to-End Learning of Action Detection from Frame Glimpses in Videos , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Isaac Skog,et al.  Modeling, Detecting, and Tracking Freezing of Gait in Parkinson Disease Using Inertial Sensors , 2018, IEEE Transactions on Biomedical Engineering.

[6]  Amanda Kirby,et al.  Children with developmental coordination disorders , 2007, Journal of the Royal Society of Medicine.

[7]  Mia Pless,et al.  Effects of Motor Skill Intervention on Developmental Coordination Disorder: A Meta-Analysis , 2000 .

[8]  Ted Brown,et al.  Movement Assessment Battery for Children: 2nd Edition (MABC-2) , 2018 .

[9]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Bernard Ghanem,et al.  End-to-End, Single-Stream Temporal Action Detection in Untrimmed Videos , 2017, BMVC.

[11]  B C M Smits-Engelsman,et al.  The efficacy of two task-orientated interventions for children with Developmental Coordination Disorder: Neuromotor Task Training and Nintendo Wii Fit Training. , 2013, Research in developmental disabilities.

[12]  R. Nevatia,et al.  TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Kate Saenko,et al.  R-C3D: Region Convolutional 3D Network for Temporal Activity Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  K. Wilmut,et al.  Gait patterns in children with Developmental Coordination Disorder , 2016, Experimental Brain Research.

[15]  Shih-Fu Chang,et al.  Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Moataz Eltoukhy,et al.  Evaluation of the Performance of Digital Video Analysis of Human Motion: Dartfish Tracking System , 2012 .

[17]  Guillermo Sapiro,et al.  Computer Vision Analysis for Quantification of Autism Risk Behaviors , 2018, IEEE Transactions on Affective Computing.

[18]  R. Mombarg,et al.  Movement assessment battery for children , 2019 .

[19]  D. Coetzee,et al.  The role of visual functions in persisting developmental coordination disorder (DCD) among 7-year-old children : a follow-up study : kinderkinetics , 2010 .

[20]  Jill G. Zwicker,et al.  Developmental coordination disorder: a review and update. , 2012, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[21]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[22]  H Ghasemzadeh,et al.  Coordination Analysis of Human Movements With Body Sensor Networks: A Signal Processing Model to Evaluate Baseball Swings , 2011, IEEE Sensors Journal.

[23]  Reint Geuze,et al.  Diagnostic criteria for DCD: Past and future. , 2015, Human movement science.

[24]  D. Larkin,et al.  Developmental Coordination Disorder , 2001 .

[25]  Bernard Ghanem,et al.  SST: Single-Stream Temporal Action Proposals , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Petros Daras,et al.  Quaternionic Signal Processing Techniques for Automatic Evaluation of Dance Performances From MoCap Data , 2014, IEEE Transactions on Multimedia.

[27]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[28]  J. Visser,et al.  Developmental coordination disorder: a review of research on subtypes and comorbidities. , 2003, Human movement science.

[29]  Bin Li,et al.  A markerless visual-motor tracking system for behavior monitoring in DCD assessment , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[30]  Wenjun Zeng,et al.  Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks , 2016, ECCV.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  D. De Clercq,et al.  Visual contribution to walking in children with Developmental Coordination Disorder. , 2006, Child: care, health and development.

[33]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[34]  Bingbing Ni,et al.  Temporal Action Localization with Pyramid of Score Distribution Features , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Amanda Kirby,et al.  Children with Developmental Coordination Disorder , 2005 .

[36]  L. DeStefano Bruininks-Oseretsky Test of Motor Proficiency , 2008 .