A Video-Based Method for Automatically Rating Ataxia

For many movement disorders, such as Parkinson’s disease and ataxia, disease progression is visually assessed by a clinician using a numerical disease rating scale. These tests are subjective, time-consuming, and must be administered by a professional. This can be problematic where specialists are not available, or when a patient is not consistently evaluated by the same clinician. We present an automated method for quantifying the severity of motion impairment in patients with ataxia, using only video recordings. We consider videos of the finger-to-nose test, a common movement task used as part of the assessment of ataxia progression during the course of routine clinical checkups. Our method uses neural network-based pose estimation and optical flow techniques to track the motion of the patient’s hand in a video recording. We extract features that describe qualities of the motion such as speed and variation in performance. Using labels provided by an expert clinician, we train a supervised learning model that predicts severity according to the Brief Ataxia Rating Scale (BARS). The performance of our system is comparable to that of a group of ataxia specialists in terms of mean error and correlation, and our system’s predictions were consistently within the range of inter-rater variability. This work demonstrates the feasibility of using computer vision and machine learning to produce consistent and clinically useful measures of motor impairment.

[1]  Bernt Schiele,et al.  2D Human Pose Estimation: New Benchmark and State of the Art Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Antonio Torralba,et al.  Assessing the Quality of Actions , 2014, ECCV.

[3]  Pavan K. Turaga,et al.  Dynamical Regularity for Action Analysis , 2015, BMVC.

[4]  J. Schmahmann,et al.  Disorders of the cerebellum: ataxia, dysmetria of thought, and the cerebellar cognitive affective syndrome. , 2004, The Journal of neuropsychiatry and clinical neurosciences.

[5]  D. Sutherland The evolution of clinical gait analysis. Part II kinematics. , 2002, Gait & posture.

[6]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[10]  Jeremy D. Schmahmann,et al.  Development of a brief ataxia rating scale (BARS) based on a modified form of the ICARS , 2009, Movement disorders : official journal of the Movement Disorder Society.

[11]  J. Jankovic,et al.  Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results , 2008, Movement disorders : official journal of the Movement Disorder Society.

[12]  Andrew Zisserman,et al.  Upper Body Pose Estimation with Temporal Sequential Forests , 2014, BMVC.

[13]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[14]  C. Bregler,et al.  Large displacement optical flow , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[16]  Pietro Caliandro,et al.  Gait measures with a triaxial accelerometer among patients with neurological impairment , 2013, Neurological Sciences.

[17]  Joseph P. Giuffrida,et al.  Clinically deployable Kinesia™ technology for automated tremor assessment , 2009, Movement disorders : official journal of the Movement Disorder Society.

[18]  L. Baliko,et al.  Scale for the assessment and rating of ataxia , 2006, Neurology.

[19]  Thomas Klockgether,et al.  Sporadic ataxia with adult onset: classification and diagnostic criteria , 2010, The Lancet Neurology.

[20]  Markus Frings,et al.  Reliability and validity of the scale for the assessment and rating of ataxia: A study in 64 ataxia patients , 2007, Movement disorders : official journal of the Movement Disorder Society.

[21]  Pavan K. Turaga,et al.  Attractor-Shape for Dynamical Analysis of Human Movement: Applications in Stroke Rehabilitation and Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[23]  Günther Deuschl,et al.  Projected numbers of people with movement disorders in the years 2030 and 2050 , 2011, Movement disorders : official journal of the Movement Disorder Society.

[24]  Fary Khan,et al.  The use of laboratory gait analysis for understanding gait deterioration in people with multiple sclerosis , 2016, Multiple sclerosis.

[25]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[26]  M. Hallett,et al.  International Cooperative Ataxia Rating Scale for pharmacological assessment of the cerebellar syndrome , 1997, Journal of the Neurological Sciences.

[27]  Kurt Keutzer,et al.  Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow , 2010, ECCV.

[28]  Björn Eskofier,et al.  Automatic recognition of Parkinson's disease using surface electromyography during standardized gait tests , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  Jeffrey M. Hausdorff,et al.  Toward Automated, At-Home Assessment of Mobility Among Patients With Parkinson Disease, Using a Body-Worn Accelerometer , 2011, Neurorehabilitation and neural repair.