A general descriptor for detecting abnormal action performance from skeletal data

We propose an action-independent descriptor for detecting abnormality in motion, based on medically-inspired skeletal features. The descriptor is tested on four actions/motions captured using a single depth camera: sit-to-stand, stand-to-sit, flat-walk, and climbing-stairs. For each action, a Gaussian Mixture Model (GMM) trained on normal motions is built using the action-independent feature descriptor. Test sequences are evaluated based on their fitness to the normal motion models, with a threshold over the likelihood, to assess abnormality. Results show that the descriptor is able to detect abnormality with accuracy ranging from 0.97 to 1 for the various motions.

[1]  David E Krebs,et al.  Is base of support greater in unsteady gait? , 2002, Physical therapy.

[2]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[4]  Kara K. Patterson,et al.  Evaluation of gait symmetry after stroke: a comparison of current methods and recommendations for standardization. , 2010, Gait & posture.

[5]  Gérard G. Medioni,et al.  Home Monitoring Musculo-skeletal Disorders with a Single 3D Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[6]  J. Jankovic Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[7]  Antonio Torralba,et al.  Assessing the Quality of Actions , 2014, ECCV.

[8]  Majid Mirmehdi,et al.  A comparative study of pose representation and dynamics modelling for online motion quality assessment , 2016, Comput. Vis. Image Underst..

[9]  Marjorie Skubic,et al.  Automated health alerts from kinect-based in-home gait measurements , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.