Benchmarking human motion analysis using kinect one: An open source dataset

There is a clear advantage to developing automated systems to detect human motion in the field of computer vision for applications associated with healthcare. We have compiled a diverse dataset of clinically-relevant motions using the Microsoft Kinect One sensor and release the dataset to the community as an open source solution for benchmarking detection, quantification and recognition algorithms. The dataset, namely Kinect 3D Active (K3Da), includes motions collected from young and older men and women ranging in age from 18-81 years. Participants performed standardised tests, including the Short Physical Performance Battery, Timed-Up-And-Go, vertical jump and other balance assessments which were recorded using depth sensor technology and extracted to generate motion capture data, sampled at 30 frames-per-second. Preliminary evaluations using Support Vector Machines, Random Forests, Artificial Neural Networks and Boltzmann Machines show age-related differences in many of the movements. These results demonstrate the relevance of the dataset to support benchmarking of algorithms associated and/or intended for use in a healthcare setting.

[1]  Dimitris N. Metaxas,et al.  Human Gait Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[2]  Vassiliki Derri,et al.  The effect of Xbox Kinect intervention on balance ability for previously injured young competitive male athletes: a preliminary study. , 2014, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[3]  Jessica K. Hodgins,et al.  Hierarchical Aligned Cluster Analysis for Temporal Clustering of Human Motion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  M. Tinetti Performance‐Oriented Assessment of Mobility Problems in Elderly Patients , 1986, Journal of the American Geriatrics Society.

[6]  Gazihan Alankus,et al.  Towards customizable games for stroke rehabilitation , 2010, CHI.

[7]  Dimitrios Makris,et al.  G3Di: A Gaming Interaction Dataset with a Real Time Detection and Evaluation Framework , 2014, ECCV Workshops.

[8]  P. Verschure,et al.  Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation , 2010, Journal of NeuroEngineering and Rehabilitation.

[9]  H. Boter,et al.  Prevalence of Frailty in Community‐Dwelling Older Persons: A Systematic Review , 2012, Journal of the American Geriatrics Society.

[10]  David J. Ketchen,et al.  THE APPLICATION OF CLUSTER ANALYSIS IN STRATEGIC MANAGEMENT RESEARCH: AN ANALYSIS AND CRITIQUE , 1996 .

[11]  Francisco Javier Díaz Pernas,et al.  A Kinect-based system for cognitive rehabilitation exercises monitoring , 2014, Comput. Methods Programs Biomed..

[12]  Alfredo Petrosino,et al.  Human activity modeling by spatio temporal textural appearance , 2013, Pattern Recognit. Lett..

[13]  John Darby,et al.  Exemplar-Based Human Action Recognition with Template Matching from a Stream of Motion Capture , 2014, ICIAR.

[14]  Karl Swedberg,et al.  Six minute walk test. , 2005, European heart journal.

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[17]  Dimitrios Makris,et al.  G3D: A gaming action dataset and real time action recognition evaluation framework , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Diane Podsiadlo,et al.  The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly Persons , 1991, Journal of the American Geriatrics Society.

[19]  Helena M. Mentis,et al.  Instructing people for training gestural interactive systems , 2012, CHI.

[20]  Yang Yang,et al.  Reliability and Validity of Kinect RGB-D Sensor for Assessing Standing Balance , 2014, IEEE Sensors Journal.

[21]  L. Ferrucci,et al.  A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. , 1994, Journal of gerontology.

[22]  Moritz Tenorth,et al.  The TUM Kitchen Data Set of everyday manipulation activities for motion tracking and action recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[23]  M. Brusco,et al.  A variable-selection heuristic for K-means clustering , 2001 .

[24]  Gérard G. Medioni,et al.  Home Monitoring Musculo-skeletal Disorders with a Single 3D Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Albert A. Rizzo,et al.  Development and evaluation of low cost game-based balance rehabilitation tool using the microsoft kinect sensor , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[27]  Ying Wu,et al.  Mining actionlet ensemble for action recognition with depth cameras , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Moi Hoon Yap,et al.  Atlas-registration based image segmentation of MRI human thigh muscles in 3D space , 2014, Medical Imaging.

[29]  Alessio Del Bue,et al.  Re-identification with RGB-D Sensors , 2012, ECCV Workshops.

[30]  John Darby,et al.  Human Activity Recognition for Physical Rehabilitation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[31]  Mathieu Barnachon,et al.  Ongoing human action recognition with motion capture , 2014, Pattern Recognit..

[32]  Geoffrey E. Hinton,et al.  Modeling Human Motion Using Binary Latent Variables , 2006, NIPS.

[33]  Kingshuk Chakravarty,et al.  Pose Based Person Identification Using Kinect , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[34]  Alex Mihailidis,et al.  A MARKERLESS MOTION TRACKING APPROACH TO UNDERSTAND CHANGES IN GAIT AND BALANCE : A CASE STUDY , 2013 .

[35]  Dejan Gjorgjevikj,et al.  Evaluation of different feature sets for gait recognition using skeletal data from Kinect , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[36]  Marco Grangetto,et al.  Gait characterization using dynamic skeleton acquisition , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[37]  i-LIDS Team,et al.  Imagery Library for Intelligent Detection Systems (i-LIDS); A Standard for Testing Video Based Detection Systems , 2006, Proceedings 40th Annual 2006 International Carnahan Conference on Security Technology.

[38]  Andrew Blake,et al.  Efficient Human Pose Estimation from Single Depth Images , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Bart Selman,et al.  Unstructured human activity detection from RGBD images , 2011, 2012 IEEE International Conference on Robotics and Automation.

[40]  Ran Gilad-Bachrach,et al.  Full body gait analysis with Kinect , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[42]  Bülent Sankur,et al.  Graph-based analysis of physical exercise actions , 2013, MIIRH '13.

[43]  Cordelia Schmid,et al.  Actions in context , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.