Mining Human Mobility to Quantify Performance Status

Human mobility has been studied extensively in various biomedical contexts with applications in clinical rehabilitation, disease diagnosis, health risk prognosis, and general performance assessments. In this paper, we present ATOMHP (Analytical Technologies to Objectively Measure Human Performance) Kinect: a system to objectively quantify human performance using the Microsoft Kinect as a single camera sensor to capture human mobility. We explore the viability of this noninvasive performance assessment system by studying a cohort of cancer patients undergoing various therapy regimens who are assigned a performance score based on a qualitative clinical test. The ATOM-HP Kinect is a clinically usable system which consists of tools for Kinect, clinical data collection, data quality validation, and mobility feature extraction, which can be used for downstream analysis of performance. Preliminary results based on the clinical case study indicate that ATOM-HP Kinect can quantify changes in kinematic parameters, and that these features are correlated with clinically measured risk factors which could be used for early prediction of diseases, or making decision on treatment modification.

[1]  Olivier Beauchet,et al.  Guidelines for clinical applications of spatio-temporal gait analysis in older adults , 2006, Aging clinical and experimental research.

[2]  Diane Podsiadlo,et al.  The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly Persons , 1991, Journal of the American Geriatrics Society.

[3]  J. Sloan,et al.  Patient‐physician disagreement regarding performance status is associated with worse survivorship in patients with advanced cancer , 2008, Cancer.

[4]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[5]  Emil Frei,et al.  Appraisal of methods for the study of chemotherapy of cancer in man: Comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramide , 1960 .

[6]  Farnoush Banaei Kashani,et al.  Monitoring mobility disorders at home using 3D visual sensors and mobile sensors , 2013, Wireless Health.

[7]  Ruzena Bajcsy,et al.  Evaluation of upper extremity reachable workspace using Kinect camera. , 2013, Technology and health care : official journal of the European Society for Engineering and Medicine.

[8]  R. Baker Gait analysis methods in rehabilitation , 2006, Journal of NeuroEngineering and Rehabilitation.

[9]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[10]  E. Salmon,et al.  Gait analysis in elderly adult patients with mild cognitive impairment and patients with mild Alzheimer’s disease: simple versus dual task: a preliminary report , 2010, Clinical physiology and functional imaging.

[11]  Norlena Salamuddin,et al.  Energy Expenditure through Walking: Meta Analysis on Gender and Age , 2010 .

[12]  Tao Liu,et al.  Gait Analysis Using Wearable Sensors , 2012, Sensors.

[13]  A Leardini,et al.  An anatomically based protocol for the description of foot segment kinematics during gait. , 1999, Clinical biomechanics.

[14]  Ian N. Olver,et al.  Observer error in grading performance status in cancer patients , 1999 .

[15]  Matthias Kranz,et al.  GymSkill: A personal trainer for physical exercises , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[16]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[17]  Armin Shahrokni,et al.  Moving beyond Karnofsky and ECOG Performance Status Assessments with New Technologies , 2016, Journal of oncology.

[18]  Jeffrey M. Hausdorff,et al.  A new measure for quantifying the bilateral coordination of human gait: effects of aging and Parkinson’s disease , 2007, Experimental Brain Research.

[19]  Antonio Ortega,et al.  Validation of Automated Mobility Assessment Using a Single 3D Sensor , 2016, ECCV Workshops.

[20]  E. McFadden,et al.  Toxicity and response criteria of the Eastern Cooperative Oncology Group , 1982, American journal of clinical oncology.

[21]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[22]  J Walsh,et al.  A pilot study comparing objective physical activity to the physical component of the Eastern Cooperative Oncology Group (ECOG) performance status scale. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[23]  Shane S. Sturrock,et al.  Time Warps, String Edits, and Macromolecules – The Theory and Practice of Sequence Comparison . David Sankoff and Joseph Kruskal. ISBN 1-57586-217-4. Price £13.95 (US$22·95). , 2000 .