Physiological Function Assessment Based on Kinect V2

This paper presented a framework based on fog computing for convenient and efficient Physiological Function Assessment, which consists of three parts: 1)measuring the degree of joint mobility; 2) investigating the abnormality of actions of upper limbs; and 3) abnormal gait detection for lower limbs. Especially, we introduced semi-automatic Rapid Upper Limb Assessment (RULA) using Kinect v2 for the upper limb motion evaluation. Since a specific action can be described by action sequences of different length, we used dynamic time warping (DTW) to find the similarity between action sequences with different length. Traditional DTW algorithm does not work well when the action sequences are long and complex. To address this problem, we improved the DTW method by modifying the mapping relationship and limiting the computation space. Our modified DTW algorithm was evaluated on a standard 3D action dataset (SYSU 3D HOI) and Human Upper Action dataset (HUA), achieving the accuracy of 83.75%, 89.50%, respectively. The result is significantly better than the traditional DTW and the reported methods. In our previous work, we described the framework and how to make physiological function assessment. The goal of this paper is to 1) enrich the experiments of previous work and 2) introduce the framework of using RULA for physiological function assessment. All the tests have been done in this framework based on fog computing.

[1]  B Bonnechère,et al.  Validity and reliability of the Kinect within functional assessment activities: comparison with standard stereophotogrammetry. , 2014, Gait & posture.

[2]  Meinard Müller,et al.  Dynamic Time Warping , 2008 .

[3]  M. Shamim Hossain,et al.  Cloud-assisted Industrial Internet of Things (IIoT) - Enabled framework for health monitoring , 2016, Comput. Networks.

[4]  Alexandre Bernardino,et al.  A dataset for the automatic assessment of functional senior fitness tests using kinect and physiological sensors , 2016, 2016 1st International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW).

[5]  Zicheng Liu,et al.  HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Gang Wang,et al.  Multi-modal feature fusion for action recognition in RGB-D sequences , 2014, 2014 6th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[7]  Zhiquan He,et al.  Physiological Function Assessment Based on RGB-D Camera , 2018, 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[8]  Sara Dockrell,et al.  An investigation of the reliability of Rapid Upper Limb Assessment (RULA) as a method of assessment of children's computing posture. , 2012, Applied ergonomics.

[9]  Sobia Arshad,et al.  A Challenging Demand Side Power Management through Smart Embedded Meter System , 2014 .

[10]  Wei-Shi Zheng,et al.  Jointly Learning Heterogeneous Features for RGB-D Activity Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[12]  Jesse Hoey,et al.  3D Pose tracking of walker users' lower limb with a structured-light camera on a moving platform , 2011, CVPR 2011 WORKSHOPS.

[13]  Penny Standen,et al.  A study to evaluate a low cost virtual reality system for home based rehabilitation of the upper limb following stroke , 2011 .

[14]  L McAtamney,et al.  RULA: a survey method for the investigation of work-related upper limb disorders. , 1993, Applied ergonomics.

[15]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[16]  D. Sharma,et al.  Senior health monitoring using Kinect , 2012, 2012 Fourth International Conference on Communications and Electronics (ICCE).

[17]  Junsong Yuan,et al.  Learning Actionlet Ensemble for 3D Human Action Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Saeid Nahavandi,et al.  Real Time Ergonomic Assessment for Assembly Operations Using Kinect , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[19]  Chih-Chen Chen,et al.  Improvement in the physiological function and standing stability based on kinect multimedia for older people , 2016, Journal of physical therapy science.

[20]  Thi-Lan Le,et al.  Human posture recognition using human skeleton provided by Kinect , 2013, 2013 International Conference on Computing, Management and Telecommunications (ComManTel).

[21]  M. Waseem,et al.  The Frozen Shoulder: Myths and Realities , 2013, The open orthopaedics journal.

[22]  Begonya Garcia-Zapirain,et al.  Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications , 2014, Sensors.

[23]  Arif Mahmood,et al.  Real time action recognition using histograms of depth gradients and random decision forests , 2014, IEEE Winter Conference on Applications of Computer Vision.

[24]  Kelly J. Bower,et al.  Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. , 2013, Journal of biomechanics.

[25]  S McEwen,et al.  Disablement following stroke. , 1999, Disability and rehabilitation.

[26]  Youfu Li,et al.  DSRF: A flexible trajectory descriptor for articulated human action recognition , 2018, Pattern Recognit..

[27]  Robert Jurmain,et al.  Osteoarthritis revisited: a contemporary review of aetiology , 2007 .

[28]  J. Kanis,et al.  DIAGNOSIS OF OSTEOPOROSIS , 2016 .

[29]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[30]  Hiroaki Sakoe,et al.  A Dynamic Programming Approach to Continuous Speech Recognition , 1971 .

[31]  Danuta Roman-Liu,et al.  Comparison of concepts in easy-to-use methods for MSD risk assessment. , 2014, Applied ergonomics.

[32]  Franck Multon,et al.  Validation of an ergonomic assessment method using Kinect data in real workplace conditions. , 2017, Applied ergonomics.

[33]  Franck Multon,et al.  Pose Estimation with a Kinect for Ergonomic Studies: Evaluation of the Accuracy Using a Virtual Mannequin , 2015, Sensors.

[34]  Gianpaolo Francesco Trotta,et al.  Real time RULA assessment using Kinect v2 sensor. , 2017, Applied ergonomics.

[35]  Holger Karl,et al.  Specification of Complex Structures in Distributed Service Function Chaining Using a YANG Data Model , 2015, ArXiv.

[36]  Nicholas M. DiFilippo,et al.  Characterization of Different Microsoft Kinect Sensor Models , 2015, IEEE Sensors Journal.

[37]  Lianjie Li,et al.  [Construction and analysis of a monitoring system with remote real-time multiple physiological parameters based on cloud computing]. , 2014, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.