Posture Recognition Technology Based on Kinect

SUMMARY Aiming at the complexity of posture recognition with Kinect, a method of posture recognition using distance characteristics is proposed. Firstly, depth image data was collected by Kinect, and three- dimensional coordinate information of 20 skeleton joints was obtained. Secondly, according to the contribution of joints to posture expression, 60 dimensional Kinect skeleton joint data was transformed into a vector of 24-dimensional distance characteristics which were normalized according to the human body structure. Thirdly, a static posture recognition method of the shortest distance and a dynamic posture recognition method of the minimum accumulative distance with dynamic time warping (DTW) were proposed. The experimental results showed that the recognition rates of static postures, non-cross-subject dynamic postures and cross-subject dynamic postures were 95.9%, 93.6% and 89.8% respectively. Finally, pos- ture selection, Kinect placement, and comparisons with literatures were discussed, which provides a reference for Kinect based posture recognition technology and interaction design.

[1]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[2]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Randal C. Nelson,et al.  Recognition of motion from temporal texture , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[5]  Jie Yao,et al.  Arm gesture detection in a classroom environment , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[6]  Aaron Hertzmann,et al.  Learning Non-Rigid 3D Shape from 2D Motion , 2003, NIPS.

[7]  Ramakant Nevatia,et al.  Single View Human Action Recognition using Key Pose Matching and Viterbi Path Searching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[9]  Liang-Tien Chia,et al.  Motion Context: A New Representation for Human Action Recognition , 2008, ECCV.

[10]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[11]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Hrvoje Benko,et al.  Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface , 2008 .

[13]  Ming Yang,et al.  Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor , 2009, ACM Multimedia.

[14]  Samsu Sempena,et al.  Human action recognition using Dynamic Time Warping , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[15]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[16]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[17]  Kin Fun Li,et al.  A Web-Based Sign Language Translator Using 3D Video Processing , 2011, 2011 14th International Conference on Network-Based Information Systems.

[18]  Jake K. Aggarwal,et al.  Human detection using depth information by Kinect , 2011, CVPR 2011 WORKSHOPS.

[19]  Albert A. Rizzo,et al.  Interactive game-based rehabilitation using the Microsoft Kinect , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[20]  Ying Wu,et al.  Robust 3D Action Recognition with Random Occupancy Patterns , 2012, ECCV.

[21]  Marco Grangetto,et al.  Gait characterization using dynamic skeleton acquisition , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[22]  Nasser Kehtarnavaz,et al.  Real-time human action recognition based on depth motion maps , 2013, Journal of Real-Time Image Processing.

[23]  Hsien-Tsung Chang,et al.  A Dynamic Fitting Room Based on Microsoft Kinect and Augmented Reality Technologies , 2013, HCI.

[24]  Xiaodong Yang,et al.  Polynormal Fisher vector for activity recognition from depth sequences , 2014, SIGGRAPH ASIA Autonomous Virtual Humans and Social Robot for Telepresence.

[25]  Fan Chen,et al.  Extraction of Discriminative Patterns from Skeleton Sequences for Accurate Action Recognition , 2014, Fundam. Informaticae.

[26]  Ho-Sub Yoon,et al.  Action Recogntion with Depth Maps Using HOG Descriptors of Multi-view Motion Appearance and History , 2014 .

[27]  Changsheng Xu,et al.  Latent Support Vector Machine Modeling for Sign Language Recognition with Kinect , 2015, ACM Trans. Intell. Syst. Technol..

[28]  Nasser Kehtarnavaz,et al.  Action Recognition from Depth Sequences Using Depth Motion Maps-Based Local Binary Patterns , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[29]  Yun Yang,et al.  Gradient Local Auto-Correlations and Extreme Learning Machine for Depth-Based Activity Recognition , 2015, ISVC.

[30]  Fei Zhang,et al.  Relative distance features for gait recognition with Kinect , 2016, Journal of Visual Communication and Image Representation.

[31]  Qiuqi Ruan,et al.  Action Recognition Using Local Consistent Group Sparse Coding with Spatio-Temporal Structure , 2016, ACM Multimedia.

[32]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[33]  Xiaoqiang Lu,et al.  Action Recognition by Jointly Using Video Proposal and Trajectory , 2018, ICVISP.

[34]  Aliaa A. A. Youssif,et al.  Real-Time Framework for Human Action Recognition , 2018, ICBET '18.

[35]  Jun Kong,et al.  Action Recognition Using Multi-Temporal DMMs Based on Adaptive Vague Division , 2018, ICIGP.

[36]  Victor M. Ruiz Penichet,et al.  Falls and Fainting Detection at Home through Movement-Based Interaction , 2018, Interacción.

[37]  Xiaoyi Feng,et al.  An Efficient Algorithm for Human Body Matting with RGB-D Data , 2018, ICVR 2018.

[38]  Wei Zhang,et al.  Temporal Sequence Distillation: Towards Few-Frame Action Recognition in Videos , 2018, ACM Multimedia.

[39]  Jingwen Li,et al.  DigiClay: An Interactive Installation for Virtual Pottery using Motion Sensing Technology , 2018, ICVR 2018.

[40]  Kaspar Jansen,et al.  Disposable, stretchable on-skin sensors for posture monitoring , 2018, WearSys@MobiSys.

[41]  Hongjun Li,et al.  Sitting Posture Recognition in Real-Time Combined with Index Map and BLS , 2019, ICIAI 2019.

[42]  Lei Geng,et al.  Posture Recognition in CT Scanning Based on HOG Feature and Mixture-of-parts Model , 2019, IMIP '19.

[43]  Marina L. Gavrilova,et al.  Multi-layer Perceptron Architecture for Kinect-Based Gait Recognition , 2019, CGI.

[44]  Cong Wang,et al.  Human Gait Recognition Based on Deterministic Learning and Data Stream of Microsoft Kinect , 2019, IEEE Transactions on Circuits and Systems for Video Technology.