Fuzzy logic and differential evolution-based hybrid system for gesture recognition using Kinect sensor

Expert Systems. 2017;e12210. https://doi.org/10.1111/exsy.12210 Abstract The paper introduces a novel approach to gesture recognition aimed at physical disorder identification capable of handling variations in disorder expressions. The gestures are captured by Microsoft's Kinect sensor. The work is segmented into four main parts. The first stage describes a “relax” posture through four centroids depicting four portions of the skeletal structure. In the second stage, when the subject is showing symptoms of any one of the 16 physical disorders, then the skeletal structure distorts; the bilateral structure is lost, and concept of “centroid” computation does not seem relevant. Hence, in the second stage, “motion points” depicting shifted centroids for the distorted posture are computed by distance maximization with respect to the four corresponding centroids obtained for the relax posture. This process is carried out by adapting the weights assigned to each joint by differential evolution. In the third stage, eight features are figured out on the basis of Euclidean distances and angles among the motion points of the distorted gesture. In the final stage, gestures are recognized using an interval type‐2 fuzzy set‐based classifier with 91.37% accuracy.

[1]  Mariusz Oszust,et al.  Recognition of signed expressions observed by Kinect Sensor , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[2]  Yinghua Lin,et al.  Building a Fuzzy System from Input-Output Data , 1994, J. Intell. Fuzzy Syst..

[3]  Xiaoyi Yu,et al.  Children tantrum behaviour analysis based on Kinect sensor , 2011, 2011 Third Chinese Conference on Intelligent Visual Surveillance.

[4]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[5]  John Solaro,et al.  The Kinect Digital Out-of-Box Experience , 2011, Computer.

[6]  Jerry M. Mendel,et al.  On the importance of interval sets in type-2 fuzzy logic systems , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[9]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[10]  Yung-Yaw Chen,et al.  Human Posture Recognition by Simple Rules , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[11]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[12]  Mariano Rincón,et al.  A block-based model for monitoring of human activity , 2011, Neurocomputing.

[13]  Gang Feng,et al.  Design of Fuzzy Control Systems Based on State Feedback , 1995, J. Intell. Fuzzy Syst..

[14]  George J. Klir,et al.  Genetic algorithms for determining fuzzy measures from data , 1998, J. Intell. Fuzzy Syst..

[15]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[16]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[17]  Larry S. Davis,et al.  Ghost: a human body part labeling system using silhouettes , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Thi-Lan Le,et al.  Human posture recognition using human skeleton provided by Kinect , 2013, 2013 International Conference on Computing, Management and Telecommunications (ComManTel).

[19]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Baining Guo,et al.  Kinect Identity: Technology and Experience , 2011, Computer.

[21]  Sergios Theodoridis,et al.  Introduction to Pattern Recognition: A Matlab Approach , 2010 .

[22]  Weidong Wu,et al.  A coordination method for fuzzy multi-objective optimization of system reliability , 2005, J. Intell. Fuzzy Syst..

[23]  Tom M. Mitchell,et al.  Machine Learning and Data Mining , 2012 .

[24]  Monique Thonnat,et al.  Posture recognition with a 3D human model , 2005 .

[25]  D. Sharma,et al.  Senior health monitoring using Kinect , 2012, 2012 Fourth International Conference on Communications and Electronics (ICCE).

[26]  Sriparna Saha,et al.  Neural Network Based Gesture Recognition for Elderly Health Care Using Kinect Sensor , 2013, SEMCCO.

[27]  Amit Konar,et al.  General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[29]  Kuhu Pal,et al.  Handling of inconsistent rules with an extended model of fuzzy reasoning , 1999, J. Intell. Fuzzy Syst..

[30]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[31]  C. C. Martin,et al.  A real-time ergonomic monitoring system using the Microsoft Kinect , 2012, 2012 IEEE Systems and Information Engineering Design Symposium.

[32]  Chris Harris,et al.  Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation , 2013, IEEE Transactions on Biomedical Engineering.

[33]  Yuanguo Zhu,et al.  Expected values of functions of fuzzy variables , 2006, J. Intell. Fuzzy Syst..

[34]  Mark T. Bolas,et al.  Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect , 2012, VR.