An Interval Type-2 Neural Fuzzy Classifier Learned Through Soft Margin Minimization and its Human Posture Classification Application

This paper proposes an interval type-2 neural fuzzy classifier learned through soft margin minimization (IT2NFC-SMM) and applies it to human body posture classification. The IT2NFC-SMM consists of interval type-2, zero-order Takagi-Sugeno (T-S) fuzzy rules established through online structure learning. The antecedent part of the IT2NFC-SMM uses interval type-2 fuzzy sets to decrease the number of rules and manage noisy data. For parameter learning, the consequent parameters are learned through a linear support vector machine (SVM) for soft margin minimization to improve the generalization ability. The proposed SVM-based learning addresses the problem that the orders of the fuzzy rules in computing the outputs of an interval type-2 fuzzy system depend on the consequent values that are unknown in advance. To address this problem, the IT2NFC-SMM uses weighted bound-set boundaries to simplify the type-reduction operation and a novel crisp-to-interval linear SVM learning algorithm. Based on the soft margin minimization, the antecedent parameters are tuned using the gradient descent algorithm. The IT2NFC-SMM is applied to a vision-based human body posture classification system. The system uses two cameras and novel classification features extracted from a silhouette of the human body to classify the four postures of standing, bending, sitting, and lying. The classification performance of the IT2NFC-SMM is verified through results in clean and noisy classification examples and through the posture classification problem, as well as through comparisons with various type-1 and type-2 fuzzy classifiers. The overall result shows that the IT2NFC-SMM achieves higher classification rates with a smaller or similar model size than the classifiers used for comparison, especially for noisy classification problems.

[1]  Chia-Feng Juang,et al.  An accuracy-oriented self-splitting fuzzy classifier with support vector learning in high-order expanded consequent space , 2014, Appl. Soft Comput..

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  M. Negnevitsky,et al.  A Neural-Fuzzy Classifier for Recognition of Power Quality Disturbances , 2002, IEEE Power Engineering Review.

[5]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[6]  Costin Barbu,et al.  Fuzzy component based object detection , 2007, Int. J. Approx. Reason..

[7]  Gin-Der Wu,et al.  A Maximizing-Discriminability-Based Self-Organizing Fuzzy Network for Classification Problems , 2010, IEEE Transactions on Fuzzy Systems.

[8]  Claudio A. Perez,et al.  Extracting Fuzzy Rules From Polysomnographic Recordings for Infant Sleep Classification , 2006, IEEE Transactions on Biomedical Engineering.

[9]  Anup Basu,et al.  Human Activity Recognition Based on Silhouette Directionality , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Robert Ivor John,et al.  On Constructing Parsimonious Type-2 Fuzzy Logic Systems via Influential Rule Selection , 2009, IEEE Transactions on Fuzzy Systems.

[11]  Hani Hagras,et al.  Towards the Wide Spread Use of Type-2 Fuzzy Logic Systems in Real World Applications , 2012, IEEE Computational Intelligence Magazine.

[12]  Yannick Benezeth,et al.  Posture Recognition Based on Fuzzy Logic for Home Monitoring of the Elderly , 2012, IEEE Transactions on Information Technology in Biomedicine.

[13]  Pradipta Kishore Dash,et al.  Measurement and Classification of Simultaneous Power Signal Patterns With an S-Transform Variant and Fuzzy Decision Tree , 2013, IEEE Transactions on Industrial Informatics.

[14]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[15]  Chia-Feng Juang,et al.  Hierarchical Singleton-Type Recurrent Neural Fuzzy Networks for Noisy Speech Recognition , 2007, IEEE Transactions on Neural Networks.

[16]  Chia-Feng Juang,et al.  A Fuzzy Model With Online Incremental SVM and Margin-Selective Gradient Descent Learning for Classification Problems , 2014, IEEE Transactions on Fuzzy Systems.

[17]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.

[18]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[19]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[21]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[22]  Chia-Feng Juang,et al.  A Type-2 Self-Organizing Neural Fuzzy System and Its FPGA Implementation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  John Q. Gan,et al.  Constructing L2-SVM-Based Fuzzy Classifiers in High-Dimensional Space With Automatic Model Selection and Fuzzy Rule Ranking , 2007, IEEE Transactions on Fuzzy Systems.

[24]  Oscar Castillo,et al.  Application of interval type-2 fuzzy neural networks in non-linear identification and time series prediction , 2014, Soft Comput..

[25]  Narasimhan Sundararajan,et al.  A Metacognitive Neuro-Fuzzy Inference System (McFIS) for Sequential Classification Problems , 2013, IEEE Transactions on Fuzzy Systems.

[26]  Chia-Feng Juang,et al.  An incremental support vector machine-trained TS-type fuzzy system for online classification problems , 2011, Fuzzy Sets Syst..

[27]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Robert Nowicki,et al.  Rough Neuro-Fuzzy Structures for Classification With Missing Data , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[30]  S. Katebi,et al.  Protein Superfamily Classification Using Fuzzy Rule-Based Classifier , 2009, IEEE Transactions on NanoBioscience.

[31]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Oscar Castillo,et al.  Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction , 2014, Inf. Sci..

[33]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Oscar Castillo,et al.  A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks , 2009, Inf. Sci..

[35]  Miao Yu,et al.  A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment , 2012, IEEE Transactions on Information Technology in Biomedicine.

[36]  Chin-Teng Lin,et al.  An Efficient Human Detection System Using Adaptive Neural Fuzzy Networks , 2008 .

[37]  Ester Bernadó-Mansilla,et al.  Genetic-based machine learning systems are competitive for pattern recognition , 2008, Evol. Intell..

[38]  Nikhil R. Pal,et al.  An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification , 2012, IEEE Transactions on Fuzzy Systems.

[39]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[40]  Amit Konar,et al.  General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[41]  Chia-Feng Juang,et al.  Object Detection Using Color Entropies and a Fuzzy Classifier , 2013, IEEE Computational Intelligence Magazine.

[42]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[43]  Jeng-Shyang Pan,et al.  Fuzzy Rules Interpolation for Sparse Fuzzy Rule-Based Systems Based on Interval Type-2 Gaussian Fuzzy Sets and Genetic Algorithms , 2013, IEEE Transactions on Fuzzy Systems.

[44]  Marley M. B. R. Vellasco,et al.  Computing derivatives in interval type-2 fuzzy logic systems trained by steepest descent method for fault classification in a switch machine , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[45]  Chia-Feng Juang,et al.  Evolutionary Robot Wall-Following Control Using Type-2 Fuzzy Controller With Species-DE-Activated Continuous ACO , 2013, IEEE Transactions on Fuzzy Systems.

[46]  Gin-Der Wu,et al.  A TS-Type Maximizing-Discriminability-Based Recurrent Fuzzy Network for Classification Problems , 2011, IEEE Transactions on Fuzzy Systems.

[47]  Okyay Kaynak,et al.  Type 2 Fuzzy Neural Structure for Identification and Control of Time-Varying Plants , 2010, IEEE Transactions on Industrial Electronics.

[48]  Yixin Chen,et al.  Support vector learning for fuzzy rule-based classification systems , 2003, IEEE Trans. Fuzzy Syst..

[49]  Chia-Feng Juang,et al.  Reduced Interval Type-2 Neural Fuzzy System Using Weighted Bound-Set Boundary Operation for Computation Speedup and Chip Implementation , 2013, IEEE Transactions on Fuzzy Systems.

[50]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[51]  Chia-Feng Juang,et al.  A TS Fuzzy System Learned Through a Support Vector Machine in Principal Component Space for Real-Time Object Detection , 2012, IEEE Transactions on Industrial Electronics.

[52]  Chia-Feng Juang,et al.  Vision-based human body posture recognition using support vector machines , 2012, 4th International Conference on Awareness Science and Technology.

[53]  Hani Hagras,et al.  A Type-2 Fuzzy Ontology and Its Application to Personal Diabetic-Diet Recommendation , 2010, IEEE Transactions on Fuzzy Systems.

[54]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[55]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[56]  Chia-Feng Juang,et al.  Reinforcement Ant Optimized Fuzzy Controller for Mobile-Robot Wall-Following Control , 2009, IEEE Transactions on Industrial Electronics.

[57]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.