Probabilistic Fuzzy Classification for Stochastic Data

The classification problem in the real-world applications always involves uncertainties in both stochastic and fuzzy nature. This paper proposes a classification framework based on the unified probabilistic fuzzy configuration for data with uncertainties in both stochastic and fuzzy nature. The design and tuning procedures are also developed in terms of probability-based performance measure for working in the complex environment. A theoretical analysis is conducted to derive its quantificational model and disclose the interesting features. In addition to a superior performance than the traditional fuzzy method, the proposed method generates probabilistic fuzzy rules that can help users to better understand how the classifier works. This explainable characteristic is crucial for the decision making. Finally, the effectiveness of the proposed classifier will be demonstrated on its application to the Pima Indians Diabetes data and low back pain diagnosis. The satisfactory classification and the explainable characteristic disclose its potential in classification of data with uncertainties.

[1]  Kazuo Tanaka,et al.  Modeling and control of carbon monoxide concentration using a neuro-fuzzy technique , 1995, IEEE Trans. Fuzzy Syst..

[2]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition : methods that search for structures in data , 1992 .

[3]  Uzay Kaymak,et al.  Probabilistic Fuzzy Systems as Additive Fuzzy Systems , 2014, IPMU.

[4]  Sang Yeol Joo,et al.  Strong convergence for weighted sums of fuzzy random sets , 2006, Inf. Sci..

[5]  K. P. Sudheer,et al.  Fuzzy model identification based on cluster estimation for reservoir inflow forecasting , 2008 .

[6]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[7]  Rui Jorge Almeida,et al.  Conditional Density Estimation Using Probabilistic Fuzzy Systems , 2013, IEEE Transactions on Fuzzy Systems.

[8]  Uzay Kaymak,et al.  Fuzzy classification using probability-based rule weighting , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[9]  Yan Wang,et al.  Burg Matrix Divergence-Based Hierarchical Distance Metric Learning for Binary Classification , 2017, IEEE Access.

[10]  Han-Xiong Li,et al.  A probabilistic fuzzy learning system for pattern classification , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[11]  H. Hagras,et al.  Type-2 FLCs: A New Generation of Fuzzy Controllers , 2007, IEEE Computational Intelligence Magazine.

[12]  Abraham Kandel,et al.  Constraints on belief functions imposed by fuzzy random variables , 1995, IEEE Trans. Syst. Man Cybern..

[13]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[14]  Han-Xiong Li,et al.  An Efficient Configuration for Probabilistic Fuzzy Logic System , 2012, IEEE Transactions on Fuzzy Systems.

[15]  Zhi Liu,et al.  A probabilistic fuzzy logic system for modeling and control , 2005, IEEE Transactions on Fuzzy Systems.

[16]  Shaoyuan Li,et al.  A Three-Dimensional Fuzzy Control Methodology for a Class of Distributed Parameter Systems , 2007, IEEE Transactions on Fuzzy Systems.

[17]  Stephen L. Chin An Efficient Method for Extracting Fuzzy Classification Rules from High Dimensional Data , 1997, J. Adv. Comput. Intell. Intell. Informatics.

[18]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[19]  Jerry M. Mendel,et al.  Type-2 fuzzy logic systems , 1999, IEEE Trans. Fuzzy Syst..

[20]  G. Pisier,et al.  The Law of Large Numbers and the Central Limit Theorem in Banach Spaces , 1976 .

[21]  Jerry M. Mendel,et al.  Interval Type-2 Fuzzy Logic Systems Made Simple , 2006, IEEE Transactions on Fuzzy Systems.

[22]  V. M. Zolotarev,et al.  On Representation of Densities of Stable Laws by Special Functions , 1995 .

[23]  L. Zadeh Probability measures of Fuzzy events , 1968 .

[24]  Han-Xiong Li,et al.  An unified intelligent inference framework for complex modeling and classification , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Kaoru Hirota,et al.  Concepts of probabilistic sets , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[26]  Zhi Liu,et al.  A Probabilistic Neural-Fuzzy Learning System for Stochastic Modeling , 2008, IEEE Transactions on Fuzzy Systems.

[27]  Xiao Zhang,et al.  Hierarchical fuzzy rule-based system optimized with genetic algorithms for short term traffic congestion prediction , 2014 .

[28]  Shaoyuan Li,et al.  Analytical Study and Stability Design of a 3-D Fuzzy Logic Controller for Spatially Distributed Dynamic Systems , 2008, IEEE Transactions on Fuzzy Systems.