Analysis of probabilistic fuzzy systems' parameters in conditional density estimation

Probabilistic fuzzy systems (PFS) are shown to be valuable methods for conditional density estimation that combine fuzziness or linguistic uncertainty and probabilistic uncertainty. Several PFS applications have shown the added value of the different reasoning mechanisms of PFS and gains from incorporating two types of uncertainty. The effects of parametrization and parameter estimation on the function or conditional density approximations of PFS have not been documented in the literature. This paper aims to fill this gap in the literature by analyzing the parameters of PFS in conditional density estimation and point forecast using synthetic and real data applications. We show that both in-sample and out-of-sample results depend on PFS parametrization and the results deteriorate when the probability parameters of PFS are not optimized correctly, since these parameters allow the system to be fine tuned.

[1]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[2]  Mohammad R. Akbarzadeh-Totonchi,et al.  Probabilistic fuzzy logic and probabilistic fuzzy systems , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[3]  Uzay Kaymak,et al.  A fuzzy additive reasoning scheme for probabilistic Mamdani fuzzy systems , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  L. Zadeh Probability measures of Fuzzy events , 1968 .

[6]  Uzay Kaymak,et al.  Maximum likelihood parameter estimation in probabilistic fuzzy classifiers , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[7]  Uzay Kaymak,et al.  Fuzzy classification using probability-based rule weighting , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[8]  Min Tang,et al.  Generation of a probabilistic fuzzy rule base by learning from examples , 2012, Inf. Sci..

[9]  Han-Xiong Li,et al.  An Efficient Configuration for Probabilistic Fuzzy Logic System , 2012, IEEE Transactions on Fuzzy Systems.

[10]  Zhi Liu,et al.  A probabilistic fuzzy logic system for modeling and control , 2005, IEEE Transactions on Fuzzy Systems.

[11]  Uzay Kaymak,et al.  Financial markets analysis by using a probabilistic fuzzy modelling approach , 2004, Int. J. Approx. Reason..

[12]  Yong Bao,et al.  Comparing Density Forecast Models , 2007 .

[13]  Uzay Kaymak,et al.  A multi-covariate semi-parametric conditional volatility model using probabilistic fuzzy systems , 2012, 2012 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr).

[14]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[15]  Anne Laurent,et al.  Information Processing and Management of Uncertainty in Knowledge-Based Systems - 15th International Conference, IPMU 2014, Montpellier, France, July 15-19, 2014, Proceedings, Part III , 2014 .

[16]  Uzay Kaymak,et al.  Fuzzy histograms: A Statistical Analysis , 2005, EUSFLAT Conf..

[17]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[18]  Rui Jorge Almeida,et al.  Point and density forecasts of US inflation using probabilistic fuzzy systems , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[19]  Uzay Kaymak,et al.  Probabilistic fuzzy systems for seasonality analysis and multiple horizon forecasts , 2014, 2014 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr).

[20]  Uzay Kaymak,et al.  Probabilistic fuzzy systems in value-at-risk estimation , 2009 .

[21]  Didier Dubois,et al.  The three semantics of fuzzy sets , 1997, Fuzzy Sets Syst..

[22]  Han-Xiong Li,et al.  A probabilistic fuzzy learning system for pattern classification , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[23]  D. Ralescu,et al.  Statistical Modeling, Analysis and Management of Fuzzy Data , 2001 .

[24]  J. Galí,et al.  Inflation Dynamics: A Structural Econometric Analysis , 1999 .

[25]  Rob J. Hyndman,et al.  Bandwidth selection for kernel conditional density estimation , 2001 .

[26]  Ronald R. Yager,et al.  Information Processing and Management of Uncertainty in Knowledge-Based Systems , 2014, Communications in Computer and Information Science.

[27]  Uzay Kaymak,et al.  Value-at-risk estimation by using probabilistic fuzzy systems , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[28]  G. C. Van den Eijkel Fuzzy Probabilistic Learning and Reasoning, Rule Induction for Decision-Support Systems in Exacting Environments , 1999 .

[29]  Uzay Kaymak,et al.  Probabilistic and statistical fuzzy set foundations of competitive exception learning , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[30]  L. Zadeh Discussion: probability theory and fuzzy logic are complementary rather than competitive , 1995 .

[31]  Uzay Kaymak,et al.  Tail Point Density Estimation Using Probabilistic Fuzzy Systems , 2009, IFSA/EUSFLAT Conf..

[32]  Rui Jorge Almeida,et al.  Conditional Density Estimation Using Probabilistic Fuzzy Systems , 2013, IEEE Transactions on Fuzzy Systems.