Fuzzy Modeling from Black-Box Data with Deep Learning Techniques

Deep learning techniques have been successfully used for pattern classification. These advantage methods are still not applied in fuzzy modeling. In this paper, a novel data-driven fuzzy modeling approach is proposed. The deep learning methods is applied to learn the probability properties of input and output pairs. We propose special unsupervised learning methods for these two deep learning models with input data. The fuzzy rules are extracted from these properties. These deep learning based fuzzy modeling algorithms are validated with three benchmark examples.

[1]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[2]  Wen Yu,et al.  Randomized algorithms for nonlinear system identification with deep learning modification , 2016, Inf. Sci..

[3]  Wen Yu,et al.  Fuzzy modelling via on-line support vector machines , 2010, Int. J. Syst. Sci..

[4]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[5]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Trans. Fuzzy Syst..

[6]  Wen Yu.  A Novel Fuzzy-Neural-Network Modeling Approach to Crude-Oil Blending , 2009, IEEE Transactions on Control Systems Technology.

[7]  Léon Personnaz,et al.  Neural-network construction and selection in nonlinear modeling , 2003, IEEE Trans. Neural Networks.

[8]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[9]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[10]  Yoshua Bengio,et al.  Justifying and Generalizing Contrastive Divergence , 2009, Neural Computation.

[11]  Jacek M. Leski,et al.  TSK-fuzzy modeling based on /spl epsiv/-insensitive learning , 2005, IEEE Transactions on Fuzzy Systems.

[12]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[13]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[14]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[15]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[16]  Kazumi Saito,et al.  Extracting regression rules from neural networks , 2002, Neural Networks.

[17]  Pascal Vincent,et al.  The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training , 2009, AISTATS.

[18]  Spyros G. Tzafestas,et al.  NeuroFAST: on-line neuro-fuzzy ART-based structure and parameter learning TSK model , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Wen Yu,et al.  Fuzzy identification using fuzzy neural networks with stable learning algorithms , 2004 .

[20]  Plamen P. Angelov,et al.  An approach for fuzzy rule-base adaptation using on-line clustering , 2004, Int. J. Approx. Reason..