Hierarchical wavelet packet fuzzy inference system for pattern classification and system identification

This study presents a hierarchical Takagi–Sugeno–Kang type fuzzy system called hierarchical wavelet packet fuzzy inference system. In the proposed method, wavelet packet transform is applied on the input data to produce approximation and detail sub-bands of the input data and the output is used as the input vector of the proposed network. This network uses a hierarchical structure same as wavelet packet decomposition tree, in which adaptive network-based fuzzy inference system is used as sub-model. Also, gradient descent algorithm is chosen for training the parameters of antecedent and conclusion parts of the sub-models. In order to evaluate the capability of the proposed method, its applications in pattern classification, system identification and time-series prediction have been studied. The results show that the proposed method performs better than the other conventional models.

[1]  Michel Pasquier,et al.  Application of a hierarchical coevolutionary fuzzy system for financial prediction and trading , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[2]  Haitao Lin,et al.  Hierarchical fuzzy trust management for peer-to-peer network , 2009, 2009 ISECS International Colloquium on Computing, Communication, Control, and Management.

[3]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[4]  Stefano Marsili-Libelli,et al.  Adaptive fuzzy pattern recognition in the anaerobic digestion process , 1996, Pattern Recognit. Lett..

[5]  P. Pillay,et al.  Application of wavelets to model short-term power system disturbances , 1996 .

[6]  A. Ahmadyfard,et al.  A Hierarchical Fuzzy Based Approach for Face Detection , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[7]  Jian-An Fang,et al.  Intrusion Detection Model Based on Hierarchical Fuzzy Inference System , 2009, 2009 Second International Conference on Information and Computing Science.

[8]  Xiao-Jun Zeng,et al.  Intermediate Variable Normalization for Gradient Descent Learning for Hierarchical Fuzzy System , 2009, IEEE Transactions on Fuzzy Systems.

[9]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[10]  Ronald R. Yager,et al.  Fuzzy sets, neural networks, and soft computing , 1994 .

[11]  Ming-Ling Lee,et al.  Modeling of hierarchical fuzzy systems , 2003, Fuzzy Sets Syst..

[12]  Wen Yu,et al.  Fuzzy identification using fuzzy neural networks with stable learning algorithms , 2004 .

[13]  Li-Xin Wang,et al.  Universal approximation by hierarchical fuzzy systems , 1998, Fuzzy Sets Syst..

[14]  Yo-Ping Huang,et al.  Designing a fuzzy model by adaptive macroevolution genetic algorithms , 2000, Fuzzy Sets Syst..

[15]  M. Teshnehlab,et al.  Hierarchical Takagi-Sugeno type fuzzy system for diabetes mellitus forecasting , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[16]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[17]  Chun-Hee Woo,et al.  Evolutionary design of fuzzy rule base for nonlinear system modeling and control , 2000, IEEE Trans. Fuzzy Syst..

[18]  Korris Fu-Lai Chung,et al.  Multilevel fuzzy relational systems: structure and identification , 2002, Soft Comput..

[19]  Paulo Salgado,et al.  Clustering and hierarchization of fuzzy systems , 2005, Soft Comput..

[20]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[21]  Chia-Feng Juang,et al.  Hierarchical Singleton-Type Recurrent Neural Fuzzy Networks for Noisy Speech Recognition , 2007, IEEE Transactions on Neural Networks.

[22]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[23]  Duc Truong Pham,et al.  Training Elman and Jordan networks for system identification using genetic algorithms , 1999, Artif. Intell. Eng..

[24]  D. Hladek,et al.  Hierarchical fuzzy inference system for robotic pursuit evasion task , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[25]  Bin Liu,et al.  The Design of Customer Satisfaction Analysis Model Based on Hierarchical Fuzzy System , 2009, 2009 International Conference on Business Intelligence and Financial Engineering.

[26]  M. D. Cox,et al.  Discrete wavelet analysis of power system transients , 1996 .

[27]  R. Holve.  Rule generation for hierarchical fuzzy systems , 1997, 1997 Annual Meeting of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.97TH8297).

[28]  A. Sakaguchi,et al.  A study on system identification using GA and GMDH network , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[29]  Patricia A. Nava,et al.  Speaker independent voice recognition with a fuzzy neural network , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[30]  Kuo-Chung Lin,et al.  Wavelet packet feature extraction for vibration monitoring , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[31]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[32]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Laercio B. Goncalves,et al.  Macroscopic Rock Texture Image Classification Using an Hierarchical Neuro-Fuzzy System , 2009, 2009 16th International Conference on Systems, Signals and Image Processing.

[34]  D. Altman,et al.  Statistics Notes: Diagnostic tests 1: sensitivity and specificity , 1994, BMJ.

[35]  Sheng-De Wang,et al.  Fuzzy system identification using an adaptive learning rule with terminal attractors , 1999, Fuzzy Sets Syst..

[36]  Yuehui Chen,et al.  Hierarchical Takagi-Sugeno Models for Online Security Evaluation Systems , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[37]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[38]  Cheng Li,et al.  Bearing fault detection via wavelet packet transform and rough set theory , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[39]  S. R. Mendis,et al.  Harmonic and transient overvoltage analyses in arc furnace power systems , 1992 .

[40]  Kalevi Tervo,et al.  A hierarchical fuzzy inference method for skill evaluation of machine operators , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[41]  Santiago Aja-Fernández,et al.  Hierarchical fuzzy systems with FITM , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[42]  Xiaoou Li,et al.  Fuzzy identification using fuzzy neural networks with stable learning algorithms , 2004, IEEE Transactions on Fuzzy Systems.

[43]  Nabil Derbel,et al.  Optimal Control for Discrete Large Scale Nonlinear Systems Using Hierarchical Fuzzy Systems , 2010, 2010 Second International Conference on Machine Learning and Computing.

[44]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[45]  Ajith Abraham.  EvoNF: a framework for optimization of fuzzy inference systems using neural network learning and evolutionary computation , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[46]  Mr. suhas Yadav,et al.  Intelligent Learning Of Fuzzy Logic Controllers Via Neural Network And Genetic Algorithm , 2013 .

[47]  Christopher J. Harris,et al.  Fuzzy local linearization and local basis function expansion in nonlinear system modeling , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[48]  A. Bagis.  Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. , 2008, ISA transactions.

[49]  Jin S. Lee,et al.  A class of hierarchical fuzzy systems with constraints on the fuzzy rules , 2005, IEEE Transactions on Fuzzy Systems.

[50]  Derek A. Linkens,et al.  A systematic neuro-fuzzy modeling framework with application to material property prediction , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[51]  Estefan Ortiz,et al.  Support Vector Machines and Wavelet Packet Analysis for Fault Detection and Identification , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[52]  Jun Zhou,et al.  Adaptive hierarchical fuzzy controller , 1993, IEEE Trans. Syst. Man Cybern..

[53]  Shyi-Ming Chen,et al.  A new method for constructing membership functions and fuzzy rules from training examples , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[54]  Giancarlo Mauri,et al.  Learning fuzzy rules with tabu search-an application to control , 1999, IEEE Trans. Fuzzy Syst..

[55]  Martin Brown,et al.  High dimensional neurofuzzy systems: overcoming the curse of dimensionality , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[56]  Xiaoping Qiu,et al.  The Mixed Hierarchical Fuzzy Evaluation System Based on Dynamic Neural Network , 2007, Third International Conference on Natural Computation (ICNC 2007).

[57]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[58]  Li-Xin Wang,et al.  Analysis and design of hierarchical fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[59]  David G. Stork,et al.  Pattern Classification , 1973 .

[60]  María José del Jesús,et al.  Analysing the Hierarchical Fuzzy Rule Based Classification Systems with genetic rule selection , 2010, 2010 4th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[61]  Lijun Wang,et al.  Application of Multi-factor Hierarchical Fuzzy Evaluation in Public Transport , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[62]  Xiao-Jun Zeng,et al.  Hierarchical Fuzzy Systems for Function Approximation on Discrete Input Spaces With Application , 2008, IEEE Transactions on Fuzzy Systems.

[63]  Hai-shuang Guan,et al.  Research on Hierarchical Fuzzy Wavelet Neural Network Control Algorithm in Urban Traffic Trunk , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[64]  S. Santoso,et al.  Power quality assessment via wavelet transform analysis , 1996 .

[65]  M. Sugeno,et al.  Fuzzy modeling and control of multilayer incinerator , 1986 .

[66]  Yu Wen.  Passivity analysis for dynamic multilayer neuro identifier , 2003 .

[67]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.