Complex-valued neuro-fuzzy inference system for wind prediction

In this paper, we present a complex-valued neuro-fuzzy inference system (CNFIS) and its gradient descent based learning algorithm developed employing Wirtinger calculus. The proposed CNFIS is a four layered network which realizes zero-order Takagi-Sugeno-Kang based fuzzy inference mechanism. CNFIS is used to predict the speed and direction of wind. Here, the speed and direction are considered as statistically independent variables and are represented as a complex-valued signal (with speed as magnitude and direction as phase). Performance of CNFIS is compared with other algorithms available in the literature and results indicate improved performance of CNFIS. The major contribution of this paper is as follows: (1) Propose a complex-valued neuro-fuzzy inference system (2) Employ Wirtinger calculus for complex-valued gradient descent algorithm (3) Solve wind speed and direction prediction problem in complex domain.

[1]  Tülay Adali,et al.  Approximation by Fully Complex Multilayer Perceptrons , 2003, Neural Computation.

[2]  Robert F. H. Fischer,et al.  Precoding and Signal Shaping for Digital Transmission , 2002 .

[3]  Jacek M. Zurada,et al.  A new design method for the complex-valued multistate Hopfield associative memory , 2003, IEEE Trans. Neural Networks.

[4]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[5]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[6]  Tülay Adali,et al.  Fully Complex Multi-Layer Perceptron Network for Nonlinear Signal Processing , 2002, J. VLSI Signal Process..

[7]  Narasimhan Sundararajan,et al.  Complex-Valued Minimal Resource Allocation Network for Nonlinear Signal Processing , 2000, Int. J. Neural Syst..

[8]  Narasimhan Sundararajan,et al.  A fast learning Fully Complex-valued Relaxation Network (FCRN) , 2011, The 2011 International Joint Conference on Neural Networks.

[9]  Daesik Hong,et al.  Nonlinear blind equalization schemes using complex-valued multilayer feedforward neural networks , 1998, IEEE Trans. Neural Networks.

[10]  Akira Hirose,et al.  Continuous complex-valued back-propagation learning , 1992 .

[11]  Narasimhan Sundararajan,et al.  A fully complex-valued radial basis function classifier for real-valued classification problems , 2012, Neurocomputing.

[12]  Sundaram Suresh,et al.  A meta-cognitive learning algorithm for a Fully Complex-valued Relaxation Network , 2012, Neural Networks.

[13]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  F. Ares,et al.  Analysis, synthesis, and diagnostics of antenna arrays through complex-valued neural networks , 2006 .

[15]  R. Remmert,et al.  Theory of Complex Functions , 1990 .

[16]  Kazuyuki Murase,et al.  Single-layered complex-valued neural network for real-valued classification problems , 2009, Neurocomputing.

[17]  Sundaram Suresh,et al.  Fast Learning Fully Complex-Valued Classifiers for Real-Valued Classification Problems , 2011, ISNN.

[18]  N. Sundararajan,et al.  A fully complex-valued radial basis function network and its learning algorithm. , 2009 .

[19]  Bernard Mulgrew,et al.  Complex-valued radial basic function network, Part I: Network architecture and learning algorithms , 1994, Signal Process..

[20]  Narasimhan Sundararajan,et al.  A Sequential Learning Algorithm for Complex-Valued Self-Regulating Resource Allocation Network-CSRAN , 2011, IEEE Transactions on Neural Networks.

[21]  Francesco Piazza,et al.  On the complex backpropagation algorithm , 1992, IEEE Trans. Signal Process..

[22]  Ganapati Panda,et al.  Nonlinear channel equalization for QAM signal constellation using artificial neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Akira Hirose,et al.  Complex-Valued Neural Networks (Studies in Computational Intelligence) , 2006 .

[24]  Xiaoming Chen,et al.  A modified error backpropagation algorithm for complex-value neural networks , 2005, Int. J. Neural Syst..

[25]  Sundaram Suresh,et al.  Metacognitive Learning in a Fully Complex-Valued Radial Basis Function Neural Network , 2012, Neural Computation.

[26]  Claudio Moraga,et al.  Multilayer Feedforward Neural Network Based on Multi-valued Neurons (MLMVN) and a Backpropagation Learning Algorithm , 2006, Soft Comput..

[27]  Jacek M. Zurada,et al.  Blur Identification by Multilayer Neural Network Based on Multivalued Neurons , 2008, IEEE Transactions on Neural Networks.

[28]  Tohru Nitta,et al.  Orthogonality of Decision Boundaries in Complex-Valued Neural Networks , 2004, Neural Computation.

[29]  R. Venkatesh Babu,et al.  Human action recognition using a fast learning fully complex-valued classifier , 2012, Neurocomputing.

[30]  Sammy Siu,et al.  Sensitivity Analysis of the Split-Complex Valued Multilayer Perceptron Due to the Errors of the i.i.d. Inputs and Weights , 2007, IEEE Transactions on Neural Networks.

[31]  Henry Leung,et al.  The complex backpropagation algorithm , 1991, IEEE Trans. Signal Process..

[32]  Sundaram Suresh,et al.  Fast learning Circular Complex-valued Extreme Learning Machine (CC-ELM) for real-valued classification problems , 2012, Inf. Sci..

[33]  Paramasivan Saratchandran,et al.  A new learning algorithm with logarithmic performance index for complex-valued neural networks , 2009, Neurocomputing.

[34]  N. Sundararajan,et al.  Complex-valued growing and pruning rbf neural networks for communication channel equalisation , 2006 .

[35]  Tohru Nitta,et al.  An Extension of the Back-Propagation Algorithm to Complex Numbers , 1997, Neural Networks.

[36]  Tohru Nitta.  The Computational Power of Complex-Valued Neuron , 2003, ICANN.

[37]  Kazuyuki Murase,et al.  Real-Time Hand Gesture Recognition Using Complex-Valued Neural Network (CVNN) , 2011, ICONIP.

[38]  Sundaram Suresh,et al.  A Fast Learning Complex-valued Neural Classifier for real-valued classification problems , 2011, The 2011 International Joint Conference on Neural Networks.

[39]  Sundaram Suresh,et al.  A Fully Complex-Valued Radial Basis Function Network and its Learning Algorithm , 2009, Int. J. Neural Syst..

[40]  Kazuyuki Aihara,et al.  Complex-valued prediction of wind profile using augmented complex statistics , 2009 .