Fast learning complex-valued classifiers for real-valued classification problems

In this paper, we present two fast learning complex-valued, single hidden layer neural network classifiers namely, ‘bilinear branch-cut complex-valued extreme learning machine (BB-CELM)’ and ‘phase encoded complex-valued extreme learning machine (PE-CELM)’ to solve real-valued classification problems. BB-CELM and PE-CELM use the bilinear transformation with a branch-cut at 2π and the phase encoded transformation, respectively, at the input layer to transform the feature space from the real domain to complex domain ($${\Re \rightarrow \mathbb{C}}$$). A complex-valued activation function of the type of hyperbolic secant employed at the hidden layer maps the complex-valued feature space to a hyper dimensional complex space ($${\mathbb{C}^m \rightarrow \mathbb{C}^K\quad K > m}$$). BB-CELM and PE-CELM are trained by choosing the hidden layer parameters randomly and computing the output weights analytically. Therefore, these classifiers require minimal computational effort during the training process. The performances of these classifiers are evaluated on a set of benchmark classification problems from the UCI machine learning repository and a practical acoustic emission signal classification problem. The results of the performance study highlight the superior classification ability of BB-CELM and PE-CELM classifiers.

[1]  Narasimhan Sundararajan,et al.  Complex-Valued Minimal Resource Allocation Network for Nonlinear Signal Processing , 2000, Int. J. Neural Syst..

[2]  Narasimhan Sundararajan,et al.  Fully complex extreme learning machine , 2005, Neurocomputing.

[3]  H. J. Kim,et al.  A sequential learning algorithm for self-adaptive resource allocation network classifier , 2010, Neurocomputing.

[4]  Tülay Adali,et al.  Approximation by Fully Complex Multilayer Perceptrons , 2003, Neural Computation.

[5]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[6]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[7]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Tohru Nitta,et al.  Orthogonality of Decision Boundaries in Complex-Valued Neural Networks , 2004, Neural Computation.

[9]  Kazuyuki Murase,et al.  Ensemble of single-layered complex-valued neural networks for classification tasks , 2009, Neurocomputing.

[10]  Kazuyuki Murase,et al.  Single-layered complex-valued neural network for real-valued classification problems , 2009, Neurocomputing.

[11]  N. Sundararajan,et al.  A fully complex-valued radial basis function network and its learning algorithm. , 2009 .

[12]  F. Ares,et al.  Analysis, synthesis, and diagnostics of antenna arrays through complex-valued neural networks , 2006 .

[13]  Lajos Hanzo,et al.  Symmetric Complex-Valued RBF Receiver for Multiple-Antenna-Aided Wireless Systems , 2008, IEEE Transactions on Neural Networks.

[14]  N. Sundararajan,et al.  Complex-valued growing and pruning rbf neural networks for communication channel equalisation , 2006 .

[15]  Claudio Moraga,et al.  Multilayer Feedforward Neural Network Based on Multi-valued Neurons (MLMVN) and a Backpropagation Learning Algorithm , 2006, Soft Comput..

[16]  N Sundararajan,et al.  Adaptive beamforming using complex-valued Radial Basis Function neural networks , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[17]  Narasimhan Sundararajan,et al.  A sequential multi-category classifier using radial basis function networks , 2008, Neurocomputing.

[18]  Sundaram Suresh,et al.  Metacognitive Learning in a Fully Complex-Valued Radial Basis Function Neural Network , 2012, Neural Computation.

[19]  Jacek M. Zurada,et al.  Blur Identification by Multilayer Neural Network Based on Multivalued Neurons , 2008, IEEE Transactions on Neural Networks.

[20]  Tohru Nitta,et al.  Solving the XOR problem and the detection of symmetry using a single complex-valued neuron , 2003, Neural Networks.

[21]  Narasimhan Sundararajan,et al.  A fully complex-valued radial basis function classifier for real-valued classification problems , 2012, Neurocomputing.

[22]  Sundaram Suresh,et al.  A meta-cognitive learning algorithm for a Fully Complex-valued Relaxation Network , 2012, Neural Networks.

[23]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[24]  Sundaram Suresh,et al.  Fast learning Circular Complex-valued Extreme Learning Machine (CC-ELM) for real-valued classification problems , 2012, Inf. Sci..

[25]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[26]  David A. Landgrebe,et al.  Decision boundary feature extraction for neural networks , 1997, IEEE Trans. Neural Networks.

[27]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[28]  Tohru Nitta The Computational Power of Complex-Valued Neuron , 2003, ICANN.

[29]  Sundaram Suresh,et al.  A Fast Learning Complex-valued Neural Classifier for real-valued classification problems , 2011, The 2011 International Joint Conference on Neural Networks.

[30]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[31]  Narasimhan Sundararajan,et al.  Risk-sensitive loss functions for sparse multi-category classification problems , 2008, Inf. Sci..

[32]  Tülay Adali,et al.  Fully Complex Multi-Layer Perceptron Network for Nonlinear Signal Processing , 2002, J. VLSI Signal Process..

[33]  V. Mani,et al.  Acoustic emmision signal classiefiation using fuzzy C-means clustering - Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference o , 2004 .

[34]  Narasimhan Sundararajan,et al.  A Sequential Learning Algorithm for Complex-Valued Self-Regulating Resource Allocation Network-CSRAN , 2011, IEEE Transactions on Neural Networks.

[35]  Sundaram Suresh,et al.  Lift coefficient prediction at high angle of attack using recurrent neural network , 2003 .

[36]  R. Venkatesh Babu,et al.  Human action recognition using a fast learning fully complex-valued classifier , 2012, Neurocomputing.

[37]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[38]  S. N. Omkar,et al.  Rule extraction for classification of acoustic emission signals using Ant Colony Optimisation , 2008, Eng. Appl. Artif. Intell..