Optimum steepest descent higher level learning radial basis function network

We model a neural network with adaptive structure and dynamic learning.Higher level learning components helps the network to think before learning.Number of hidden neurons are decreased and redundant samples are removed.Increases classification accuracy, reduces detection time & architecture complexity.Various abnormality levels in vital parameters of multiple patients are classified. Dynamically changing real world applications, demands for rapid and accurate machine learning algorithm. In neural network based machine learning algorithms, radial basis function (RBF) network is a simple supervised learning feed forward network. With its simplicity, this network is highly suitable to model and control the nonlinear systems. Existing RBF networks in literature are applied to static applications and also faces challenges such as increased model size, neuron removal, improper center selection etc leading to erroneous output. To overcome the challenges and handle complex real world problems, this paper proposes a new optimum steepest descent based higher level learning radial basis function network (OSDHL-RBFN). The proposed OSDHL-RBFN implements major components inspired from the human brain for efficient learning, adaptive structure and accurate classification. Higher level learning and thinking components of the proposed network are sample deletion, neuron addition, neuron migration, sample navigation and neuroplasticity. These components helps the classifier to think before learning the samples and regulates the learning strategy. The knowledge gained from the trained samples are used by the network to identify the incomplete sample, optimal center and bond strength of hidden & output neurons. Adaptive network structure is employed to minimize classification error. The proposed work also uses optimum steepest descent method for weight parameter update to minimize the sum square error. OSDHL-RBFN is tested and evaluated in both static and dynamic environments on nine benchmark classification (binary and multiclass) problems for balanced, unbalanced, small, large, low dimensional and high dimensional datasets. The overall and class wise efficiency of OSDHL-RBFN is improved when compared to other RBFN's in the literature. The performance results clearly show that the proposed OSDHL-RBFN reduces the architecture complexity and computation time compared to other RBFN's. Overall, the proposed OSDHL-RBFN is efficient and suitable for dynamic real world applications in terms of detection time and accuracy. As a case study, OSDHL-RBFN is implemented in real time remote health monitoring application for classifying the various abnormality levels in vital parameters.

[1]  Surendra Kumar,et al.  Hybrid GA Tuned RBF Based Neuro-Fuzzy Controller for Robotic Manipulator , 2008 .

[2]  Sundaram Suresh,et al.  Sequential Projection-Based Metacognitive Learning in a Radial Basis Function Network for Classification Problems , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[3]  César Hervás-Martínez,et al.  Evolutionary Generalized Radial Basis Function neural networks for improving prediction accuracy in gene classification using feature selection , 2012, Appl. Soft Comput..

[4]  Pedro Antonio Gutiérrez,et al.  Evolutionary q-Gaussian radial basis function neural networks for multiclassification , 2011, Neural Networks.

[5]  Yong Zhao,et al.  Concurrent Subspace Width Optimization Method for RBF Neural Network Modeling , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Shengli Wu,et al.  Effective Neural Network Ensemble Approach for Improving Generalization Performance , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Safwan El Assad,et al.  Efficient classification algorithm and a new training mode for the adaptive radial basis function neural network equaliser , 2012, IET Commun..

[8]  Zheng Rong Yang,et al.  A novel radial basis function neural network for discriminant analysis , 2006, IEEE Transactions on Neural Networks.

[9]  Yu Gong,et al.  Online Modeling With Tunable RBF Network , 2013, IEEE Transactions on Cybernetics.

[10]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Αλέξανδρος Π. Αλεξανδρίδης,et al.  Large earthquake occurrence estimation based on radial basis function neural networks , 2015 .

[12]  Junfei Qiao,et al.  Adaptive Computation Algorithm for RBF Neural Network , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Ruey-Jing Lian,et al.  Adaptive Self-Organizing Fuzzy Sliding-Mode Radial Basis-Function Neural-Network Controller for Robotic Systems , 2014, IEEE Transactions on Industrial Electronics.

[14]  Amitava Chatterjee,et al.  A Postural Information-Based Biometric Authentication System Employing S-Transform, Radial Basis Function Network, and Extended Kalman Filtering , 2010, IEEE Transactions on Instrumentation and Measurement.

[15]  Hao Yu,et al.  Advantages of Radial Basis Function Networks for Dynamic System Design , 2011, IEEE Transactions on Industrial Electronics.

[16]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[17]  Zhi-Hua Zhou,et al.  Adapting RBF Neural Networks to Multi-Instance Learning , 2006, Neural Processing Letters.

[18]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Hao Yu,et al.  An Incremental Design of Radial Basis Function Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Chia-Nan Ko,et al.  Identification of non-linear systems using radial basis function neural networks with time-varying learning algorithm , 2012, IET Signal Process..

[21]  George Panoutsos,et al.  Interval Type-2 Radial Basis Function Neural Network: A Modeling Framework , 2015, IEEE Transactions on Fuzzy Systems.

[22]  Yen-Jen Oyang,et al.  Data classification with radial basis function networks based on a novel kernel density estimation algorithm , 2005, IEEE Transactions on Neural Networks.

[23]  Adam Krzyzak,et al.  Radial Basis Function Networks and Complexity Regularization in Function Learning , 2022 .

[24]  Bernhard Sick,et al.  Evolutionary optimization of radial basis function classifiers for data mining applications , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Mehmet Korürek,et al.  ECG beat classification using particle swarm optimization and radial basis function neural network , 2010, Expert Syst. Appl..

[26]  Haralambos Sarimveis,et al.  Radial Basis Function Network Training Using a Nonsymmetric Partition of the Input Space and Particle Swarm Optimization , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Nicolaos B. Karayiannis,et al.  On the construction and training of reformulated radial basis function neural networks , 2003, IEEE Trans. Neural Networks.

[28]  Jianghai Hu,et al.  Variable Neural Adaptive Robust Control: A Switched System Approach , 2015, IEEE Transactions on Neural Networks and Learning Systems.