Combining SOM and evolutionary computation algorithms for RBF neural network training

This paper intends to enhance the learning performance of radial basis function neural network (RBFnn) using self-organizing map (SOM) neural network (SOMnn). In addition, the particle swarm optimization (PSO) and genetic algorithm (GA) based (PG) algorithm is employed to train RBFnn for function approximation. The proposed mix of SOMnn with PG (MSPG) algorithm combines the automatically clustering ability of SOMnn and the PG algorithm. The simulation results revealed that SOMnn, PSO and GA approaches can be combined ingeniously and redeveloped into a hybrid algorithm which aims for obtaining a more accurate learning performance among relevant algorithms. On the other hand, method evaluation results for four continuous test function experiments and the demand estimation case showed that the MSPG algorithm outperforms other algorithms and the Box–Jenkins models in accuracy. Additionally, the proposed MSPG algorithm is allowed to be embedded into business’ enterprise resource planning system in different industries to provide suppliers, resellers or retailers in the supply chain more accurate demand information for evaluation and so to lower the inventory cost. Next, it can be further applied to the intelligent manufacturing system to cope with real situation in the industry to meet the need of customization.

[1]  Kin Keung Lai,et al.  A multiscale neural network learning paradigm for financial crisis forecasting , 2010, Neurocomputing.

[2]  H. Akaike.  A new look at the statistical model identification , 1974 .

[3]  Ke Wang,et al.  A PSO–GA optimal model to estimate primary energy demand of China , 2012 .

[4]  John Tsimikas,et al.  On training RBF neural networks using input-output fuzzy clustering and particle swarm optimization , 2013, Fuzzy Sets Syst..

[5]  Donald C. Wunsch,et al.  Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization , 2007, Neural Networks.

[6]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[7]  Kejun Zhu,et al.  A hybrid MPSO-BP structure adaptive algorithm for RBFNs , 2008, Neural Computing and Applications.

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[10]  Thomas Wennekers,et al.  A Spiking Self-Organizing Map Combining STDP, Oscillations, and Continuous Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[12]  Sultan Noman Qasem,et al.  Multi-objective hybrid evolutionary algorithms for radial basis function neural network design , 2012, Knowl. Based Syst..

[13]  Rasul Enayatifar,et al.  Optimal design of plate-fin heat exchangers by a hybrid evolutionary algorithm , 2012 .

[14]  Mahesh Pal,et al.  Performance evaluation of artificial neural network approaches in forecasting reservoir inflow , 2012 .

[15]  Igor Kuzmanovski,et al.  Classification of perovskites with supervised self-organizing maps. , 2007, Analytica chimica acta.

[16]  Wei Du,et al.  A multiobjective optimization-based neural network model for short-term replenishment forecasting in fashion industry , 2015, Neurocomputing.

[17]  Juan Luis Fernández-Martínez,et al.  A Brief Historical Review of Particle Swarm Optimization (PSO) , 2012 .

[18]  Genichi Taguchi,et al.  Taguchi methods : design of experiments , 1993 .

[19]  Rong Chen,et al.  A novel parallel hybrid intelligence optimization algorithm for a function approximation problem , 2012, Comput. Math. Appl..

[20]  Haralambos Sarimveis,et al.  A new algorithm for developing dynamic radial basis function neural network models based on genetic algorithms , 2004, Comput. Chem. Eng..

[21]  Wei-Zhen Lu,et al.  Forecasting of ozone level in time series using MLP model with a novel hybrid training algorithm , 2006 .

[22]  Jinliang Zhang,et al.  A novel hybrid method for crude oil price forecasting , 2015 .

[23]  Ali Azadeh,et al.  INTEGRATION OF GENETIC ALGORITHM, COMPUTER SIMULATION AND DESIGN OF EXPERIMENTS FOR FORECASTING ELECTRICAL ENERGY CONSUMPTION , 2007 .

[24]  Nasser Sadati,et al.  An enhanced under-voltage load-shedding scheme to provide voltage stability , 2007 .

[25]  W. Fuller,et al.  LIKELIHOOD RATIO STATISTICS FOR AUTOREGRESSIVE TIME SERIES WITH A UNIT ROOT , 1981 .

[26]  Yanping Bai,et al.  Generalized radial basis function neural network based on an improved dynamic particle swarm optimization and AdaBoost algorithm , 2015, Neurocomputing.

[27]  Helon Vicente Hultmann Ayala,et al.  Cascaded evolutionary algorithm for nonlinear system identification based on correlation functions and radial basis functions neural networks , 2016 .

[28]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[29]  Ismail H. Altas,et al.  A novel modified hybrid PSOGSA based on fuzzy logic for non-convex economic dispatch problem with valve-point effect , 2015 .

[30]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[31]  Sheng Chen,et al.  Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks , 1999, IEEE Trans. Neural Networks.

[32]  Mohammad Kazem Sheikh-El-Eslami,et al.  Price forecasting of day-ahead electricity markets using a hybrid forecast method , 2011 .

[33]  Jie Hu,et al.  Dynamic representation of fuzzy knowledge based on fuzzy petri net and genetic-particle swarm optimization , 2014, Expert Syst. Appl..

[34]  Xiang Cheng,et al.  Adaptive multi-objective artificial immune system based virtual network embedding , 2015, J. Netw. Comput. Appl..

[35]  R. Qi,et al.  Analysis of bacterial community in bulking sludge using culture-dependent and -independent approaches. , 2011, Journal of environmental sciences.

[36]  Arash Ghanbari,et al.  Developing a hybrid artificial intelligence model for outpatient visits forecasting in hospitals , 2012, Appl. Soft Comput..

[37]  Vimal J. Savsani,et al.  Effect of hybridizing Biogeography-Based Optimization (BBO) technique with Artificial Immune Algorithm (AIA) and Ant Colony Optimization (ACO) , 2014, Appl. Soft Comput..

[38]  Jose Miguel Puerta,et al.  Learning weighted linguistic fuzzy rules with estimation of distribution algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[39]  Majid Bagheri,et al.  Modeling and optimization of activated sludge bulking for a real wastewater treatment plant using hybrid artificial neural networks-genetic algorithm approach , 2015 .

[40]  Ujjwal Maulik,et al.  Quantum inspired genetic algorithm and particle swarm optimization using chaotic map model based interference for gray level image thresholding , 2014, Swarm Evol. Comput..

[41]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[42]  Mevlut Ture,et al.  Comparing performances of logistic regression, classification and regression tree, and neural networks for predicting coronary artery disease , 2008, Expert Syst. Appl..

[43]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[44]  Dipti Srinivasan,et al.  A SOM-based hybrid linear-neural model for short-term load forecasting , 2011, Neurocomputing.

[45]  Tharam S. Dillon,et al.  Neural-Network-Based Models for Short-Term Traffic Flow Forecasting Using a Hybrid Exponential Smoothing and Levenberg–Marquardt Algorithm , 2012, IEEE Transactions on Intelligent Transportation Systems.

[46]  Carmelo J. A. Bastos Filho,et al.  A mechanism based on Artificial Bee Colony to generate diversity in Particle Swarm Optimization , 2015, Neurocomputing.

[47]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[48]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[49]  Sheng-Hsun Hsu,et al.  A two-stage architecture for stock price forecasting by integrating self-organizing map and support vector regression , 2009, Expert Syst. Appl..

[50]  Chao-Ming Huang,et al.  An RBF Network With OLS and EPSO Algorithms for Real-Time Power Dispatch , 2007, IEEE Transactions on Power Systems.

[51]  Hsuan-Ming Feng,et al.  Self-generation RBFNs using evolutional PSO learning , 2006, Neurocomputing.

[52]  Pei-Chann Chang,et al.  Combining SOM and fuzzy rule base for flow time prediction in semiconductor manufacturing factory , 2006, Appl. Soft Comput..

[53]  Gwo-Fong Lin,et al.  An RBF network with a two-step learning algorithm for developing a reservoir inflow forecasting model , 2011 .

[54]  Meng Joo Er,et al.  Adaptive noise cancellation using enhanced dynamic fuzzy neural networks , 2005, IEEE Transactions on Fuzzy Systems.

[55]  Tung-Kuan Liu,et al.  Tuning the structure and parameters of a neural network by using hybrid Taguchi-genetic algorithm , 2006, IEEE Trans. Neural Networks.

[56]  Dervis Karaboga,et al.  A novel binary artificial bee colony algorithm based on genetic operators , 2015, Inf. Sci..

[57]  Po-Hua Yang,et al.  Application of Taguchi Method in Light-Emitting Diode Backlight Design for Wide Color Gamut Displays , 2009, Journal of Display Technology.

[58]  Evandro Parente,et al.  A hybrid shared/distributed memory parallel genetic algorithm for optimization of laminate composites , 2014 .

[59]  R. J. Kuo,et al.  A hybrid of genetic algorithm and particle swarm optimization for solving bi-level linear programming problem – A case study on supply chain model , 2011 .

[60]  Henry Y. K. Lau,et al.  An AIS-based hybrid algorithm for static job shop scheduling problem , 2012, Journal of Intelligent Manufacturing.

[61]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[62]  Jian-Da Wu,et al.  A forecasting system for car fuel consumption using a radial basis function neural network , 2012, Expert Syst. Appl..

[63]  Gwo-Fong Lin,et al.  A hybrid neural network model for typhoon-rainfall forecasting , 2009 .

[64]  S. S. Mahapatra,et al.  An improved demand forecasting method to reduce bullwhip effect in supply chains , 2014, Expert Syst. Appl..

[65]  Guoping Xia,et al.  An investigation and comparison of artificial neural network and time series models for Chinese food grain price forecasting , 2007, Neurocomputing.

[66]  Robert F. Engle,et al.  Forecasting and testing in co-integrated systems , 1987 .

[67]  D. E. Goldberg,et al.  Genetic Algorithms in Search, Optimization & Machine Learning , 1989 .

[68]  Andrés Iglesias,et al.  A new iterative mutually coupled hybrid GA-PSO approach for curve fitting in manufacturing , 2013, Appl. Soft Comput..

[69]  R. J. Kuo,et al.  Integration of particle swarm optimization and genetic algorithm for dynamic clustering , 2012, Inf. Sci..

[70]  E. Anawa,et al.  Using Taguchi method to optimize welding pool of dissimilar laser-welded components , 2008 .

[71]  Ke Wang,et al.  China’s primary energy demands in 2020: Predictions from an MPSO–RBF estimation model , 2011 .

[72]  Haruna Chiroma,et al.  Evolutionary Neural Network model for West Texas Intermediate crude oil price prediction , 2015 .

[73]  Fernando José Von Zuben,et al.  An Immunological Density-Preserving Approach to the Synthesis of RBF Neural Networks for classification , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[74]  Shiwei Yu,et al.  Provincial carbon intensity abatement potential estimation in China: A PSO–GA-optimized multi-factor environmental learning curve method , 2015 .

[75]  A. Noorul Haq,et al.  Simulation and parameter optimization of flux cored arc welding using artificial neural network and particle swarm optimization algorithm , 2012, Journal of Intelligent Manufacturing.

[76]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[77]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[78]  Carl G. Looney,et al.  Advances in Feedforward Neural Networks: Demystifying Knowledge Acquiring Black Boxes , 1996, IEEE Trans. Knowl. Data Eng..

[79]  N. Kumarappan,et al.  Day-ahead deregulated electricity market price forecasting using neural network input featured by DCT , 2014 .

[80]  Zne-Jung Lee.  A novel hybrid algorithm for function approximation , 2008, Expert Syst. Appl..

[81]  Hamed Ketabchi,et al.  Evolutionary algorithms for the optimal management of coastal groundwater: A comparative study toward future challenges , 2015 .

[82]  C. Senabre,et al.  Application of SOM neural networks to short-term load forecasting: The Spanish electricity market case study , 2012 .

[83]  A. Rezaee Jordehi,et al.  Parameter selection in particle swarm optimisation: a survey , 2013, J. Exp. Theor. Artif. Intell..

[84]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[85]  Ke Wang,et al.  A hybrid self-adaptive Particle Swarm Optimization–Genetic Algorithm–Radial Basis Function model for annual electricity demand prediction , 2015 .

[86]  J S Denker,et al.  Neural network models of learning and adaptation , 1986 .

[87]  Genichi Taguchi,et al.  Taguchi's Quality Engineering Handbook , 2004 .