New Parameter-Free Simplified Swarm Optimization for Artificial Neural Network Training and its Application in the Prediction of Time Series

A new soft computing method called the parameter-free simplified swarm optimization (SSO)-based artificial neural network (ANN), or improved SSO for short, is proposed to adjust the weights in ANNs. The method is a modification of the SSO, and seeks to overcome some of the drawbacks of SSO. In the experiments, the iSSO is compared with five other famous soft computing methods, including the backpropagation algorithm, the genetic algorithm, the particle swarm optimization (PSO) algorithm, cooperative random learning PSO, and the SSO, and its performance is tested on five famous time-series benchmark data to adjust the weights of two ANN models (multilayer perceptron and single multiplicative neuron model). The experimental results demonstrate that iSSO is robust and more efficient than the other five algorithms.

[1]  Li-Chiu Chang,et al.  Reinforced Two-Step-Ahead Weight Adjustment Technique for Online Training of Recurrent Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  John T. Coshall,et al.  Combining volatility and smoothing forecasts of UK demand for international tourism , 2009 .

[4]  Wei-Chang Yeh,et al.  Optimization of the Disassembly Sequencing Problem on the Basis of Self-Adaptive Simplified Swarm Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Peter Tiño,et al.  Minimum Complexity Echo State Network , 2011, IEEE Transactions on Neural Networks.

[6]  Daniel Molina,et al.  Time Series Modeling and Forecasting Using Memetic Algorithms for Regime-Switching Models , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Nikolay I. Nikolaev,et al.  Recursive Bayesian Recurrent Neural Networks for Time-Series Modeling , 2010, IEEE Transactions on Neural Networks.

[8]  Mingjun Wang,et al.  Particle swarm optimization-based support vector machine for forecasting dissolved gases content in power transformer oil , 2009 .

[9]  Liang Zhao,et al.  PSO-based single multiplicative neuron model for time series prediction , 2009, Expert Syst. Appl..

[10]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[11]  Hübner,et al.  Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser. , 1989, Physical review. A, General physics.

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  Haiyan Lu,et al.  Combined modeling for electric load forecasting with adaptive particle swarm optimization , 2010 .

[14]  J. Liang,et al.  Robust Synchronization of an Array of Coupled Stochastic Discrete-Time Delayed Neural Networks , 2008, IEEE Transactions on Neural Networks.

[15]  Wei-Chang Yeh,et al.  Simplified swarm optimization in disassembly sequencing problems with learning effects , 2012, Comput. Oper. Res..

[16]  Rohit Mathur,et al.  Real-time bias-adjusted O3 and PM2.5 air quality index forecasts and their performance evaluations over the continental United States , 2010 .

[17]  Wei-Chang Yeh,et al.  Novel swarm optimization for mining classification rules on thyroid gland data , 2012, Inf. Sci..

[18]  Weizhong Yan,et al.  Toward Automatic Time-Series Forecasting Using Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Wei-Chang Yeh,et al.  A new hybrid approach for mining breast cancer pattern using discrete particle swarm optimization and statistical method , 2009, Expert Syst. Appl..

[20]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[21]  Kaoru Hirota,et al.  A Solution for the N-bit Parity Problem Using a Single Translated Multiplicative Neuron , 2004, Neural Processing Letters.

[22]  Guoqiang Peter Zhang,et al.  Trend Time–Series Modeling and Forecasting With Neural Networks , 2008, IEEE Transactions on Neural Networks.

[23]  Wei-Chang Yeh,et al.  A two-stage discrete particle swarm optimization for the problem of multiple multi-level redundancy allocation in series systems , 2009, Expert Syst. Appl..

[24]  Ali Zilouchian,et al.  FUNDAMENTALS OF NEURAL NETWORKS , 2001 .