Binary Particle Swarm Optimization Structure Selection of Nonlinear Autoregressive Moving Average with Exogenous Inputs (NARMAX) Model of a Flexible Robot Arm

The Nonlinear Auto-Regressive Moving Average with Exogenous Inputs (NARMAX) model is a powerful, efficient and unified representation of a variety of nonlinear models. The model’s construction involves structure selection and parameter estimation, which can be simultaneously performed using the established Orthogonal Least Squares (OLS) algorithm. However, several criticisms have been directed towards OLS for its tendency to select excessive or sub-optimal terms leading to nonparsimonious models. This paper proposes the application of the Binary Particle Swarm Optimization (BPSO) algorithm for structure selection of NARMAX models. The selection process searches for the optimal structure using binary bits to accept or reject the terms to form the reduced regressor matrix. Construction of the model is done by first estimating the NARX model, then continues with the estimation of the MA model based on the residuals produced by NARX. One Step Ahead (OSA) prediction, Mean Squared Error (MSE) and residual histogram analysis were performed to validate the model. The proposed optimization algorithm was tested on the Flexible Robot Arm (FRA) dataset. Results show the success of BPSO structure selection for NARMAX when applied to the FRA dataset. The final NARMAX model combines the NARX and MA models to produce a model with improved predictive ability compared to the NARX model.

[1]  Sheng Chen,et al.  Extended model set, global data and threshold model identification of severely non-linear systems , 1989 .

[2]  Leandro dos Santos Coelho,et al.  Nonlinear Black-box System Identification through Neural Networks of a Hysteretic Piezoelectric Robotic Micromanipulator , 2015 .

[3]  Yiliu Liu,et al.  Customized configuration for hierarchical products: component clustering and optimization with PSO , 2011 .

[4]  Robert C. Green,et al.  Central force optimization on a GPU: a case study in high performance metaheuristics , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[5]  Mohammad Ali Vali,et al.  Identification of Time-Delay Systems using the Subspace Method , 2016 .

[6]  Rishi Amrit,et al.  Stochastic identification of bioreactor process exhibiting input multiplicity , 2007, Bioprocess and biosystems engineering.

[7]  Hector M. Romero Ugalde,et al.  Computational cost improvement of neural network models in black box nonlinear system identification , 2015, Neurocomputing.

[8]  WU Yunna,et al.  Application of Radial Basis Function Neural Network Based on Ant Colony Algorithm in Credit Evaluation of Real Estate Enterprises , 2010 .

[9]  M. A. Arjona,et al.  Parameter Estimation of a Synchronous Generator Using a Sine Cardinal Perturbation and Mixed Stochastic–Deterministic Algorithms , 2011, IEEE Transactions on Industrial Electronics.

[10]  J. B. Singh,et al.  Software fault prediction using Nonlinear Autoregressive with eXogenous Inputs (NARX) network , 2011, Applied Intelligence.

[11]  Xiaojun Wu,et al.  Adaptive Web QoS controller based on online system identification using quantum-behaved particle swarm optimization , 2015, Soft Comput..

[12]  Xianku Zhang,et al.  Multi-innovation auto-constructed least squares identification for 4 DOF ship manoeuvring modelling with full-scale trial data. , 2015, ISA transactions.

[13]  Yu Cheng,et al.  An efficient identification scheme for a nonlinear polynomial NARX model , 2011, Artificial Life and Robotics.

[14]  N. C. Van de Giesen,et al.  Monthly streamflow prediction in the Volta Basin of West Africa: A SISO NARMAX polynomial modelling , 2008 .

[15]  Chiung-Chou Liao.  Enhanced RBF Network for Recognizing Noise-Riding Power Quality Events , 2010, IEEE Transactions on Instrumentation and Measurement.

[16]  Juntao Fei,et al.  Adaptive fuzzy sliding mode control of MEMS gyroscope sensor using fuzzy switching approach , 2013, The SICE Annual Conference 2013.

[17]  Reza Shahnazi,et al.  Hyperchaos synchronization using PSO-optimized RBF-based controllers to improve security of communication systems , 2011, Neural Computing and Applications.

[18]  John D. Hios,et al.  FDI for Aircraft Systems Using Stochastic Pooled-NARMAX Representations: Design and Assessment , 2009, IEEE Transactions on Control Systems Technology.

[19]  Stephen A. Billings,et al.  An adaptive orthogonal search algorithm for model subset selection and non-linear system identification , 2008, Int. J. Control.

[20]  Yamina Mohamed Ben Ali,et al.  Psychological model of particle swarm optimization based multiple emotions , 2012, Applied Intelligence.

[21]  Luigi Piroddi,et al.  Simulation error minimisation methods for NARX model identification , 2008, Int. J. Model. Identif. Control..

[22]  Ian Cotton,et al.  Critical span identification model for dynamic thermal rating system placement , 2015 .

[23]  Stephen A. Billings,et al.  A new class of wavelet networks for nonlinear system identification , 2005, IEEE Transactions on Neural Networks.

[24]  Chia-Nan Ko,et al.  Identification of non-linear systems using radial basis function neural networks with time-varying learning algorithm , 2012, IET Signal Process..

[25]  Robert E. Kearney,et al.  NARMAX representation and identification of ankle dynamics , 2003, IEEE Transactions on Biomedical Engineering.

[26]  Xiao-Lin Li.  A Particle Swarm Optimization and Immune Theory-Based Algorithm for Structure Learning of Bayesian Networks , 2010 .

[27]  Ning Zhou,et al.  Probing Signal Design for Power System Identification , 2010, IEEE Transactions on Power Systems.

[28]  David Rees,et al.  Nonlinear gas turbine modeling using NARMAX structures , 2001, IEEE Trans. Instrum. Meas..

[29]  Jimoh Olarewaju Pedro,et al.  Nonlinear Active Vehicle Suspension Controller Design using PID Reference Tracking , 2015 .

[30]  Johan A. K. Suykens,et al.  Kernel based partially linear models and nonlinear identification , 2005, IEEE Transactions on Automatic Control.

[31]  Min-Yuan Cheng,et al.  Dynamic guiding particle swarm optimization with embedded chaotic search for solving multidimensional problems , 2011, Optimization Letters.

[32]  A. C. Schouten,et al.  Comparison of closed-loop system identification techniques to quantify multi-joint human balance control , 2016, Annu. Rev. Control..

[33]  Kyoung Kwan Ahn,et al.  Inverse Double NARX Fuzzy Modeling for System Identification , 2010, IEEE/ASME Transactions on Mechatronics.

[34]  M Cannesson,et al.  Goal-Directed fluid therapy with closed-loop assistance during moderate risk surgery using noninvasive cardiac output monitoring: A pilot study. , 2015, British journal of anaesthesia.

[35]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[36]  A. M. Moussa,et al.  An Improved Particle Swarm Optimization Technique for Solving the Unit Commitment Problem , 2011 .

[37]  Azlee Zabidi,et al.  System identification of essential oil extraction system using Non-Linear Autoregressive Model with Exogenous Inputs (NARX) , 2010, 2010 IEEE Control and System Graduate Research Colloquium (ICSGRC 2010).

[38]  Marco Lovera,et al.  NARX Model Identification with Error Filtering , 2008 .

[39]  Yang Wang,et al.  Wireless Mobile Sensor Network for the System Identification of a Space Frame Bridge , 2012, IEEE/ASME Transactions on Mechatronics.

[40]  Naveed R. Butt,et al.  Utilizing higher-order neural networks in U-model based controllers for stable nonlinear plants , 2011 .

[41]  Sheng Chen,et al.  Identification of non-linear output-affine systems using an orthogonal least-squares algorithm , 1988 .

[42]  Sean R. Anderson,et al.  Nonlinear Dynamic Modeling of Isometric Force Production in Primate Eye Muscle , 2010, IEEE Transactions on Biomedical Engineering.

[43]  Daniele Spina,et al.  Structural monitoring by the Italian Department of Civil Protection and the case of 2009 Abruzzo seismic sequence , 2011 .

[44]  Jun Wang,et al.  A Dynamic Feedforward Neural Network Based on Gaussian Particle Swarm Optimization and its Application for Predictive Control , 2011, IEEE Transactions on Neural Networks.

[45]  S. A. Billings,et al.  Using the NARMAX approach to model the evolution of energetic electrons fluxes at geostationary orbit , 2011 .

[46]  M. I. Yusof,et al.  Nonlinear system identification for a Dc motor using NARMAX approach , 2003, Asian Conference on Sensors, 2003. AsiaSense 2003..

[47]  Hoshin V. Gupta,et al.  Modeling the distributed effects of forest thinning on the long-term water balance and streamflow extremes for a semi-arid basin in the southwestern US , 2015 .

[48]  Zongkun Li,et al.  Nonlinear System Identification Based on Recurrent Wavelet Neural Network , 2009, ISNN.

[49]  Mahsa A. Golkar,et al.  Closed-loop identification of the dynamic relation between surface EMG and torque at the human ankle , 2015 .

[50]  Mayank Dave,et al.  Filterbank optimization for robust ASR using GA and PSO , 2012, Int. J. Speech Technol..

[51]  Wenhe Liao,et al.  Optimization of multi-pass face milling using a fuzzy particle swarm optimization algorithm , 2011 .

[52]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[53]  Stephen A. Billings,et al.  An alternative solution to the model structure selection problem , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[54]  Ramprasad Potluri,et al.  Path-tracking control of an autonomous 4WS4WD electric vehicle using its natural feedback loops , 2013, 2013 IEEE International Conference on Control Applications (CCA).

[55]  Robert E. Kearney,et al.  A least-squares parameter estimation algorithm for switched Hammerstein systems with applications to the VOR , 2005, IEEE Transactions on Biomedical Engineering.

[56]  Tian Yubo,et al.  Particle-Swarm-Optimization-Based Selective Neural Network Ensemble and Its Application to Modeling Resonant Frequency of Microstrip Antenna , 2011 .

[57]  Eduardo M. A. M. Mendes,et al.  Nonlinear Identification and Cluster Analysis of Chaotic Attractors from a Real Implementation of Chua's Circuit , 1997 .

[58]  Patrick Siarry,et al.  A multi-swarm PSO using charged particles in a partitioned search space for continuous optimization , 2012, Comput. Optim. Appl..

[59]  Khuong Vu,et al.  Study on attitude determination based on discrete particle swarm optimization , 2010 .

[60]  M. Er,et al.  Self-constructing Fuzzy Neural Networks with Extended Kalman Filter , 2010 .

[61]  Carlo Mastroianni,et al.  Special Issue: Bio-Inspired Optimization Techniques for High Performance Computing , 2011, New Generation Computing.

[62]  Kah Phooi Seng,et al.  Radial Basis Function Neural Network With Incremental Learning for Face Recognition , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  Luis A. Aguirre,et al.  Modeling Nonlinear Dynamics and Chaos: A Review , 2009 .

[64]  M. Sunwoo,et al.  Idle speed controller based on active disturbance rejection control in diesel engines , 2016 .

[65]  Yuan Bin Mo,et al.  Particle Swarm Optimization for Cylinder Helical Gear Multi-Objective Design Problems , 2011 .

[66]  Stephen A. Billings,et al.  Model structure selection using an integrated forward orthogonal search algorithm assisted by squared correlation and mutual information , 2008, Int. J. Model. Identif. Control..

[67]  Hao Xu,et al.  Productivity matching and quantitative prediction of coalbed methane wells based on BP neural network , 2011 .

[68]  Edgar Campos Furtado,et al.  Building dynamical models from data and prior knowledge: the case of the first period-doubling bifurcation. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  H. K. M. Youssef,et al.  Optimal Harmonic Meter Placement Using Particle Swarm Optimization Technique , 2011 .

[70]  Sung-Bae Cho,et al.  Radial basis function neural networks: a topical state-of-the-art survey , 2016, Open Comput. Sci..

[71]  P. Caminal,et al.  Model identification of the neural control of the cardiovascular system using NARMAX models , 1991, [1991] Proceedings Computers in Cardiology.

[72]  Lokukaluge P. Perera,et al.  System Identification of Nonlinear Vessel Steering , 2015 .

[73]  Antônio de Pádua Braga,et al.  Black and Gray-Box Identification of a Hydraulic Pumping System , 2011, IEEE Transactions on Control Systems Technology.

[74]  Yi-Qing Ni,et al.  On-board Identification and Control Performance Verification of an MR Damper Incorporated with Structure , 2011 .

[75]  Omer T. Inan,et al.  A Novel System Identification Technique for Improved Wearable Hemodynamics Assessment , 2015, IEEE Transactions on Biomedical Engineering.