Two-Stage Method for Diagonal Recurrent Neural Network Identification of a High-Power Continuous Microwave Heating System

This paper proposes a diagonal recurrent neural network (DRNN) based identification scheme to handle the complexity and nonlinearity of high-power continuous microwave heating system (HPCMHS). The new DRNN design involves a two-stage training process that couples an efficient forward model selection technique with gradient-based optimization. In the first stage, an impact recurrent network structure is obtained by a fast recursive algorithm in a stepwise forward procedure. To ensure stability, update rules are further developed using Lyapunov stability criterion to tune parameters of reduced size model at the second stage. The proposed approach is tested with an experimental regression problem and a practical HPCMHS identification, and the results are compared with four typical network models. The results show that the new design demonstrates improved accuracy and model compactness with reduced computational complexity over the existing methods.

[1]  Yuanying Ni,et al.  Effect of carbonic maceration pre-treatment on the drying behavior and physicochemical compositions of sweet potato dried with intermittent or continuous microwave , 2016 .

[2]  Timothy Marler,et al.  Neural network for regression problems with reduced training sets , 2017, Neural Networks.

[3]  Stephen A. Billings,et al.  International Journal of Control , 2004 .

[4]  S. Chen,et al.  Fast orthogonal least squares algorithm for efficient subset model selection , 1995, IEEE Trans. Signal Process..

[5]  Li Ping Shen,et al.  Improve the Accuracy of Recurrent Fuzzy System Design Using an Efficient Continuous Ant Colony Optimization , 2018, International Journal of Fuzzy Systems.

[6]  Shuai Li,et al.  A Novel Recurrent Neural Network for Manipulator Control With Improved Noise Tolerance , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Yunong Zhang,et al.  Robust Zeroing Neural-Dynamics and Its Time-Varying Disturbances Suppression Model Applied to Mobile Robot Manipulators , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Yunong Zhang,et al.  A Hybrid Multi-Objective Scheme Applied to Redundant Robot Manipulators , 2017, IEEE Transactions on Automation Science and Engineering.

[10]  Dariush Mowla,et al.  Experimental and theoretical investigation of shelled corn drying in a microwave-assisted fluidized bed dryer using Artificial Neural Network , 2011 .

[11]  Yi Cao,et al.  Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation , 2008 .

[12]  Phadungsak Rattanadecho,et al.  Development of compressive strength of cement paste under accelerated curing by using a continuous microwave thermal processor , 2008 .

[13]  MengChu Zhou,et al.  Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[14]  George W. Irwin,et al.  A fast nonlinear model identification method , 2005, IEEE Transactions on Automatic Control.

[15]  Fuad E. Alsaadi,et al.  Bipolar Fuzzy Hamacher Aggregation Operators in Multiple Attribute Decision Making , 2017, International Journal of Fuzzy Systems.

[16]  Armando Blanco,et al.  A real-coded genetic algorithm for training recurrent neural networks , 2001, Neural Networks.

[17]  Ah Chung Tsoi,et al.  Locally recurrent globally feedforward networks: a critical review of architectures , 1994, IEEE Trans. Neural Networks.

[18]  Smriti Srivastava,et al.  Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion. , 2017, ISA transactions.

[19]  T. G. K. Murthy,et al.  Microwave drying of mango ginger (Curcuma amada Roxb): prediction of drying kinetics by mathematical modelling and artificial neural network , 2012 .

[20]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[21]  Mahmoud Omid,et al.  Prediction of Physicochemical Properties of Raspberry Dried by Microwave-Assisted Fluidized Bed Dryer Using Artificial Neural Network , 2014 .

[22]  S Z Qin,et al.  Comparison of four neural net learning methods for dynamic system identification , 1992, IEEE Trans. Neural Networks.

[23]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[24]  Yung C. Shin,et al.  Constructive training of recurrent neural networks using hybrid optimization , 2010, Neurocomputing.

[25]  Shuai Li,et al.  Zeroing neural-dynamics approach and its robust and rapid solution for parallel robot manipulators against superposition of multiple disturbances , 2018, Neurocomputing.

[26]  Ganesh K. Venayagamoorthy,et al.  Quantum inspired PSO for the optimization of simultaneous recurrent neural networks as MIMO learning systems , 2010, Neural Networks.

[27]  George W. Irwin,et al.  Two-Stage Orthogonal Least Squares Methods for Neural Network Construction , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Sheng Chen,et al.  Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks , 1999, IEEE Trans. Neural Networks.

[29]  Rajesh Kumar,et al.  Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates , 2018, Neurocomputing.

[30]  Kezhi Mao,et al.  Fast orthogonal forward selection algorithm for feature subset selection , 2002, IEEE Trans. Neural Networks.

[31]  Wen Yu,et al.  Dead-zone Kalman filter algorithm for recurrent neural networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[32]  Shuai Li,et al.  A Noise-Suppressing Neural Algorithm for Solving the Time-Varying System of Linear Equations: A Control-Based Approach , 2019, IEEE Transactions on Industrial Informatics.

[33]  Ramazan Coban.  A context layered locally recurrent neural network for dynamic system identification , 2013, Eng. Appl. Artif. Intell..

[34]  Tao Wang,et al.  A hybrid optimization-based recurrent neural network for real-time data prediction , 2013, Neurocomputing.

[35]  Saeid Minaei,et al.  Microwave–vacuum drying of sour cherry: comparison of mathematical models and artificial neural networks , 2013, Journal of Food Science and Technology.

[36]  Shuai Li,et al.  Neural Dynamics for Cooperative Control of Redundant Robot Manipulators , 2018, IEEE Transactions on Industrial Informatics.

[37]  S. Billings,et al.  Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks , 1996 .

[38]  Jiannan Li,et al.  Research of uniformity evaluation model based on entropy clustering in the microwave heating processes , 2016, Neurocomputing.

[39]  Stephen A. Billings,et al.  An adaptive wavelet neural network for spatio-temporal system identification , 2010, Neural Networks.

[40]  D. Atong,et al.  Drying of a Slip Casting for Tableware Product Using Microwave Continuous Belt Dryer , 2006 .

[41]  Lee A. Feldkamp,et al.  Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks , 1994, IEEE Trans. Neural Networks.

[42]  Phadungsak Rattanadecho,et al.  The microwave processing of wood using a continuous microwave belt drier , 2009 .

[43]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[44]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[45]  Shuai Li,et al.  Tracking Control of Robot Manipulators with Unknown Models: A Jacobian-Matrix-Adaption Method , 2018, IEEE Transactions on Industrial Informatics.

[46]  Shuai Li,et al.  Kinematic Control of Redundant Manipulators Using Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.