Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system

The wastewater treatment is an effective method for alleviating the shortage of water resources. In this article, a data‐driven iterative adaptive tracking control approach is developed to improve the control performance of the dissolved oxygen concentration and the nitrate nitrogen concentration in the nonlinear wastewater treatment plant. First, the model network is established to obtain the steady control and evaluate the new system state. Then, a nonquadratic performance functional is provided to handle asymmetric control constraints. Moreover, the new costate function and the tracking control policy are derived by using the dual heuristic dynamic programming algorithm. In the present control scheme, two neural networks are constructed to approximate the costate function and the tracking control law. Finally, the feasibility of the proposed algorithm is confirmed by applying the designed strategy to the wastewater treatment plant.

[1]  Xiaolong Wu,et al.  A Self-Organizing Sliding-Mode Controller for Wastewater Treatment Processes , 2019, IEEE Transactions on Control Systems Technology.

[2]  Junfei Qiao,et al.  Multi‐Variable Direct Self‐Organizing Fuzzy Neural Network Control for Wastewater Treatment Process , 2018, Asian Journal of Control.

[3]  Ulf Jeppsson,et al.  Benchmark Simulation Model no. 1 (BSM1) , 2008 .

[4]  Ben Niu,et al.  Adaptive Neural Tracking Control Scheme of Switched Stochastic Nonlinear Pure-Feedback Nonlower Triangular Systems , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Xin Zhang,et al.  Online adaptive dynamic programming based on echo state networks for dissolved oxygen control , 2018, Appl. Soft Comput..

[6]  Ruizhuo Song,et al.  Data-driven finite-horizon optimal tracking control scheme for completely unknown discrete-time nonlinear systems , 2019, Neurocomputing.

[7]  Wendong Xiao,et al.  Optimal Tracking Control for a Class of Unknown Discrete-time Systems with Actuator Saturation via Data-based ADP Algorithm , 2013 .

[8]  Derong Liu,et al.  Neural robust stabilization via event-triggering mechanism and adaptive learning technique , 2018, Neural Networks.

[9]  Xin Xu,et al.  Neural critic learning toward robust dynamic stabilization , 2019, International Journal of Robust and Nonlinear Control.

[10]  Derong Liu,et al.  Model-Free H∞ Optimal Tracking Control of Constrained Nonlinear Systems via an Iterative Adaptive Learning Algorithm , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  C. L. Philip Chen,et al.  Event-Trigger-Based Finite-Time Fuzzy Adaptive Control for Stochastic Nonlinear System With Unmodeled Dynamics , 2021, IEEE Transactions on Fuzzy Systems.

[12]  Huaguang Zhang,et al.  A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration Algorithm , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Qiao Jun-fei,et al.  Heuristic Dynamic Programming Using Echo State Network For Multivariable Tracking Control Of Wastewater Treatment Process , 2015 .

[14]  Frank L. Lewis,et al.  Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Junfei Qiao,et al.  Self-Learning Optimal Regulation for Discrete-Time Nonlinear Systems Under Event-Driven Formulation , 2020, IEEE Transactions on Automatic Control.

[16]  Jiaqi Liang,et al.  Wide-area measurement based dynamic stochastic optimal power flow control for smart grids with high variability and uncertainty , 2012, 2012 IEEE Power and Energy Society General Meeting.

[17]  C. L. Philip Chen,et al.  Optimized Formation Control Using Simplified Reinforcement Learning for a Class of Multiagent Systems With Unknown Dynamics , 2020, IEEE Transactions on Industrial Electronics.

[18]  Derong Liu,et al.  Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach , 2012, Neurocomputing.

[19]  Derong Liu,et al.  Event-triggered constrained control with DHP implementation for nonaffine discrete-time systems , 2020, Inf. Sci..

[20]  Haibo He,et al.  Novel iterative neural dynamic programming for data-based approximate optimal control design , 2017, Autom..

[21]  C. L. Philip Chen,et al.  Optimized Multi-Agent Formation Control Based on an Identifier–Actor–Critic Reinforcement Learning Algorithm , 2018, IEEE Transactions on Fuzzy Systems.

[22]  Frank L. Lewis,et al.  Actor–Critic-Based Optimal Tracking for Partially Unknown Nonlinear Discrete-Time Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Zheng Liu,et al.  Data-Driven Multiobjective Predictive Control for Wastewater Treatment Process , 2020, IEEE Transactions on Industrial Informatics.

[24]  Derong Liu,et al.  Event-Triggered Adaptive Critic Control Design for Discrete-Time Constrained Nonlinear Systems , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Derong Liu,et al.  Data-based Self-learning Optimal Control: Research Progress and Prospects , 2013 .

[26]  Derong Liu,et al.  Data-Based Nonaffine Optimal Tracking Control Using Iterative DHP Approach , 2020 .

[27]  Fuad E. Alsaadi,et al.  Adaptive Neural State-Feedback Tracking Control of Stochastic Nonlinear Switched Systems: An Average Dwell-Time Method , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Huaguang Zhang,et al.  Neural-Network-Based Near-Optimal Control for a Class of Discrete-Time Affine Nonlinear Systems With Control Constraints , 2009, IEEE Transactions on Neural Networks.

[29]  Junfei Qiao,et al.  Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant , 2021, IEEE Transactions on Industrial Electronics.

[30]  Shuzhi Sam Ge,et al.  Optimized Backstepping for Tracking Control of Strict-Feedback Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[31]  C. L. Philip Chen,et al.  Finite-Time Adaptive Quantized Control of Stochastic Nonlinear Systems With Input Quantization: A Broad Learning System Based Identification Method , 2020, IEEE Transactions on Industrial Electronics.

[32]  Frank L. Lewis,et al.  Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach , 2005, Autom..

[33]  Xiaoguang Liu,et al.  Optimized Adaptive Nonlinear Tracking Control Using Actor–Critic Reinforcement Learning Strategy , 2019, IEEE Transactions on Industrial Informatics.

[34]  Wei Zhang,et al.  Dynamic multi-objective optimization control for wastewater treatment process , 2018, Neural Computing and Applications.