Data-Driven Design and Optimization of Feedback Control Systems for Industrial Applications

In this paper, regarding the observer form of the well-known Youla parameterization, the controller design and optimization are exhibited with an integrated residual access. To better reveal this philosophy, the feedback control loop is interpreted on the basis of the observer-based residual generator. The next main attention is drawn to the generation of residuals, the design of a deadbeat controller for system stabilization both in the data-driven environment, and later the optimal adaptive realization of a dynamic system that translates residuals into compensatory control inputs to meet certain performance specifications. Towards these goals, numerical algorithms are summarized, and for the issues of controller optimization, the reinforcement learning algorithm is introduced using only measured input-output and residual signals. In addition, the effectiveness of developed schemes for industrial applications is also illustrated by experimental studies on a laboratory continuous stirred tank heater (CSTH) process.

[1]  Steven X. Ding,et al.  Real-Time Implementation of Fault-Tolerant Control Systems With Performance Optimization , 2014, IEEE Transactions on Industrial Electronics.

[2]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[3]  Si-Zhao Joe Qin,et al.  An overview of subspace identification , 2006, Comput. Chem. Eng..

[4]  Huijun Gao,et al.  Distributed H∞ Filtering for a Class of Markovian Jump Nonlinear Time-Delay Systems Over Lossy Sensor Networks , 2013, IEEE Transactions on Industrial Electronics.

[5]  Approximate dynamic programming for output feedback control , 2010, Proceedings of the 29th Chinese Control Conference.

[6]  Meng Joo Er,et al.  Obstacle avoidance of a mobile robot using hybrid learning approach , 2005, IEEE Transactions on Industrial Electronics.

[7]  Kao-Shing Hwang,et al.  Adaptive reinforcement learning system for linearization control , 2000, IEEE Trans. Ind. Electron..

[8]  M. Steinbuch,et al.  Data-based optimal control , 2005, Proceedings of the 2005, American Control Conference, 2005..

[9]  Nina F. Thornhill,et al.  A continuous stirred tank heater simulation model with applications , 2008 .

[10]  Frank L. Lewis,et al.  Optimal Control: Lewis/Optimal Control 3e , 2012 .

[11]  Frank L. Lewis,et al.  Reinforcement Learning and Approximate Dynamic Programming for Feedback Control , 2012 .

[12]  Steven X. Ding,et al.  Model-based Fault Diagnosis Techniques: Design Schemes, Algorithms, and Tools , 2008 .

[13]  R. Skelton,et al.  Markov Data-Based LQG Control , 2000 .

[14]  Zhang Ren,et al.  A new controller architecture for high performance, robust, and fault-tolerant control , 2001, IEEE Trans. Autom. Control..

[15]  Michel Kinnaert,et al.  Diagnosis and Fault-tolerant Control, 2nd edition , 2006 .

[16]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[17]  Laurent Bako,et al.  Parameterization and identification of multivariable state-space systems: A canonical approach , 2011, Autom..

[18]  Steven X. Ding,et al.  Data-driven design of monitoring and diagnosis systems for dynamic processes: A review of subspace technique based schemes and some recent results , 2014 .

[19]  Yeung Sam Hung,et al.  Distributed $H_{\infty}$ Filtering for Polynomial Nonlinear Stochastic Systems in Sensor Networks , 2011, IEEE Transactions on Industrial Electronics.

[20]  Torsten Jeinsch,et al.  Feedback Control Structures, Embedded Residual Signals, and Feedback Control Schemes With an Integrated Residual Access , 2010, IEEE Transactions on Control Systems Technology.

[21]  B. Moor,et al.  Subspace identification for linear systems , 1996 .

[22]  Zhong-Ping Jiang,et al.  Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics , 2012, Autom..

[23]  Frank L. Lewis,et al.  Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Yong Zhang,et al.  Data-driven realizations of kernel and image representations and their application to fault detection and control system design , 2014, Autom..

[25]  Andrew G. Barto,et al.  Adaptive linear quadratic control using policy iteration , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[26]  Biao Huang,et al.  Dynamic Modeling, Predictive Control and Performance Monitoring: A Data-driven Subspace Approach , 2008 .

[27]  Hamid Reza Karimi,et al.  Data-driven design of robust fault detection system for wind turbines , 2014 .

[28]  B. Moor,et al.  Subspace state space system identification for industrial processes , 1998 .

[29]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .