Control performance monitoring and degradation recovery in automatic control systems: A review, some new results, and future perspectives

Abstract This paper addresses control performance monitoring (CPM) and degradation recovering in automatic control systems. It begins with a re-visit of CPM techniques and a summary of the major limitations of the existing CPM methods. They are (i) deficit in assessing control performance degradation caused by different types of disturbances and environment uncertainties, (ii) incapability for predicting performance degradation, and (iii) deficiency of efficient performance degradation recovering methods. In order to meet increasing demands of next generation automatic control systems for higher system performance, novel CPM methods have been developed in recent years, including performance assessment of control systems with deterministic disturbances and uncertainties, prediction of control performance degradation, and recovery of control performance degradation. Some of these methods and algorithms are introduced in the second part of this paper. The basis of these methods is a so-called residual centred model of feedback control systems, which allows a unified handling of control, monitoring and diagnosis in feedback control systems corrupted by disturbances and uncertainties. The focuses of these methods are on (i) introduction of the loop performance degradation index for the assessment and prediction of performance degradation in automatic control systems, (ii) predictive detection and estimation of loop performance degradation, and (iii) a data-driven performance degradation recovering scheme. The paper is concluded by a short summary of three future perspective topics, (i) prediction of economic system performance monitoring and estimation, (ii) reinforcement learning aided system performance recovery, and (iii) CPM digital twin.

[1]  Changsheng Hua Reinforcement Learning and Feedback Control , 2021, Reinforcement Learning Aided Performance Optimization of Feedback Control Systems.

[2]  Mohieddine Jelali,et al.  An overview of control performance assessment technology and industrial applications , 2006 .

[3]  Thomas F. Edgar,et al.  PID control performance assessment: The single‐loop case , 2004 .

[4]  Frank L. Lewis,et al.  Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  S. Joe Qin,et al.  Recent developments in multivariable controller performance monitoring , 2007 .

[6]  Michael W. Grieves Virtually Intelligent Product Systems: Digital and Physical Twins , 2019, Complex Systems Engineering: Theory and Practice.

[7]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[8]  Tore Hägglund,et al.  Advanced PID Control , 2005 .

[9]  Steven X. Ding,et al.  Data-driven Design of Fault Diagnosis and Fault-tolerant Control Systems , 2014 .

[10]  John B. Moore,et al.  High Performance Control , 1997 .

[11]  Changsheng Hua Reinforcement Learning Aided Performance Optimization of Feedback Control Systems , 2021 .

[12]  Sirish L. Shah,et al.  The role of the unitary interactor matrix in the explicit solution of the singular LQ output feedback control problem , 1997, Autom..

[13]  Se-Kyu Oh,et al.  Iterative learning model predictive control for constrained multivariable control of batch processes , 2016, Comput. Chem. Eng..

[14]  Biao Huang,et al.  Performance Assessment of Control Loops , 1999 .

[15]  Ying Yang,et al.  Performance-Based Fault Detection and Fault-Tolerant Control for Nonlinear Systems With T–S Fuzzy Implementation , 2019, IEEE Transactions on Cybernetics.

[16]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Junghui Chen,et al.  Iterative Learning Control (ILC)-Based Economic Optimization for Batch Processes Using Helpful Disturbance Information , 2018 .

[18]  Nael H. El-Farra,et al.  A unified framework for detection, isolation and compensation of actuator faults in uncertain particulate processes , 2009 .

[19]  Stephen P. Boyd,et al.  MIMO PID tuning via iterated LMI restriction , 2016 .

[20]  Biao Huang,et al.  Multi-step prediction error approach for controller performance monitoring , 2010 .

[21]  T. Yamamoto,et al.  Design of a PID Controller with a Performance-Driven Adaptive Mechanism , 2007, 2007 American Control Conference.

[22]  David Zumoffen,et al.  Data-Driven Plant-Wide Control Performance Monitoring , 2019, Industrial & Engineering Chemistry Research.

[23]  Steven X. Ding,et al.  Performance Supervised Fault Detection Schemes for Industrial Feedback Control Systems and their Data-Driven Implementation , 2020, IEEE Transactions on Industrial Informatics.

[24]  Kaixiang Peng,et al.  Performance-based fault detection and fault-tolerant control for automatic control systems , 2019, Autom..

[25]  Nael H. El-Farra,et al.  Robust fault detection and monitoring of hybrid process systems with uncertain mode transitions , 2011 .

[26]  Zhiqiang Geng,et al.  Distributed data-based fault identification and accommodation in networked process systems , 2015 .

[27]  T. J. Harris,et al.  Performance assessment of multivariable feedback controllers , 1996, Autom..

[28]  Sheng Chen,et al.  A data-based approach for multivariate model predictive control performance monitoring , 2011, Neurocomputing.

[29]  Steven X. Ding,et al.  Application of randomized algorithms to assessment and design of observer-based fault detection systems , 2019, Autom..

[30]  Raghunathan Rengaswamy,et al.  Control loop performance assessment using detrended fluctuation analysis (DFA) , 2012, Autom..

[31]  Steven X. Ding,et al.  Integrated design of feedback controllers and fault detectors , 2009, Annu. Rev. Control..

[32]  T. Harris Assessment of Control Loop Performance , 1989 .

[33]  Steven X. Ding,et al.  Advanced methods for fault diagnosis and fault-tolerant control , 2021 .

[34]  Nael H. El-Farra,et al.  Forecast-Triggered Model Predictive Control of Constrained Nonlinear Processes with Control Actuator Faults , 2018, Mathematics.

[35]  C. T. Seppala,et al.  A review of performance monitoring and assessment techniques for univariate and multivariate control systems , 1999 .

[36]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[37]  Steven X. Ding,et al.  Performance-Based Fault-Tolerant Control Approaches For Industrial Processes With Multiplicative Faults , 2020, IEEE Transactions on Industrial Informatics.

[38]  Ramon Vilanova,et al.  PID control in the Third Millennium : lessons learned and new approaches , 2012 .

[39]  S. Joe Qin,et al.  Statistical MIMO controller performance monitoring. Part II: Performance diagnosis , 2008 .

[40]  Steven X. Ding,et al.  Gap metric techniques and their application to fault detection performance analysis and fault isolation schemes , 2020, Autom..

[41]  Barry Lennox,et al.  Model predictive control monitoring using multivariate statistics , 2009 .

[42]  Leiba Rodman,et al.  Algebraic Riccati equations , 1995 .

[43]  S. Joe Qin,et al.  Control performance monitoring — a review and assessment , 1998 .

[44]  B. De Moor,et al.  Model-free subspace-based LQG-design , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[45]  Kaixiang Peng,et al.  A Novel Scheme for Key Performance Indicator Prediction and Diagnosis With Application to an Industrial Hot Strip Mill , 2013, IEEE Transactions on Industrial Informatics.

[46]  B. Moor,et al.  Subspace identification for linear systems , 1996 .

[47]  Xin Peng,et al.  Distributed data-driven optimal fault detection for large-scale systems , 2020 .

[48]  Prashant Mhaskar,et al.  Robust Model Predictive Control Design for Fault-Tolerant Control of Process Systems , 2006 .

[49]  Gene H. Golub,et al.  Matrix computations , 1983 .

[50]  Mohieddine Jelali,et al.  Control Performance Management in Industrial Automation , 2012 .

[51]  K. Åström,et al.  Performance and robustness trade-offs in PID control , 2014 .

[52]  Alireza Karimi,et al.  A toolbox for robust PID controller tuning using convex optimization , 2012 .

[53]  Francis J. Doyle,et al.  Survey on iterative learning control, repetitive control, and run-to-run control , 2009 .

[54]  Steven X. Ding,et al.  Model-based Fault Diagnosis Techniques: Design Schemes, Algorithms, and Tools , 2008 .

[55]  Stephen P. Boyd,et al.  PID design by convex-concave optimization , 2013, 2013 European Control Conference (ECC).

[56]  Mohieddine Jelali,et al.  The current state of control loop performance monitoring – A survey of application in industry , 2016 .

[57]  F. Lewis,et al.  Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers , 2012, IEEE Control Systems.

[58]  Feng Qian,et al.  Multi-input–Multi-output (MIMO) Control System Performance Monitoring Based on Dissimilarity Analysis , 2014 .

[59]  Steven X. Ding,et al.  Control Performance-Based Fault-Tolerant Control Strategy for Singular Systems , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[60]  Biao Huang,et al.  Performance assessment of model pedictive control for variability and constraint tuning , 2007 .