An Online Outlier Identification and Removal Scheme for Improving Fault Detection Performance

Measured data or states for a nonlinear dynamic system is usually contaminated by outliers. Identifying and removing outliers will make the data (or system states) more trustworthy and reliable since outliers in the measured data (or states) can cause missed or false alarms during fault diagnosis. In addition, faults can make the system states nonstationary needing a novel analytical model-based fault detection (FD) framework. In this paper, an online outlier identification and removal (OIR) scheme is proposed for a nonlinear dynamic system. Since the dynamics of the system can experience unknown changes due to faults, traditional observer-based techniques cannot be used to remove the outliers. The OIR scheme uses a neural network (NN) to estimate the actual system states from measured system states involving outliers. With this method, the outlier detection is performed online at each time instant by finding the difference between the estimated and the measured states and comparing its median with its standard deviation over a moving time window. The NN weight update law in OIR is designed such that the detected outliers will have no effect on the state estimation, which is subsequently used for model-based fault diagnosis. In addition, since the OIR estimator cannot distinguish between the faulty or healthy operating conditions, a separate model-based observer is designed for fault diagnosis, which uses the OIR scheme as a preprocessing unit to improve the FD performance. The stability analysis of both OIR and fault diagnosis schemes are introduced. Finally, a three-tank benchmarking system and a simple linear system are used to verify the proposed scheme in simulations, and then the scheme is applied on an axial piston pump testbed. The scheme can be applied to nonlinear systems whose dynamics and underlying distribution of states are subjected to change due to both unknown faults and operating conditions.

[1]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[2]  Martin Brown,et al.  Simultaneous, Multiplicative Actuator and Sensor Fault Estimation using Fuzzy Observers , 2007, 2007 IEEE International Fuzzy Systems Conference.

[3]  Bo Song,et al.  A New Algorithm for Outlier Detection Based on Offset , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[4]  Stefan Berchtold,et al.  Efficient Biased Sampling for Approximate Clustering and Outlier Detection in Large Data Sets , 2003, IEEE Trans. Knowl. Data Eng..

[5]  Douglas M. Hawkins Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[6]  Didier Theilliol,et al.  Fault diagnosis and accommodation of a three-tank system based on analytical redundancy. , 2002, ISA transactions.

[7]  Toshihiro Furukawa,et al.  Kalman filter for robust noise suppression in white and colored noises , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[8]  Panagiotis D. Christofides,et al.  Data-based fault detection and isolation using feedback control: Output feedback and optimality , 2009 .

[9]  Raymond T. Ng,et al.  Algorithms for Mining Distance-Based Outliers in Large Datasets , 1998, VLDB.

[10]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[11]  Luigi Villani,et al.  Actuators fault diagnosis for robot manipulators with uncertain model , 2009 .

[12]  Rolf Isermann,et al.  Model-based fault-detection and diagnosis - status and applications , 2004, Annu. Rev. Control..

[13]  Kihoon Choi,et al.  Systematic Data-Driven Approach to Real-Time Fault Detection and Diagnosis in Automotive Engines , 2006, 2006 IEEE Autotestcon.

[14]  Stefan Schaal,et al.  A Kalman filter for robust outlier detection , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  S. Jagannathan,et al.  A unified model-based fault diagnosis scheme for non-linear discrete-time systems with additive and multiplicative faults , 2013 .

[16]  Chaitanya Sankavaram,et al.  Integrated model-based and data-driven fault detection and diagnosis approach for an automotive electric power steering system , 2011, 2011 IEEE AUTOTESTCON.

[17]  Shing-Chow Chan,et al.  A new robust Kalman filter algorithm under outliers and system uncertainties , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[18]  Radoslaw Romuald Zakrzewski,et al.  Neural network control of nonlinear discrete time systems , 1994 .

[19]  Raymond T. Ng,et al.  Distance-based outliers: algorithms and applications , 2000, The VLDB Journal.

[20]  P. Rousseeuw,et al.  A fast algorithm for the minimum covariance determinant estimator , 1999 .

[21]  Sarangapani Jagannathan,et al.  A Model-Based Fault-Detection and Prediction Scheme for Nonlinear Multivariable Discrete-Time Systems With Asymptotic Stability Guarantees , 2010, IEEE Transactions on Neural Networks.

[22]  Gang Tao,et al.  A feedback-based fault detection scheme for aircraft systems with damage , 2011, 2011 8th Asian Control Conference (ASCC).

[23]  Eduardo Mario Nebot,et al.  An outlier-robust Kalman filter , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Marios M. Polycarpou,et al.  Fault diagnosis of a class of nonlinear uncertain systems with Lipschitz nonlinearities using adaptive estimation , 2010, Autom..

[25]  Jiang-She Zhang,et al.  Robust clustering by pruning outliers , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[26]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[27]  Heidar Ali Talebi,et al.  A neural network-based actuator gain Fault Detection and Isolation strategy for nonlinear systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[28]  J.J. Gertler,et al.  Survey of model-based failure detection and isolation in complex plants , 1988, IEEE Control Systems Magazine.

[29]  T. Ferryman,et al.  Data outlier detection using the Chebyshev theorem , 2005, 2005 IEEE Aerospace Conference.