Linear Prediction Approaches to Compensation of Missing Measurements in Kalman Filtering

Kalman filter relies heavily on perfect knowledge of sensor readings, used to compute the minimum mean square error estimate of the system state. However in reality, unavailability of output data might occur due to factors including sensor faults and failures, confined memory spaces of buffer registers and congestion of communication channels. Therefore investigations on the effectiveness of Kalman filtering in the case of imperfect data have, since the last decade, been an interesting yet challenging research topic. The prevailed methodology employed in the state estimation for imperfect data is the open loop estimation wherein the measurement update step is skipped during data loss time. This method has several shortcomings such as high divergence rate, not regaining its steady states after the data is resumed, etc. This thesis proposes a novel approach, which is found efficient for both stationary and nonstationary processes, for the above scenario, based on linear prediction schemes. Utilising the concept of linear prediction, the missing data (output signal) is reconstructed through modified linear prediction schemes. This signal is then employed in Kalman filtering at the measurement update step. To reduce the computational cost in the large matrix inversions, a modified Levinson-Durbin algorithm is employed. It is shown that the proposed scheme offers promising results in the event of loss of observations and exhibits the general properties of conventional Kalman filters. To demonstrate the effectiveness of the proposed scheme, a rigid body spacecraft case study subject to measurement loss has been considered.

[1]  Xiaoming Hu,et al.  Drift-free attitude estimation for accelerated rigid bodies , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  Kyu Yong Choi,et al.  Optimal State Estimation in the Transesterification Stage of a Continuous Polyethylene Terephthalate Condensation Polymerization Process. , 1988 .

[3]  Zhenbang Gong,et al.  An Attitude Determination System For A Small Unmanned Helicopter Using Low-Cost Sensors , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[4]  S. Shankar Sastry,et al.  Pursuit-evasion strategies for teams of multiple agents with incomplete information , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  Ian Postlethwaite,et al.  A robust fault-tolerant tracking scheme , 2008 .

[6]  Flavio de Barros Vidal,et al.  Window-Matching Techniques with Kalman Filtering for an Improved Object Visual Tracking , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[7]  Ling Shi,et al.  Probabilistic performance of state estimation across a lossy network , 2008, Autom..

[8]  Guillermo Heredia,et al.  Sensor and actuator fault detection in small autonomous helicopters , 2008 .

[9]  Petko H. Petkov,et al.  Robust control design with MATLAB , 2005 .

[10]  Jitendra R. Raol,et al.  Modelling and Parameter Estimation of Dynamic Systems , 1992 .

[11]  Sajjad Fekri,et al.  Improvement on state estimation for discrete-time LTI systems with measurement loss , 2010 .

[12]  S. K. Yang,et al.  An experiment of state estimation for predictive maintenance using Kalman filter on a DC motor , 2002, Reliab. Eng. Syst. Saf..

[13]  Lihua Xie,et al.  Peak covariance stability of Kalman filter with bounded Markovian packet losses , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[14]  Lihua Xie,et al.  Peak Covariance Stability of a Random Riccati Equation Arising from Kalman Filtering with Observation Losses , 2007, J. Syst. Sci. Complex..

[15]  Nasser E. Nahi,et al.  Optimal recursive estimation with uncertain observation , 1969, IEEE Trans. Inf. Theory.

[16]  Thomas W. Parsons,et al.  Voice and Speech Processing , 1986 .

[17]  Yan-Wu Wang,et al.  Stability and synchronization of complex dynamical networks with random packet losses , 2010, 2010 IEEE International Symposium on Intelligent Control.

[18]  John Valasek,et al.  Observer/Kalman Filter Identification for on-line system identification of aircraft , 1999 .

[19]  F. Blaabjerg,et al.  Control and testing of a dynamic voltage restorer (DVR) at medium voltage level , 2003, IEEE Transactions on Power Electronics.

[20]  Andrea Censi,et al.  On the performance of Kalman filtering with intermittent observations: A geometric approach with fractals , 2009, 2009 American Control Conference.

[21]  W. Stadlin,et al.  Transformer Tap Position Estimation , 1983, IEEE Power Engineering Review.

[22]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[23]  Ian Postlethwaite,et al.  Fault-tolerant Cooperative Target Tracking in Distributed UAV Networks , 2008 .

[24]  Zhi-Quan Luo,et al.  Finite-horizon robust Kalman filter design , 2001, IEEE Trans. Signal Process..

[25]  Robert B. McGhee,et al.  An improved quaternion-based Kalman filter for real-time tracking of rigid body orientation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[26]  Guillermo A. Francia Embedded systems programming , 2001 .

[27]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[28]  V. Walton,et al.  Detecting Instrument Malfunctions in Control Systems , 1975, IEEE Transactions on Aerospace and Electronic Systems.

[29]  P. A. Blight The Analysis of Time Series: An Introduction , 1991 .

[30]  J. Junkins,et al.  Analytical Mechanics of Space Systems , 2003 .

[31]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[32]  G. Heredia,et al.  Sensor fault detection in small autonomous helicopters using observer/Kalman filter identification , 2009, 2009 IEEE International Conference on Mechatronics.

[33]  Peter S. Maybeck,et al.  Multiple-model adaptive estimation using a residual correlation Kalman filter bank , 2000, IEEE Trans. Aerosp. Electron. Syst..

[34]  A. Goldsmith,et al.  Kalman filtering with partial observation losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[35]  John L.P. Thompson,et al.  Missing data , 2004, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[36]  Minyi Huang,et al.  Kalman Filtering with Markovian Packet Losses and Stability Criteria , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[37]  Rudi van Drunen,et al.  Localization of Random Pulse Point Sources Using Physically Implementable Search Algorithms , 2020, Optoelectronics, Instrumentation and Data Processing.

[38]  R. Murray,et al.  Estimation with Information Loss: Asymptotic Analysis and Error Bounds , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[39]  L. Teng Theory and application of Kalman filtering , 1970 .

[40]  Wei Xue,et al.  APPLICATION OF A BANK OF KALMAN FILTERS AND A ROBUST KALMAN FILTER FOR AIRCRAFT ENGINE SENSOR / ACTUATOR FAULT DIAGNOSIS , 2008 .

[41]  Frank Allgöwer,et al.  Robustification and optimization of a Kalman filter with measurement loss using linear precoding , 2009, 2009 American Control Conference.

[42]  A. Girgis,et al.  A digital recursive measurement scheme for online tracking of power system harmonics , 1991 .

[43]  P. Peebles Probability, Random Variables and Random Signal Principles , 1993 .

[44]  Soummya Kar,et al.  Kalman Filtering With Intermittent Observations: Weak Convergence to a Stationary Distribution , 2009, IEEE Transactions on Automatic Control.

[45]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[46]  Koichi Mizukami,et al.  State-estimation in a pursuit-evasion-game with incomplete information-exchange , 1980 .

[47]  Huazhen Fang,et al.  Kalman filter‐based adaptive control for networked systems with unknown parameters and randomly missing outputs , 2009 .

[48]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems: theory and application , 1989 .

[49]  Huazhen Fang,et al.  Kalman filter-based identification for systems with randomly missing measurements in a network environment , 2010, Int. J. Control.

[50]  Huazhen Fang,et al.  Parameter estimation with missing input/output data , 2009, 2009 American Control Conference.

[51]  Wai C. Chu,et al.  Speech Coding Algorithms: Foundation and Evolution of Standardized Coders , 2003 .

[52]  Eve A. Riskin,et al.  Signals, Systems, and Transforms , 1994 .

[53]  Robert B. McGhee,et al.  Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking , 2005, IEEE Transactions on Robotics.

[54]  F. Pirmoradi,et al.  Fault detection and diagnosis in a spacecraft attitude determination system , 2009 .

[55]  Luca Schenato,et al.  Optimal Estimation in Networked Control Systems Subject to Random Delay and Packet Drop , 2008, IEEE Transactions on Automatic Control.

[56]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[57]  P. P. Kanjilal,et al.  Adaptive Prediction and Predictive Control , 1995 .

[58]  Feng Ding,et al.  Parameter estimation algorithms for missing-data systems , 2009, 2009 American Control Conference.

[59]  Ian Postlethwaite,et al.  A case study on spacecraft attitude control , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[60]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Graham C. Goodwin,et al.  A moving horizon approach to Networked Control system design , 2004, IEEE Transactions on Automatic Control.

[62]  R. Clark A Simplified Instrument Failure Detection Scheme , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[63]  Thomas Quatieri,et al.  Discrete-Time Speech Signal Processing: Principles and Practice , 2001 .

[64]  Bin Jiang,et al.  Fault estimation and accommodation for linear MIMO discrete-time systems , 2005, IEEE Transactions on Control Systems Technology.

[65]  Wu Chen,et al.  Adaptive Kalman Filtering for Vehicle Navigation , 2003 .

[66]  D. Powell,et al.  Land-vehicle navigation using GPS , 1999, Proc. IEEE.

[67]  Peter Seiler,et al.  Estimation with lossy measurements: jump estimators for jump systems , 2003, IEEE Trans. Autom. Control..

[68]  Donald L. Simon,et al.  Evaluation of an Enhanced Bank of Kalman Filters for In-Flight Aircraft Engine Sensor Fault Diagnostics , 2005 .

[69]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[70]  Paul Zarchan,et al.  Fundamentals of Kalman Filtering: A Practical Approach , 2001 .

[71]  B. Azimi-Sadjadi,et al.  Stability of networked control systems in the presence of packet losses , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[72]  D.-W. Gu,et al.  State estimation in the case of loss of observations , 2009, 2009 ICCAS-SICE.

[73]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[74]  Huazhen Fang,et al.  Genetic adaptive state estimation with missing input/output data , 2010 .

[75]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[76]  Subhrakanti Dey,et al.  Stability of Kalman filtering with Markovian packet losses , 2007, Autom..

[77]  Mike P. Stewart,et al.  Land Vehicle Navigation in the Urban Canyon - A Kalman Filter Solution usingIntegrated GPS, GLONASS and Dead Reckoning , 1999 .

[78]  Elbert Hendricks,et al.  Linear Systems Control: Deterministic and Stochastic Methods , 2008 .

[79]  Louis L. Whitcomb,et al.  Underwater robotics: out of the research laboratory and into the field , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[80]  L. Schenato Kalman Filtering for networked control systems with random delay and packet loss , 2005 .

[81]  Son-Goo Kim,et al.  Kalman filtering for relative spacecraft attitude and position estimation , 2005 .

[82]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[83]  Venkat Venkatasubramanian,et al.  A Heuristic Extended Kalman Filter Based Estimator for Fault Identification in a Fluid Catalytic Cracking Unit , 2003 .

[84]  Zhijiang Du,et al.  Camera calibration based on Extended Kalman Filter using robot's arm motion , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[85]  Fuwen Yang,et al.  Robust Kalman filtering for discrete time-varying uncertain systems with multiplicative noises , 2002, IEEE Trans. Autom. Control..

[86]  Da-W Gu,et al.  Robust Control Design with MATLAB® (Advanced Textbooks in Control and Signal Processing) , 2005 .

[87]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[88]  Patrick Pérez,et al.  Robust tracking with motion estimation and local Kernel-based color modeling , 2007, Image Vis. Comput..

[89]  Paul M. Frank Advanced Fault Detection and Isolation Schemes Using Nonlinear and Robust Observers , 1987 .

[90]  Yuanxin Wu,et al.  On 'A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation' , 2013, ArXiv.

[91]  Jean-Jacques E. Slotine,et al.  Hamiltonian adaptive control of spacecraft , 1990 .

[92]  Youmin Zhang,et al.  Design of integrated fault detection, diagnosis and reconfigurable control systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[93]  P. Abbeel,et al.  Kalman filtering , 2020, IEEE Control Systems Magazine.

[94]  Antonio M. Pascoal,et al.  Robust multiple model adaptive control (RMMAC): a case study , 2007 .

[95]  P. P. Vaidyanathan,et al.  The Theory of Linear Prediction , 2008, Synthesis Lectures on Signal Processing.

[96]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[97]  M. Micheli Random Sampling of a Continuous-time Stochastic Dynamical System: Analysis, State Estimation, and Applications , 2001 .

[98]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[99]  Ruokang Li,et al.  Fault detection and diagnosis in a closed-loop nonlinear distillation process: application of extended Kalman filters , 1991 .

[100]  Peng Shi,et al.  Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters , 1999, IEEE Trans. Autom. Control..

[101]  P. D. Roberts,et al.  Linear Control System Analysis and Design , 1982 .

[102]  J. Davenport Editor , 1960 .

[103]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[104]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[105]  E. J. Lefferts,et al.  Kalman Filtering for Spacecraft Attitude Estimation , 1982 .

[106]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[107]  Seymour Geisser,et al.  Process control and optimization , 1993 .

[108]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[109]  Silvio Simani,et al.  Model-based fault diagnosis in dynamic systems using identification techniques , 2003 .

[110]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[111]  Da-Wei Gu,et al.  Properties of a robust Kalman filter , 2009, ICONS.

[112]  Ge Guo,et al.  Kalman filtering with partial Markovian packet losses , 2009, Int. J. Autom. Comput..