A mixture-of-experts framework for adaptive Kalman filtering

This paper proposes a modular and flexible approach to adaptive Kalman filtering using the framework of a mixture-of-experts regulated by a gating network. Each expert is a Kalman filter modeled with a different realization of the unknown system parameters such as process and measurement noise. The gating network performs on-line adaptation of the weights given to individual filter estimates based on performance. This scheme compares very favorably with the classical Magill filter bank, which is based on a Bayesian technique, in terms of: estimation accuracy; quicker response to changing environments; and numerical stability and computational demands. The proposed filter bank is further enhanced by periodically using a search algorithm in a feedback loop. Two search algorithms are considered. The first algorithm uses a recursive quadratic programming approach which extremizes a modified maximum likelihood function to update the parameters of the best performing filter in the bank. This particular approach to parameter adaptation allows a real-time implementation. The second algorithm uses a genetic algorithm to search for the parameter vector and is suited for post-processed data type applications. The workings and power of the overall filter bank and the suggested adaptation schemes are illustrated by a number of examples.

[1]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[2]  Y. Bar-Shalom,et al.  A recursive multiple model approach to noise identification , 1994 .

[3]  Y. Bar-Shalom,et al.  An interacting multiple model approach for target tracking with glint noise , 1994, Proceedings of 1994 IEEE National Radar Conference.

[4]  Yaakov Bar-Shalom,et al.  Interacting multiple model tracking with target amplitude feature , 1993 .

[5]  Michael I. Jordan,et al.  Learning piecewise control strategies in a modular neural network architecture , 1993, IEEE Trans. Syst. Man Cybern..

[6]  X. R. Li,et al.  Performance Prediction of the Interacting Multiple Model Algorithm , 1992, 1992 American Control Conference.

[7]  Michael I. Jordan,et al.  Hierarchies of Adaptive Experts , 1991, NIPS.

[8]  Michael I. Jordan,et al.  A Competitive Modular Connectionist Architecture , 1990, NIPS.

[9]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[10]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[11]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  R. Brown,et al.  Adaptive Kalman Filtering in Computer Relaying: Fault Classification Using Voltage Models , 1985, IEEE Transactions on Power Apparatus and Systems.

[14]  H. P. Blom.  An efficient filter for abruptly changing systems , 1984, The 23rd IEEE Conference on Decision and Control.

[15]  R. Grover Brown,et al.  A Kalman Filter Approach to Precision GPS Geodesy , 1983 .

[16]  R. Brown,et al.  A new look at the Magill adaptive filter as a practical means of multiple hypothesis testing , 1983 .

[17]  Wang Tang,et al.  Application of multiple model estimation to a recursive terrain height correlation system , 1983 .

[18]  M. J. Hicks,et al.  Recursive adaptive filter design using an adaptive genetic algorithm , 1982, ICASSP.

[19]  R. Stewart.  Satellite altimetric measurements of the ocean. Report of the TOPEX Science Working Group , 1981 .

[20]  E. Walsh,et al.  Satellite radar altimeters - Present and future oceanographic capabilities , 1981 .

[21]  R. H. Stewart,et al.  Ocean Wave Measurement Techniques , 1980 .

[22]  B. Tapley,et al.  A sequential method for filtering satellite altimeter measurements , 1979 .

[23]  Jitendra K. Tugnait,et al.  Comments on "State Estimation for Discrete Systems with Switching Parameters , 1979 .

[24]  M. Athans,et al.  State Estimation for Discrete Systems with Switching Parameters , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[25]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[26]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[27]  B. Tapley,et al.  Adaptive sequential estimation with unknown noise statistics , 1976 .

[28]  Michael Athans,et al.  A suboptimal estimation algorithm with probabilistic editing for false measurements with applications to target tracking with wake phenomena , 1977 .

[29]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[30]  R. Mehra.  On-line identification of linear dynamic systems with applications to Kalman filtering , 1971 .

[31]  R. K. Mehra,et al.  Identification of stochastic linear dynamic systems using Kalman filter representation , 1971 .

[32]  Raman K. Mehra,et al.  Approaches to adaptive filtering , 1970 .

[33]  R. Mehra.  On the identification of variances and adaptive Kalman filtering , 1970 .

[34]  R. Kashyap.  Maximum likelihood identification of stochastic linear systems , 1970 .

[35]  D. Lainiotis,et al.  Recursive algorithm for the calculation of the adaptive Kalman filter weighting coefficients , 1969 .

[36]  Andrew P. Sage,et al.  Adaptive filtering with unknown prior statistics , 1969 .

[37]  C. Hilborn,et al.  Optimal Estimation in the Presence of Unknown Parameters , 1969, IEEE Trans. Syst. Sci. Cybern..

[38]  C. Price.  An analysis of the divergence problem in the Kalman filter , 1968 .

[39]  N. F. Toda,et al.  Divergence in the Kalman Filter , 1966 .

[40]  J. C. Shellenbarger,et al.  Estimation of covariance parameters for an adaptive Kalman filter , 1966 .

[41]  D. Magill.  Optimal adaptive estimation of sampled stochastic processes , 1965 .

[42]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[43]  R. Kalman,et al.  New results in linear prediction and filtering theory Trans. AMSE , 1961 .