Intrinsically Optimal Bayesian Robust Filtering

When designing optimal filters it is often unrealistic to assume that the statistical model is known perfectly. The issue is then to design a robust filter that is optimal relative to an uncertainty class of processes. Robust filter design has been treated from minimax (best worst-case performance) and Bayesian (best average performance) perspectives. Heretofore, the Bayesian approach has involved finding a model-specific optimal filter, one that is optimal for some model in the uncertainty class. Lifting this constraint, we optimize over the full class from which the original optimal filters were obtained, for instance, over all linear filters. By extending the original characteristics determining the filter, such as the power spectral density, to “effective characteristics” that apply across the uncertainty class, we demonstrate, for both linear and morphological filtering, that an “intrinsically optimal” Bayesian robust filter can be represented in the same form as the standard solution to the optimal filter, except via the effective characteristics. Solutions for intrinsic Bayesian robust filters are more transparent and intuitive than solutions for model-specific filters, and also less tedious, because effective characteristics push through the spectral theory into the Bayesian setting, whereas solutions in the model-specific case depend on grinding out the optimization.

[1]  S. Verdú,et al.  Minimax linear observers and regulators for stochastic systems with uncertain second-order statistics , 1984 .

[2]  Saleem A. Kassam,et al.  Robust Wiener filters , 1977 .

[3]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[4]  H. Poor,et al.  Minimax state estimation for linear stochastic systems with noise uncertainty , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[5]  H. Poor On robust wiener filtering , 1980 .

[6]  Edward R. Dougherty,et al.  Bayesian robust optimal linear filters , 2001, Signal Process..

[7]  Edward R. Dougherty,et al.  Random processes for image and signal processing , 1998, SPIE / IEEE series on imaging science and engineering.

[8]  Edward R. Dougherty,et al.  Design and Analysis of Robust Binary Filters in the Context of a Prior Distribution for the States of Nature , 2004, Journal of Mathematical Imaging and Vision.

[9]  S.A. Kassam,et al.  Robust techniques for signal processing: A survey , 1985, Proceedings of the IEEE.

[10]  Joseph G. Ibrahim,et al.  Prior elicitation for model selection and estimation in generalized linear mixed models , 2003 .

[11]  Wasserman,et al.  Bayesian Model Selection and Model Averaging. , 2000, Journal of mathematical psychology.

[12]  J. Berger,et al.  Optimal predictive model selection , 2004, math/0406464.

[13]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[14]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[15]  Adrian F. M. Smith,et al.  BOOK REVIEW: Bayesian Theory , 2001 .

[16]  M. Clyde,et al.  Model Uncertainty , 2003 .

[17]  Edward R. Dougherty,et al.  Robust optimal granulometric bandpass filters , 2001, Signal Process..

[18]  Edward R. Dougherty,et al.  Quantifying the Objective Cost of Uncertainty in Complex Dynamical Systems , 2013, IEEE Transactions on Signal Processing.

[19]  D. Madigan,et al.  Correction to: ``Bayesian model averaging: a tutorial'' [Statist. Sci. 14 (1999), no. 4, 382--417; MR 2001a:62033] , 2000 .

[20]  H. Vincent Poor,et al.  Robust matched filters , 1983, IEEE Trans. Inf. Theory.

[21]  Cheng-Tie Chen,et al.  Robust multiple-input matched filtering: Frequency and time-domain results , 1985, IEEE Trans. Inf. Theory.

[22]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[23]  H. Vincent Poor,et al.  On minimax robustness: A general approach and applications , 1984, IEEE Trans. Inf. Theory.

[24]  Wei Xing Zheng,et al.  Robust design of envelope-constrained filters in the presence of input uncertainty , 1996, IEEE Trans. Signal Process..

[25]  Edward R. Dougherty,et al.  Optimal and adaptive reconstructive granulometric bandpass filters , 1997, Signal Process..

[26]  V. S. Pugachev,et al.  Theory of Random Functions: And Its Application to Control Problems , 2013 .

[27]  A. P. Dawid,et al.  Bayesian Model Averaging and Model Search Strategies , 2007 .

[28]  Edward R. Dougherty,et al.  Optimal Binary Morphological Bandpass Filters Induced by Granulometric Spectral Representation , 1997, Journal of Mathematical Imaging and Vision.

[29]  Edward R. Dougherty,et al.  Optimal classifiers with minimum expected error within a Bayesian framework - Part II: Properties and performance analysis , 2013, Pattern Recognit..

[30]  Aniruddha Datta,et al.  Bayesian Robustness in the Control of Gene Regulatory Networks , 2007, IEEE Transactions on Signal Processing.

[31]  Artyom M. Grigoryan,et al.  Optimization of linear filters under power-spectral-density stabilization , 2001, IEEE Trans. Signal Process..

[32]  K. Vastola,et al.  Robust Wiener-Kolmogorov theory , 1984, IEEE Trans. Inf. Theory.

[33]  Keming Yu,et al.  Bayesian Mode Regression , 2012, 1208.0579.

[34]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[35]  Edward R. Dougherty,et al.  Optimal classifiers with minimum expected error within a Bayesian framework - Part I: Discrete and Gaussian models , 2013, Pattern Recognit..