Robust techniques for signal processing: A survey

In recent years there has been much interest in robustness issues in general and in robust signal processing schemes in particular. Robust schemes are useful in situations where imprecise a priori knowledge of input characteristics makes the sensitivity of performance to deviations from assumed conditions an important factor in the design of good signal processing schemes. In this survey we discuss the minimax approach for the design of robust methods for signal processing. This has proven to be a very useful approach because it leads to constructive procedures for designing robust schemes. Our emphasis is on the contributions which have been made in robust signal processing, although key results of other robust statistical procedures are also considered. Most of the results we survey have been obtained in the past fifteen years, although some interesting earlier ideas for minimax signal processing are also mentioned. This survey is organized into five main parts, which deal separately with robust linear filters for signal estimation, robust linear filters for signal detection and related applications, nonlinear methods for robust signal detection, nonlinear methods for robust estimation, and robust data quantization. The interrelationships among many of these results are also discussed in the survey.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  Gebräuchliche Fertigarzneimittel,et al.  V , 1893, Therapielexikon Neurologie.

[3]  G. Box.  NON-NORMALITY AND TESTS ON VARIANCES , 1953 .

[4]  J. L. Jackson,et al.  LINEAR FILTER OPTIMIZATION WITH GAME THEORY CONSIDERATIONS , 1955 .

[5]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[6]  Jack Capon,et al.  On the asmptotic efficiency of locally optimum detectors , 1961, IRE Trans. Inf. Theory.

[7]  William L. Root,et al.  Communications through Unspecified Additive Noise , 1961, Inf. Control..

[8]  Lars-Henning Zetterberg.  Signal detection under noise interference in a game situation , 1962, IRE Trans. Inf. Theory.

[9]  W. Root.  Stability in signal detection problems. , 1964 .

[10]  P. J. Huber.  A Robust Version of the Probability Ratio Test , 1965 .

[11]  S. M. Ali,et al.  A General Class of Coefficients of Divergence of One Distribution from Another , 1966 .

[12]  Morton Kanefsky.  Detection of weak signals with polarity coincidence arrays , 1966, IEEE Trans. Inf. Theory.

[13]  J. Gastwirth,et al.  Robust Two‐Input Correlators , 1966 .

[14]  Laurence B. Milstein,et al.  Robust detection using extreme-value theory , 1969, IEEE Trans. Inf. Theory.

[15]  Gerard V. Trunk.  Small and Large-Sample Behavior of Two Detectors Against Envelope-Detected , 1970, IEEE Trans. Inf. Theory.

[16]  S. F. George,et al.  Detection of Targets in Non-Gaussian Sea Clutter , 1970, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Stuart C. Schwartz,et al.  Robust detection of a known signal in nearly Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[18]  F. Hampel.  A General Qualitative Definition of Robustness , 1971 .

[19]  Kung Yao.  An alternative approach to the linear causal least-square filtering theory , 1971, IEEE Trans. Inf. Theory.

[20]  Thomas Kailath,et al.  RKHS approach to detection and estimation problems-I: Deterministic signals in Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[21]  C. Cahn.  Performance of Digital Matched Filter Correlator With Unknown Interference , 1971 .

[22]  P. J. Huber.  The 1972 Wald Lecture Robust Statistics: A Review , 1972 .

[23]  V. VandeLinde,et al.  Robust filtering for linear systems , 1972, CDC 1972.

[24]  R. Douglas Martin,et al.  Robust estimation of signal amplitude , 1972, IEEE Trans. Inf. Theory.

[25]  J. Snyders.  Error Formulae for Optimal Linear Filtering, Prediction and Interpolation of Stationary Time Series , 1972 .

[26]  S. Schwartz,et al.  On Mixture, Quasi-mixture and Nearly Normal Random Processes , 1972 .

[27]  Jakov Snyders,et al.  Error expressions for optimal linear filtering of stationary processes , 1972, IEEE Trans. Inf. Theory.

[28]  Ludwik Kurz,et al.  Nonparametric detectors based on m-interval partitioning , 1972, IEEE Trans. Inf. Theory.

[29]  John B. Thomas,et al.  Detectors for discrete-time signals in non-Gaussian noise , 1972, IEEE Trans. Inf. Theory.

[30]  J. D'appolito,et al.  A minimax approach to the design of low sensitivity state estimators , 1972 .

[31]  L. Breiman.  A Note on Minimax Filtering , 1973 .

[32]  F. Hampel.  Robust estimation: A condensed partial survey , 1973 .

[33]  P. J. Huber,et al.  Minimax Tests and the Neyman-Pearson Lemma for Capacities , 1973 .

[34]  Synthesis of linear detectors when the signal is inexactly given and the properties of the normal noise are incompletely known , 1974 .

[35]  R. Hogg.  Adaptive Robust Procedures: A Partial Review and Some Suggestions for Future Applications and Theory , 1974 .

[36]  J. Morris,et al.  Robust Quantization of Discrete-Time Signals with Independent Samples , 1974, IEEE Trans. Commun..

[37]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[38]  Allen Gersho,et al.  A training mode adaptive quantizer , 1974, IEEE Trans. Inf. Theory.

[39]  R. Douglas Martin,et al.  Robust detection to stochastic signals (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[40]  Allen Gersho,et al.  Theory of an Adaptive Quantizer , 1973, IEEE Trans. Commun..

[41]  N. M. Khalfina,et al.  On a Robust Version of the Likelihood Ratio Test , 1975 .

[42]  R. Douglas Martin,et al.  Robust estimation via stochastic approximation , 1975, IEEE Trans. Inf. Theory.

[43]  G. Turin.  Minimax Strategies for Matched-Filter Detection , 1975, IEEE Trans. Commun..

[44]  J. J. Wolcin.  Robust sequential probability ratio detectors , 1975 .

[45]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[46]  John B. Thomas,et al.  Dead‐zone limiter: An application of conditional tests in nonparametric detection , 1976 .

[47]  J. Miller,et al.  The Detection of Signals in Impulsive Noise Modeled as a Mixture Process , 1976, IEEE Trans. Commun..

[48]  Ludwik Kurz,et al.  Robustized vector Robbins-Monro algorithm with applications to m-interval detection , 1976, Inf. Sci..

[49]  J. Collins.  Robust Estimation of a Location Parameter in the Presence of Asymmetry , 1976 .

[50]  Synthesis of stable, small signal detectors , 1976 .

[51]  Saleem A. Kassam,et al.  Asymptotically robust detection of a known signal in contaminated non-Gaussian noise , 1976, IEEE Trans. Inf. Theory.

[52]  D. Slepian,et al.  On bandwidth , 1976, Proceedings of the IEEE.

[53]  Joel M. Morris,et al.  The Kalman filter: A robust estimator for some classes of linear quadratic problems , 1976, IEEE Trans. Inf. Theory.

[54]  S. Portnoy.  Robust Estimation in Dependent Situations , 1977 .

[55]  V. VandeLinde.  Robust properties of solutions to linear-quadratic estimation and control problems , 1977 .

[56]  Ludwik Kurz,et al.  Bivariate m-Interval Classifiers with Application to Edge Detection , 1977, Inf. Control..

[57]  Saleem A. Kassam,et al.  Robust Wiener filters , 1977 .

[58]  J. Miller,et al.  Robust Detectors for Signals in Non-Gaussian Noise , 1977, IEEE Trans. Commun..

[59]  H. Rieder.  Least Favorable Pairs for Special Capacities , 1977 .

[60]  J. Modestino.  Adaptive Detection of Signals in Impulsive Noise Environments , 1977, IEEE Trans. Commun..

[61]  V. David VandeLinde,et al.  Robust detection of known signals , 1977, IEEE Trans. Inf. Theory.

[62]  R. Sh. Aleiner.  Synthesis of stable linear detectors for an inaccurately known signal , 1977 .

[63]  R. Martin,et al.  Robust bayesian estimation for the linear model and robustifying the Kalman filter , 1977 .

[64]  J. Thomas,et al.  Locally optimum detection of discrete‐time stochastic signals in non‐Gaussian noise , 1978 .

[65]  Yuzo Hosoya.  Robust Linear Extrapolations of Second-order Stationary Processes , 1978 .

[66]  H. Vincent Poor,et al.  Asymptotically robust quantization for detection , 1978, IEEE Trans. Inf. Theory.

[67]  Saleem A. Kassam,et al.  Locally robust array detectors for random signals , 1978, IEEE Trans. Inf. Theory.

[68]  Allen Gersho,et al.  Principles of quantization , 1978 .

[69]  Nasser E. Nahi,et al.  Bounding Filter: A Simple Solution to Lack of Exact a Priori Statistics , 1978, Inf. Control..

[70]  R. Hogg.  Statistical Robustness: One View of its use in Applications Today , 1979 .

[71]  V. David VandeLinde,et al.  Robust Techniques in Communication , 1979 .

[72]  V. David VandeLinde,et al.  Robust estimation using the Robbins-Monro stochastic approximation algorithm , 1979, IEEE Trans. Inf. Theory.

[73]  S. Portnoy.  Further Remarks on Robust Estimation in Dependent Situations , 1979 .

[74]  Roger F. Dwyer,et al.  Robust sequential detection of narrowband acoustic signals in noise , 1979, ICASSP.

[75]  V. VandeLinde,et al.  Robust quantizers designed using the companding approximation , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[76]  M. Burnashev.  On the Minimax Detection of an Inaccurately Known Signal in a White Gaussian Noise Background , 1979 .

[77]  James W. Modestino,et al.  Detection of weak signals in narrowband non-Gaussian noise , 1979, IEEE Trans. Inf. Theory.

[78]  V. David VandeLinde,et al.  Robust sequential detection of signals in noise , 1979, IEEE Trans. Inf. Theory.

[79]  D. Thomson,et al.  Robust Estimation of Power Spectra , 1979 .

[80]  Yakov Z. Tsypkin,et al.  Robust identification , 1980, Autom..

[81]  H. Poor.  On robust wiener filtering , 1980 .

[82]  S. Kassam,et al.  Two-Dimensional Filters for Signal Processing under Modeling Uncertainties , 1980, IEEE Transactions on Geoscience and Remote Sensing.

[83]  R. Dwyer.  Robust sequential detection of weak signals in undefined noise using acoustical arrays , 1980 .

[84]  H. Vincent Poor,et al.  Robust decision design using a distance criterion , 1980, IEEE Trans. Inf. Theory.

[85]  H. Poor,et al.  Minimax state estimation for linear stochastic systems with noise uncertainty , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[86]  J. Morris,et al.  On single-sample robust detection of known signals with additive unknown-mean amplitude-bounded random interference , 1980, IEEE Trans. Inf. Theory.

[87]  Saleem A. Kassam,et al.  A bibliography on nonparametric detection , 1980, IEEE Trans. Inf. Theory.

[88]  John B. Thomas,et al.  On robust detection of discrete-time stochastic signals☆ , 1980 .

[89]  G. Moustakides,et al.  Robust Wiener Filters for Correlated Signals and Noise. , 1980 .

[90]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[91]  S. Kassam,et al.  Robust and Quantized Wiener Filters for p-Point Spectral Classes. , 1980 .

[92]  Saleem A. Kassam,et al.  Robust hypothesis testing for bounded classes of probability densities , 1981, IEEE Trans. Inf. Theory.

[93]  T. Bednarski.  On solutions of minimax test problems for special capacities , 1981 .

[94]  Joel M. Morris.  On single-sample robust detection of known signals with additive unknown-mean amplitude-bounded random interference - II: The randomized decision rule solution , 1981, IEEE Trans. Inf. Theory.

[95]  Leonard J. Cimini,et al.  Optimum piecewise-constant Wiener filters , 1981 .

[96]  A. Papoulis.  Maximum entropy and spectral estimation: A review , 1981 .

[97]  Masanobu Taniguchi.  ROBUST REGRESSION AND INTERPOLATION FOR TIME SERIES , 1981 .

[98]  S.M. Kay,et al.  Digital signal processing for sonar , 1981, Proceedings of the IEEE.

[99]  V. David VandeLinde,et al.  Robust memoryless quantization for minimum signal distortion , 1982, IEEE Trans. Inf. Theory.

[100]  D. Looze,et al.  Noncausal minimax linear state estimation for systems with uncertain second order statistics , 1982, CDC 1982.

[101]  Christopher Martin,et al.  Robust filtering and prediction for linear systems with uncertain dynamics: A game-theoretic approach , 1983, 1982 21st IEEE Conference on Decision and Control.

[102]  Demetrios Kazakos.  Signal detection under mismatch , 1982, IEEE Trans. Inf. Theory.

[103]  H. Vincent Poor,et al.  Signal detection in the presence of weakly dependent noise--II: Robust detection , 1982, IEEE Trans. Inf. Theory.

[104]  D. Thomson,et al.  Robust-resistant spectrum estimation , 1982, Proceedings of the IEEE.

[105]  H. Poor.  Some results on robust data quantization , 1982, 1982 21st IEEE Conference on Decision and Control.

[106]  S. Kassam.  The Bounded p-Point Classes in Robust Hypothesis Testing and Filtering. , 1982 .

[107]  H. Poor.  Minimax Linear Smoothing for Capacities , 1982 .

[108]  R. Martin.  Robust estimation of signal parameters with dependent data , 1982, 1982 21st IEEE Conference on Decision and Control.

[109]  George V. Moustakides,et al.  Robust detection of known signals in asymmetric noise , 1982, IEEE Trans. Inf. Theory.

[110]  R. Dwyer.  A technique for improving detection and estimation of signals contaminated by under ice noise , 1982 .

[111]  Joel M. Morris.  Performance of a suboptimal multisample decision rule against known signals with additive unknown-mean amplitude-bounded random interference , 1982, 1982 21st IEEE Conference on Decision and Control.

[112]  S. Kassam.  Robust Hypothesis Testing and Robust Time Series Interpolation And Regression , 1982 .

[113]  H. Vincent Poor.  The rate-distortion function on classes of sources determined by spectral capacities , 1982, IEEE Trans. Inf. Theory.

[114]  James A. Bucklew,et al.  Multidimensional asymptotic quantization theory with r th power distortion measures , 1982, IEEE Trans. Inf. Theory.

[115]  R. Evans,et al.  Robust signal and array processing , 1982 .

[116]  S. Kassam,et al.  Robust detector for narrow‐band signals in non‐Gaussian noise , 1983 .

[117]  H. Poor.  A companding approximation for the statistical divergence of quantized data , 1983, The 22nd IEEE Conference on Decision and Control.

[118]  H. Vincent Poor,et al.  An analysis of the effects of spectral uncertainty on wiener filtering , 1983, Autom..

[119]  B. Dickinson,et al.  An approach to robust Kalman filtering , 1983, The 22nd IEEE Conference on Decision and Control.

[120]  Stuart C. Schwartz,et al.  Maximin sonar system design for detection , 1983, ICASSP.

[121]  Ludwik Kurz,et al.  An adaptive robustizing approach to kalman filtering , 1983, Autom..

[122]  D. Kazakos,et al.  New Results on Robust Quantization , 1983, IEEE Trans. Commun..

[123]  S. Kassam,et al.  Robust signal processing for communication systems , 1983, IEEE Communications Magazine.

[124]  George V. Moustakides,et al.  Robust Wiener filters for random signals in correlated noise , 1983, IEEE Trans. Inf. Theory.

[125]  Sergio Verdu,et al.  Signal Selection for Robust Matched Filtering , 1983, IEEE Trans. Commun..

[126]  H. Vincent Poor,et al.  Robust matched filters , 1983, IEEE Trans. Inf. Theory.

[127]  Sergio Verdu,et al.  Minimax Robust Discrete-Time Matched Filters , 1983, IEEE Trans. Commun..

[128]  E. Geraniotis.  Performance bounds for robust decision problems with uncertain statistics , 1983, The 22nd IEEE Conference on Decision and Control.

[129]  Thomas S. Huang,et al.  A generalization of median filtering using linear combinations of order statistics , 1983 .

[130]  Cheng-Tie Chen,et al.  Robust Wiener filtering for multiple inputs with channel distortion , 1984, IEEE Trans. Inf. Theory.

[131]  S. Kassam,et al.  Nonlinear Edge Preserving Filtering Techniques for Image Enhancement. , 1984 .

[132]  George V. Moustakides,et al.  Min-max detection of weak signals in phi-mixing noise , 1984, IEEE Trans. Inf. Theory.

[133]  H. Vincent Poor,et al.  On Optimum and Nearly Optimum Data Quantization for Signal Detection , 1984, IEEE Trans. Commun..

[134]  Thomas L. Marzetta,et al.  Power spectral density bounds , 1984, IEEE Trans. Inf. Theory.

[135]  S. Verdú,et al.  Minimax linear observers and regulators for stochastic systems with uncertain second-order statistics , 1984 .

[136]  S. Kassam,et al.  Robust eckart filters for time delay estimation , 1984 .

[137]  S. Kassam,et al.  Applications of Nonlinear Adaptive Filters for Image Enhancement , 1984 .

[138]  H. Vincent Poor,et al.  On the p-point uncertainty class , 1984, IEEE Trans. Inf. Theory.

[139]  H. Vincent Poor,et al.  On minimax robustness: A general approach and applications , 1984, IEEE Trans. Inf. Theory.

[140]  H. Poor.  Quantization effects in filtering of stationary Gaussian processes , 1984, The 23rd IEEE Conference on Decision and Control.

[141]  S. Kassam.  Nonparametric detection of narrowband signals , 1984 .

[142]  W. Härdle,et al.  Robust and Nonlinear Time Series Analysis , 1984 .

[143]  K. Vastola,et al.  Robust Wiener-Kolmogorov theory , 1984, IEEE Trans. Inf. Theory.

[144]  W. Root,et al.  Stability in detection of signals in noise , 1984, The 23rd IEEE Conference on Decision and Control.

[145]  Cheng-Tie Chen,et al.  Robust multiple-input matched filtering: Frequency and time-domain results , 1985, IEEE Trans. Inf. Theory.

[146]  H. Vincent Poor,et al.  Robust Quantization of ε-Contaminated Data , 1985, IEEE Trans. Commun..

[147]  George V. Moustakides,et al.  Minimax Equalization for Random Signals , 1985, IEEE Trans. Commun..

[148]  J. Franke.  Minimax-robust prediction of discrete time series , 1985 .

[149]  H. Vincent Poor,et al.  Minimax discrimination for observed Poisson processes with uncertain rate functions , 1985, IEEE Trans. Inf. Theory.

[150]  P. Papantoni-Kazakos,et al.  Robust linear filtering for multivariable stationary time series , 1986 .