A Robust Spectral Estimator With Application to a Noise-Corrupted Process

When a dataset is corrupted by noise, the model for data generating process is misspecified and can cause parameter-estimation problems. For example, in the case of a Gaussian autoregressive (AR) process corrupted by noise, data are more accurately modeled as an AR–moving-average process rather than an AR process. This misspecification leads to bias, and hence, low resolution in AR spectral estimation. However, a new parametric spectral estimator, the realizable information-theoretic estimator (RITE) based on a nonhomogeneous Poisson spectral representation, is shown by simulation to be more robust to white noise than the asymptotic maximum likelihood estimator (MLE). We, therefore, conducted an in-depth investigation and analyzed the statistics of RITE and the asymptotic MLE for the misspecified model. For large data records, both RITE and the asymptotic MLE are asymptotically normally distributed. The asymptotic MLE has a slightly lower variance, but RITE exhibits much less bias. Simulation examples of a white-noise-corrupted AR process are provided to support the theoretical properties. This advantage of RITE increases as the signal-to-noise-ratio decreases.

[1]  Fulvio Gini,et al.  Performance Bounds for Parameter Estimation under Misspecified Models: Fundamental Findings and Applications , 2017, IEEE Signal Processing Magazine.

[2]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[3]  G. R. Stegen,et al.  Experiments with maximum entropy power spectra of sinusoids , 1974 .

[4]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[5]  D. G. Watts,et al.  Spectral analysis and its applications , 1968 .

[6]  R. Lacoss DATA ADAPTIVE SPECTRAL ANALYSIS METHODS , 1971 .

[7]  J. Makhoul,et al.  On the statistics of the estimated reflection coefficients of an autoregressive process , 1983 .

[8]  L. Marple Resolution of conventional Fourier, autoregressive, and special ARMA methods of spectrum analysis , 1977 .

[9]  Mircea Grigoriu,et al.  A spectral representation based model for Monte Carlo simulation , 2000 .

[10]  L. Stefanski,et al.  The Calculus of M-Estimation , 2002 .

[11]  H. Cramér Mathematical Methods of Statistics (PMS-9), Volume 9 , 1946 .

[12]  H. White Maximum Likelihood Estimation of Misspecified Models , 1982 .

[13]  J. Cadzow,et al.  High performance spectral estimation--A new ARMA method , 1980 .

[14]  Steven Kay,et al.  Poisson Maximum Likelihood Spectral Inference , 2017 .

[15]  Steven Kay,et al.  Representation and Generation of Non-Gaussian Wide-Sense Stationary Random Processes With Arbitrary PSDs and a Class of PDFs , 2010, IEEE Transactions on Signal Processing.

[16]  Steven Kay,et al.  Modern Spectral Estimation: Theory and Application , 1988 .

[17]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .