Welch Method Revisited: Nonparametric Power Spectrum Estimation Via Circular Overlap

The objective of this paper is twofold. The first part provides further insight in the statistical properties of the Welch power spectrum estimator. A major drawback of the Welch method reported in the literature is that the variance is not a monotonic decreasing function of the fraction of overlap. Selecting the optimal fraction of overlap, which minimizes the variance, is in general difficult since it depends on the window used. We show that the explanation for the nonmonotonic behavior of the variance, as reported in the literature, does not hold. In the second part, this extra insight allows one to eliminate the nonmonotonic behavior of the variance for the Welch power spectrum estimator (PSE) by introducing a small modification to the Welch method. The main contributions of this paper are providing extra insight in the statistical properties of the Welch PSE; modifying the Welch PSE to circular overlap-the variance is a monotonically decreasing function of the fraction of overlap, making the method more user friendly; and an extra reduction of variance with respect to the Welch PSE without introducing systematic errors-this reduction in variance is significant for a small number of data records only.

[1]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[2]  Olli Aumala,et al.  On windowing effects in estimating averaged periodograms of noisy signals , 2000 .

[3]  Thomas P. Bronez,et al.  On the performance advantage of multitaper spectral analysis , 1992, IEEE Trans. Signal Process..

[4]  Rik Pintelon,et al.  System Identification: A Frequency Domain Approach , 2012 .

[5]  D. G. Watts,et al.  Spectral analysis and its applications , 1968 .

[6]  J. Burg.  THE RELATIONSHIP BETWEEN MAXIMUM ENTROPY SPECTRA AND MAXIMUM LIKELIHOOD SPECTRA , 1972 .

[7]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[8]  J. Schoukens,et al.  Frequency domain Errors-In-Variables estimation of linear dynamic systems using data from overlapping sub-records , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[9]  R. A. Silverman,et al.  Integral, Measure and Derivative: A Unified Approach , 1967 .

[10]  Gerd Vandersteen,et al.  Frequency-domain system identification using non-parametric noise models estimated from a small number of data sets , 1997, Autom..

[11]  Ralph P. Grimaldi,et al.  Discrete and Combinatorial Mathematics: An Applied Introduction , 1998 .

[12]  B. Hofmann-Wellenhof,et al.  Introduction to spectral analysis , 1986 .

[13]  David G. Long,et al.  The probability density of spectral estimates based on modified periodogram averages , 1999, IEEE Trans. Signal Process..

[14]  B. Picinbono.  Random Signals and Systems , 1993 .

[15]  Rik Pintelon,et al.  Frequency-Domain, Errors-in-Variables Estimation of Linear Dynamic Systems Using Data From Overlapping Subrecords , 2008, IEEE Transactions on Instrumentation and Measurement.

[16]  M. S. Babtlett.  Smoothing Periodograms from Time-Series with Continuous Spectra , 1948, Nature.

[17]  F. Harris.  On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[18]  Piet M. T. Broersen,et al.  Automatic Autocorrelation and Spectral Analysis , 2006 .

[19]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[20]  Boaz Porat,et al.  Digital Processing of Random Signals: Theory and Methods , 2008 .

[21]  Arthur Schuster,et al.  On the investigation of hidden periodicities with application to a supposed 26 day period of meteorological phenomena , 1898 .

[22]  David R. Brillinger,et al.  Time Series: Data Analysis and Theory. , 1982 .

[23]  Günter Rudolph,et al.  Stochastic Convergence , 2012, Handbook of Natural Computing.

[24]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[25]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[26]  John G. Proakis,et al.  Digital signal processing (3rd ed.): principles, algorithms, and applications , 1996 .

[27]  R. Mortensen.  Random Signals and Systems , 2019, Model-Based Processing.

[28]  Ralph P. Grimaldi,et al.  Discrete and combinatorial mathematics , 1985 .