Spectral Analysis of Signals

1. Basic Concepts. 2. Nonparametric Methods. 3. Parametric Methods for Rational Spectra. 4. Parametric Methods for Line Spectra. 5. Filter Bank Methods. 6. Spatial Methods. Appendix A: Linear Algebra and Matrix Analysis Tools. Appendix B: Cramer-Rao Bound Tools. Appendix C: Model Order Selection Tools. Appendix D: Answers to Selected Exercises. Bibliography. References Grouped by Subject. Subject Index.

[1]  Khaled H. Hamed,et al.  Time-frequency analysis , 2003 .

[2]  L. Scharf,et al.  Statistical Signal Processing: Detection, Estimation, and Time Series Analysis , 1991 .

[3]  Mats Viberg,et al.  Subspace-based methods for the identification of linear time-invariant systems , 1995, Autom..

[4]  Petre Stoica,et al.  An asymptotically efficient ARMA estimator based on sample covariances , 1986 .

[5]  T. Marzetta.  A new interpretation of Capon's maximum likelihood method of frequency-wavenumber spectral estimation , 1983 .

[6]  Jian Li,et al.  A new derivation of the APES filter , 1999, IEEE Signal Processing Letters.

[7]  Petar M. Djuric,et al.  Asymptotic MAP criteria for model selection , 1998, IEEE Trans. Signal Process..

[8]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[9]  J. Rissanen.  Estimation of structure by minimum description length , 1982 .

[10]  Jung Ah Choi Lee,et al.  Effectiveness of spatially-variant apodization , 1995, Proceedings., International Conference on Image Processing.

[11]  Zdenek Vostrý.  New algorithm for polynomial spectral factorization with quadratic convergence. II , 1975, Kybernetika.

[12]  Anthony L Bertapelle.  Spectral Analysis of Time Series. , 1979 .

[13]  David S. Slepian,et al.  Estimation of signal parameters in the presence of noise , 1954, Trans. IRE Prof. Group Inf. Theory.

[14]  Ilan Ziskind,et al.  Maximum likelihood localization of multiple sources by alternating projection , 1988, IEEE Trans. Acoust. Speech Signal Process..

[15]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[16]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[17]  J. Capon.  High-resolution frequency-wavenumber spectrum analysis , 1969 .

[18]  James Durbin,et al.  The fitting of time series models , 1960 .

[19]  Piet M. T. Broersen,et al.  Finite sample criteria for autoregressive order selection , 2000, IEEE Trans. Signal Process..

[20]  Asunción Moreno,et al.  Maximum likelihood filters in spectral estimation problems , 1986 .

[21]  P. Stoica,et al.  The stochastic CRB for array processing: a textbook derivation , 2001, IEEE Signal Processing Letters.

[22]  Petre Stoica,et al.  On the parameterization of positive real sequences and MA parameter estimation , 2001, IEEE Trans. Signal Process..

[23]  A. Walden,et al.  Spectral analysis for physical applications : multitaper and conventional univariate techniques , 1996 .

[24]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[25]  A. A. Beex,et al.  A comparison of numerator estimators for ARMA spectra , 1986, IEEE Trans. Acoust. Speech Signal Process..

[26]  M. Bartlett.  Periodogram analysis and continuous spectra. , 1950, Biometrika.

[27]  P. Stoica,et al.  On the Cramer-Rao bound for model-based spectral analysis , 2002, IEEE Signal Processing Letters.

[28]  J. Markel,et al.  FFT pruning , 1971 .

[29]  Charles W. Therrien,et al.  Discrete Random Signals and Statistical Signal Processing , 1992 .

[30]  Andreas Jakobsson,et al.  Cisoid parameter estimation in the colored noise case: asymptotic Cramer-Rao bound, maximum likelihood, and nonlinear least-squares , 1997, IEEE Trans. Signal Process..

[31]  Milos Doroslovacki,et al.  Product of second moments in time and frequency for discrete-time signals and the uncertainty limit , 1998, Signal Process..

[32]  Björn E. Ottersten,et al.  Sensor array processing based on subspace fitting , 1991, IEEE Trans. Signal Process..

[33]  Louis L. Scharf,et al.  Lag-windowing and multiple-data-windowing are roughly equivalent for smooth spectrum estimation , 1999, IEEE Trans. Signal Process..

[34]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[35]  P. Vilbe,et al.  On the uncertainty principle in discrete signals , 1992 .

[36]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[37]  V. Pisarenko.  The Retrieval of Harmonics from a Covariance Function , 1973 .

[38]  Tapan K. Sarkar,et al.  Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[39]  T. McKelvey,et al.  A robust frequency domain subspace algorithm for multi-component harmonic retrieval , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[40]  Rokuya Ishii,et al.  The uncertainty principle in discrete signals , 1986 .

[41]  Simon Haykin,et al.  Advances in spectrum analysis and array processing , 1991 .

[42]  Anthony J. Weiss,et al.  Coherent wide-band processing for arbitrary array geometry , 1993, IEEE Transactions on Signal Processing.

[43]  Clifford T. Mullis,et al.  The Euclid algorithm and the fast computation of cross-covariance and autocovariance sequences , 1989, IEEE Trans. Acoust. Speech Signal Process..

[44]  Bjorn Ottersten,et al.  Exact and Large Sample ML Techniques for Parameter Estimation and Detection in Array Processing , 1993 .

[45]  Bo Wahlberg,et al.  Convergence rates for inverse Toeplitz matrix forms , 1989 .

[46]  Kurt S. Riedel,et al.  Minimum bias multiple taper spectral estimation , 2018, IEEE Trans. Signal Process..

[47]  Yoram Bresler,et al.  Exact maximum likelihood parameter estimation of superimposed exponential signals in noise , 1986, IEEE Trans. Acoust. Speech Signal Process..

[48]  T. Moon.  The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[49]  Jian Li,et al.  Optimal high-order Yule-Walker estimation of sinusoidal frequencies , 1991, IEEE Trans. Signal Process..

[50]  R. Kumaresan,et al.  Estimating the Angles of Arrival of Multiple Plane Waves , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[51]  Erik G. Larsson,et al.  Comments on "Linearization method for finding Cramer-Rao bounds in signal processing" [and reply] , 2001, IEEE Trans. Signal Process..

[52]  Jian Li,et al.  Doubly constrained robust Capon beamformer , 2004, IEEE Transactions on Signal Processing.

[53]  C. Chatfield,et al.  Fourier Analysis of Time Series: An Introduction , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[54]  H. Cox.  Resolving power and sensitivity to mismatch of optimum array processors , 1973 .

[55]  Petre Stoica,et al.  MA estimation in polynomial time , 2000, IEEE Trans. Signal Process..

[56]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[57]  Petre Stoica,et al.  Direction-of-arrival estimation of an amplitude-distorted wavefront , 2001, IEEE Trans. Signal Process..

[58]  Jeng-Kuang Hwang,et al.  A combined detection-estimation algorithm for the harmonic-retrieval problem , 1993, Signal Process..

[59]  Piet M. T. Broersen,et al.  Automatic spectral analysis with time series models , 2002, IEEE Trans. Instrum. Meas..

[60]  H. Akaike.  A new look at the statistical model identification , 1974 .

[61]  Hirotugu Akaike,et al.  On the Likelihood of a Time Series Model , 1978 .

[62]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[63]  Bhaskar D. Rao,et al.  Model based processing of signals: a state space approach , 1992, Proc. IEEE.

[64]  Boaz Porat,et al.  A course in digital signal processing , 1996 .

[65]  Randolph L. Moses,et al.  On the geometry of isotropic arrays , 2003, IEEE Trans. Signal Process..

[66]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[67]  Björn E. Ottersten,et al.  The evil of superefficiency , 1996, Signal Process..

[68]  Björn E. Ottersten,et al.  Detection and estimation in sensor arrays using weighted subspace fitting , 1991, IEEE Trans. Signal Process..

[69]  R. Kumaresan,et al.  Estimation of frequencies of multiple sinusoids: Making linear prediction perform like maximum likelihood , 1982, Proceedings of the IEEE.

[70]  J. Cavanaugh.  Unifying the derivations for the Akaike and corrected Akaike information criteria , 1997 .

[71]  R. Kashyap.  Inconsistency of the AIC rule for estimating the order of autoregressive models , 1980 .

[72]  F. Harris.  On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[73]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[74]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[75]  D. B. Preston.  Spectral Analysis and Time Series , 1983 .

[76]  Björn E. Ottersten,et al.  Array processing in correlated noise fields based on instrumental variables and subspace fitting , 1995, IEEE Trans. Signal Process..

[77]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[78]  Philippe Delsarte,et al.  The split Levinson algorithm , 1986, IEEE Trans. Acoust. Speech Signal Process..

[79]  B. Friedlander,et al.  An approximate maximum likelihood approach to ARMA spectral estimation , 1985, 1985 24th IEEE Conference on Decision and Control.

[80]  Tryphon T. Georgiou,et al.  Realization of power spectra from partial covariance sequences , 1987, IEEE Trans. Acoust. Speech Signal Process..

[81]  Stanislav B. Kesler.  Modern spectrum analysis, II , 1986 .

[82]  Sabine Van Huffel,et al.  Total least squares problem - computational aspects and analysis , 1991, Frontiers in applied mathematics.

[83]  Robert M. Gray,et al.  On the asymptotic eigenvalue distribution of Toeplitz matrices , 1972, IEEE Trans. Inf. Theory.

[84]  William S. Cleveland,et al.  The Inverse Autocorrelations of a Time Series and Their Applications , 1972 .

[85]  Torsten Söderström,et al.  Model-structure selection by cross-validation , 1986 .

[86]  R. J. Bhansali,et al.  Autoregressive and window estimates of the inverse correlation function , 1980 .

[87]  Piet M. T. Broersen,et al.  Order selection for vector autoregressive models , 2003, IEEE Trans. Signal Process..

[88]  J. Durbin.  EFFICIENT ESTIMATION OF PARAMETERS IN MOVING-AVERAGE MODELS , 1959 .

[89]  Erik G. Larsson,et al.  HIGH-RESOLUTION NONPARAMETRIC SPECTRAL ANALYSIS: THEORY AND APPLICATIONS , 2003 .

[90]  Petre Stoica,et al.  Forward-only and forward-backward sample covariances - A comparative study , 1999, Signal Process..

[91]  Rangasami L. Kashyap,et al.  Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[92]  Georges Bienvenu.  Influence of the spatial coherence of the background noise on high resolution passive methods , 1979, ICASSP.

[93]  Jian Li,et al.  An adaptive filtering approach to spectral estimation and SAR imaging , 1996, IEEE Trans. Signal Process..

[94]  Petre Stoica,et al.  Performance comparison of subspace rotation and MUSIC methods for direction estimation , 1990, Fifth ASSP Workshop on Spectrum Estimation and Modeling.

[95]  Jean-Jacques Fuchs.  Rectangular Pisarenko method applied to source localization , 1996, IEEE Trans. Signal Process..

[96]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[97]  R. Bhansali,et al.  Some properties of the order of an autoregressive model selected by a generalization of Akaike∘s EPF criterion , 1977 .

[98]  Lee C. Potter,et al.  On Model Order Determination For Complex Exponential Signals: Performance Of An FFT-initialized ML Algorithm , 1994, IEEE Seventh SP Workshop on Statistical Signal and Array Processing.

[99]  P. Faurre.  Stochastic Realization Algorithms , 1976 .

[100]  G. Wilson.  Factorization of the Covariance Generating Function of a Pure Moving Average Process , 1969 .

[101]  Petre Stoica,et al.  Statistical analysis of two nonlinear least-squares estimators of sine-wave parameters in the colored-noise case , 1989 .

[102]  Donald G. Childers,et al.  Modern Spectrum Analysis , 1978 .

[103]  Will Gersch,et al.  Estimation of the autoregressive parameters of a mixed autoregressive moving-average time series , 1970 .

[104]  Jian Li,et al.  Efficient mixed-spectrum estimation with applications to target feature extraction , 1995, Conference Record of The Twenty-Ninth Asilomar Conference on Signals, Systems and Computers.

[105]  U. Schwarz.  MATHEMATICAL-STATISTICAL DESCRIPTION OF ITERATIVE BEAM REMOVING TECHNIQUE (METHOD CLEAN) , 1978 .

[106]  Bhaskar D. Rao,et al.  Weighted subspace methods and spatial smoothing: analysis and comparison , 1993, IEEE Trans. Signal Process..

[107]  Srinivasan Umesh,et al.  Estimation of parameters of exponentially damped sinusoids using fast maximum likelihood estimation with application to NMR spectroscopy data , 1996, IEEE Trans. Signal Process..

[108]  Jian Li,et al.  Multi-model approach to model selection , 2004, Digit. Signal Process..

[109]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[110]  P. Stoica,et al.  Cyclic minimizers, majorization techniques, and the expectation-maximization algorithm: a refresher , 2004, IEEE Signal Process. Mag..

[111]  Petre Stoica,et al.  Frequency-domain method based on the singular value decomposition for frequency-selective NMR spectroscopy. , 2003, Journal of magnetic resonance.

[112]  Abd-Krim Seghouane,et al.  A small sample model selection criterion based on Kullback's symmetric divergence , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[113]  Bruce R. Musicus.  Fast MLM power spectrum estimation from uniformly spaced correlations , 1985, IEEE Trans. Acoust. Speech Signal Process..

[114]  Clifford M. Hurvich,et al.  A CORRECTED AKAIKE INFORMATION CRITERION FOR VECTOR AUTOREGRESSIVE MODEL SELECTION , 1993 .

[115]  Tryphon T. Georgiou,et al.  A generalized entropy criterion for Nevanlinna-Pick interpolation with degree constraint , 2001, IEEE Trans. Autom. Control..

[116]  W. M. Carey,et al.  Digital spectral analysis: with applications , 1986 .

[117]  M. Bartlett.  On the Theoretical Specification and Sampling Properties of Autocorrelated Time‐Series , 1946 .

[118]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[119]  Louis L. Scharf,et al.  Two-dimensional modal analysis based on maximum likelihood , 1994, IEEE Trans. Signal Process..

[120]  Björn E. Ottersten,et al.  Covariance Matching Estimation Techniques for Array Signal Processing Applications , 1998, Digit. Signal Process..

[121]  Arthur Jay Barabell,et al.  Improving the resolution performance of eigenstructure-based direction-finding algorithms , 1983, ICASSP.

[122]  Prabhakar S. Naidu,et al.  Modern spectrum analysis of time series , 1995 .

[123]  P Stoica,et al.  Nonparametric NMR spectroscopy. , 2001, Journal of magnetic resonance.

[124]  J. W. Tukey,et al.  The Measurement of Power Spectra from the Point of View of Communications Engineering , 1958 .

[125]  Jean-Jacques Fuchs,et al.  Estimating the number of sinusoids in additive white noise , 1988, IEEE Trans. Acoust. Speech Signal Process..

[126]  Gilbert T. Walker,et al.  On Periodicity in Series of Related Terms , 1931 .

[127]  Petre Stoica,et al.  Nonlinear Least-Squares Approach to Frequency Estimation and Detection for Sinusoidal Signals with Arbitrary Envelope , 1999, Digit. Signal Process..

[128]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[129]  Jian Li,et al.  On robust Capon beamforming and diagonal loading , 2003, IEEE Trans. Signal Process..

[130]  Allan Steinhardt,et al.  Multi‐window spectrum estimation — A linear algebraic approach , 1993 .

[131]  Petre Stoica,et al.  Instrumental Variable Methods for ARMA Models , 1987 .

[132]  Arye Nehorai,et al.  On stability and root location of linear prediction models , 1987, IEEE Trans. Acoust. Speech Signal Process..

[133]  James R. Fienup,et al.  Spatially variant apodization for sidelobe control in SAR imagery , 1994, Proceedings of 1994 IEEE National Radar Conference.

[134]  Steven Kay,et al.  Modern Spectral Estimation: Theory and Application , 1988 .

[135]  Fulvio Gini,et al.  Multilook APES for multibaseline SAR interferometry , 2002, IEEE Trans. Signal Process..

[136]  P. Stoica,et al.  Combining Capon and APES for estimation of spectral lines , 2000 .

[137]  ByoungSeon Choi,et al.  Arma Model Identification , 1992 .

[138]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[139]  J. Cadzow,et al.  Spectral estimation: An overdetermined rational model equation approach , 1982, Proceedings of the IEEE.

[140]  Stuart R. DeGraaf,et al.  Sidelobe reduction via adaptive FIR filtering in SAR imagery , 1994, IEEE Trans. Image Process..

[141]  J. Högbom,et al.  APERTURE SYNTHESIS WITH A NON-REGULAR DISTRIBUTION OF INTERFEROMETER BASELINES. Commentary , 1974 .

[142]  Ananthram Swami,et al.  Fast computation of the exact FIM for deterministic signals in colored noise , 1999, IEEE Trans. Signal Process..

[143]  Tryphon T. Georgiou,et al.  A new approach to spectral estimation: a tunable high-resolution spectral estimator , 2000, IEEE Trans. Signal Process..

[144]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[145]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[146]  L. Ljung,et al.  New inversion formulas for matrices classified in terms of their distance from Toeplitz matrices , 1979 .

[147]  Petre Stoica,et al.  On biased estimators and the unbiased Cramér-Rao lower bound , 1990, Signal Process..

[148]  G. Stewart.  Introduction to matrix computations , 1973 .

[149]  Jean-Jacques Fuchs.  Estimation of the number of signals in the presence of unknown correlated sensor noise , 1992, IEEE Trans. Signal Process..

[150]  T. Kailath,et al.  A subspace rotation approach to signal parameter estimation , 1986, Proceedings of the IEEE.

[151]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[152]  J. Burg.  THE RELATIONSHIP BETWEEN MAXIMUM ENTROPY SPECTRA AND MAXIMUM LIKELIHOOD SPECTRA , 1972 .

[153]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[154]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[155]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[156]  A. A. Beex,et al.  Covariance sequence approximation for parametric spectrum modeling , 1981 .

[157]  Petre Stoica,et al.  Maximum likelihood estimation of the parameters of multiple sinusoids from noisy measurements , 1989, IEEE Trans. Acoust. Speech Signal Process..

[158]  Torsten Söderström,et al.  Statistical analysis of MUSIC and subspace rotation estimates of sinusoidal frequencies , 1991, IEEE Trans. Signal Process..

[159]  Erik G. Larsson,et al.  Adaptive Filter-bank Approach to Restoration and Spectral Analysis of Gapped Data* , 2000 .

[160]  Brett Ninness,et al.  The asymptotic CRLB for the spectrum of ARMA processes , 2003, IEEE Trans. Signal Process..

[161]  Thomas P. Bronez,et al.  On the performance advantage of multitaper spectral analysis , 1992, IEEE Trans. Signal Process..

[163]  G. Yule.  On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[164]  J. Fuchs,et al.  ARMA-Order estimation via matrix perturbation theory , 1986, 1986 25th IEEE Conference on Decision and Control.

[165]  C. T. Mullis,et al.  Quadratic Estimators of the Power Spectrum , 1989 .

[166]  J. P. Burg,et al.  Maximum entropy spectral analysis. , 1967 .

[167]  Lloyd J. Griffiths,et al.  A projection approach for robust adaptive beamforming , 1994, IEEE Trans. Signal Process..

[168]  A. Cantoni,et al.  Eigenvalues and eigenvectors of symmetric centrosymmetric matrices , 1976 .

[169]  K. Arun,et al.  State-space and singular-value decomposition-based approximation methods for the harmonic retrieval problem , 1983 .