Robust Harmonic Retrieval via Block Successive Upper-Bound Minimization

Harmonic retrieval (HR) is a problem of significance with numerous applications. Many existing algorithms are explicitly or implicitly developed under Gaussian noise assumption, which, however, are not robust against non-Gaussian noise such as impulsive noise or outliers. In this paper, by employing the <inline-formula> <tex-math notation="LaTeX">$\ell _p$</tex-math></inline-formula>-fitting criterion and block successive upper-bound minimization (BSUM) technique, a variant of the classical RELAX algorithm named as BSUM-RELAX is devised for robust HR. It is revealed that the BSUM-RELAX successively performs alternating optimization along coordinate directions, i.e., it updates one harmonic by fixing the other <inline-formula><tex-math notation="LaTeX">$(K-1)$</tex-math> </inline-formula> components, such that the whole problem is split into <inline-formula><tex-math notation="LaTeX">$K$ </tex-math></inline-formula> single-tone HR problems, which are then solved by creating a surrogate function that majorizes the objective function of each subproblem. To further refine the frequency component, the Newton's method that takes linear complexity <inline-formula><tex-math notation="LaTeX">$\mathcal {O}(N)$</tex-math> </inline-formula> is derived for updating the frequency estimates. We prove that under the single-tone case, BSUM-RELAX converges to a Karush-Kuhn-Tucker point. Furthermore, the BSUM-RELAX is extended to the multidimensional HR case. Numerical results show that the proposed algorithm outperforms the state-of-the-art methods in heavy-tailed noise scenarios.

[1]  Mérouane Debbah,et al.  Preliminary Results on 3D Channel Modeling: From Theory to Standardization , 2013, IEEE Journal on Selected Areas in Communications.

[2]  Florian Roemer,et al.  Higher-Order SVD-Based Subspace Estimation to Improve the Parameter Estimation Accuracy in Multidimensional Harmonic Retrieval Problems , 2008, IEEE Transactions on Signal Processing.

[3]  Robert Boorstyn,et al.  Single tone parameter estimation from discrete-time observations , 1974, IEEE Trans. Inf. Theory.

[4]  Adriaan van den Bos,et al.  The multivariate complex normal distribution-a generalization , 1995, IEEE Trans. Inf. Theory.

[5]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Yingbo Hua The most efficient implementation of the IQML algorithm , 1994, IEEE Trans. Signal Process..

[7]  Weize Sun,et al.  ℓp-norm Based Iterative Adaptive Approach for Robust Spectral Analysis , 2014, Signal Process..

[8]  W. Szajnowski,et al.  Simulation of dependent samples of symmetric alpha-stable clutter , 2001, IEEE Signal Processing Letters.

[9]  Karim Faez,et al.  Synthetic aperture radar imaging using nonlinear frequency modulation signal , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[10]  Jian Li,et al.  Super resolution time delay estimation via MODE-WRELAX , 1999 .

[11]  Jian Li,et al.  Source Localization and Sensing: A Nonparametric Iterative Adaptive Approach Based on Weighted Least Squares , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Jeffrey A. Fessler,et al.  An Expanded Theoretical Treatment of Iteration-Dependent Majorize-Minimize Algorithms , 2007, IEEE Transactions on Image Processing.

[13]  Hugues Talbot,et al.  A Majorize-Minimize Subspace Approach for ℓ2-ℓ0 Image Regularization , 2011, SIAM J. Imaging Sci..

[14]  Theodore S. Rappaport,et al.  Measurements and Models of Radio Frequency Impulsive Noise for Indoor Wireless Communications , 1993, IEEE J. Sel. Areas Commun..

[15]  Awais Khawar,et al.  Spectral Coexistence of MIMO Radar and MIMO Cellular System , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Jian Li,et al.  Efficient mixed-spectrum estimation with applications to target feature extraction , 1995, Conference Record of The Twenty-Ninth Asilomar Conference on Signals, Systems and Computers.

[17]  Prabhu Babu,et al.  Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning , 2017, IEEE Transactions on Signal Processing.

[18]  Ta-Hsin Li A Nonlinear Method for Robust Spectral Analysis , 2010, IEEE Transactions on Signal Processing.

[19]  Jun Liu,et al.  An Eigenvector-Based Approach for Multidimensional Frequency Estimation With Improved Identifiability , 2006, IEEE Transactions on Signal Processing.

[20]  Lei Huang,et al.  Robust Spectrum Estimation via Majorization Minimization , 2018, 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[21]  Jian Li,et al.  RELAX-based estimation of damped sinusoidal signal parameters , 1997, Signal Process..

[22]  Hing-Cheung So,et al.  Robust Multi-Dimensional Harmonic Retrieval Using Iteratively Reweighted HOSVD , 2015, IEEE Signal Processing Letters.

[23]  Nikos D. Sidiropoulos,et al.  Almost sure identifiability of constant modulus multidimensional harmonic retrieval , 2002, IEEE Trans. Signal Process..

[24]  Zhi-Quan Luo,et al.  A Unified Algorithmic Framework for Block-Structured Optimization Involving Big Data: With applications in machine learning and signal processing , 2015, IEEE Signal Processing Magazine.

[25]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[26]  Lei Huang,et al.  $\ell _{p}$-MUSIC: Robust Direction-of-Arrival Estimator for Impulsive Noise Environments , 2013, IEEE Transactions on Signal Processing.

[27]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[28]  Nikos D. Sidiropoulos,et al.  Inexact Alternating Optimization for Phase Retrieval in the Presence of Outliers , 2016, IEEE Transactions on Signal Processing.

[29]  Nikos D. Sidiropoulos,et al.  Signal Processing and Optimization Tools for Conference Review and Session Assignment , 2015, IEEE Signal Processing Magazine.

[30]  W. H. Young On Classes of Summable Functions and their Fourier Series , 1912 .

[31]  Nikos D. Sidiropoulos,et al.  Joint Tensor Factorization and Outlying Slab Suppression With Applications , 2015, IEEE Transactions on Signal Processing.

[32]  Yang Song,et al.  Multilinear direction finding for sensor-array with multiple scales of invariance , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[33]  Weize Sun,et al.  Accurate and Computationally Efficient Tensor-Based Subspace Approach for Multidimensional Harmonic Retrieval , 2012, IEEE Transactions on Signal Processing.

[34]  Ta-Hsin Li,et al.  Laplace Periodogram for Time Series Analysis , 2008 .