Fast and Guaranteed Blind Multichannel Deconvolution Under a Bilinear System Model

We consider the multichannel blind deconvolution problem where we observe the output of multiple channels that are all excited with the same unknown input. From these observations, we wish to estimate the impulse responses of each of the channels. We show that this problem is well-posed if the channels follow a bilinear model where the ensemble of channel responses is modeled as lying in a low-dimensional subspace but with each channel modulated by an independent gain. Under this model, we show how the channel estimates can be found by minimizing a quadratic function over a non-convex set. We analyze two methods for solving this non-convex program, and provide performance guarantees for each. The first is a method of alternating eigenvectors that breaks the program down into a series of eigenvalue problems. The second is a truncated power iteration, which can roughly be interpreted as a method for finding the largest eigenvector of a symmetric matrix with the additional constraint that it adheres to our bilinear model. As with most non-convex optimization algorithms, the performance of both of these algorithms is highly dependent on having a good starting point. We show how such a starting point can be constructed from the channel measurements. Our performance guarantees are non-asymptotic, and provide a sufficient condition on the number of samples observed per channel in order to guarantee channel estimates of certain accuracy. Our analysis uses a model with a “generic” subspace that is drawn at random, and we show the performance bounds hold with high probability. Mathematically, the key estimates are derived by quantifying how well the eigenvectors of certain random matrices approximate the eigenvectors of their mean. We also present a series of numerical results demonstrating that the empirical performance is consistent with the presented theory.

[1]  F. T. Wright,et al.  A Bound on Tail Probabilities for Quadratic Forms in Independent Random Variables , 1971 .

[2]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[3]  Holger Rauhut,et al.  Suprema of Chaos Processes and the Restricted Isometry Property , 2012, ArXiv.

[4]  B. Carl Inequalities of Bernstein-Jackson-type and the degree of compactness of operators in Banach spaces , 1985 .

[5]  Justin Romberg,et al.  Round-robin multiple-source localization. , 2014, The Journal of the Acoustical Society of America.

[6]  M. Rudelson,et al.  Hanson-Wright inequality and sub-gaussian concentration , 2013 .

[7]  Justin Romberg,et al.  Blind deconvolution of sources of opportunity in ocean waveguides using bilinear channel models. , 2020, The Journal of the Acoustical Society of America.

[8]  Raghunandan H. Keshavan Efficient algorithms for collaborative filtering , 2012 .

[9]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[10]  Zhi-Quan Luo,et al.  Guaranteed Matrix Completion via Non-Convex Factorization , 2014, IEEE Transactions on Information Theory.

[11]  Gene H. Golub,et al.  Matrix computations , 1983 .

[12]  Ning Tian,et al.  Performance guarantees of spectral methods for passive sensing of multiple channels , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[13]  Yanjun Li,et al.  Blind Recovery of Sparse Signals From Subsampled Convolution , 2015, IEEE Transactions on Information Theory.

[14]  B. Recht,et al.  Convex Blind Deconvolution with Random Masks , 2014 .

[15]  Yanjun Li,et al.  Optimal Sample Complexity for Blind Gain and Phase Calibration , 2015, IEEE Transactions on Signal Processing.

[16]  Yoram Bresler,et al.  ADMiRA: Atomic Decomposition for Minimum Rank Approximation , 2009, IEEE Transactions on Information Theory.

[17]  Felix Krahmer,et al.  Optimal Injectivity Conditions for Bilinear Inverse Problems with Applications to Identifiability of Deconvolution Problems , 2016, SIAM J. Appl. Algebra Geom..

[18]  Justin K. Romberg,et al.  Blind Deconvolution Using Convex Programming , 2012, IEEE Transactions on Information Theory.

[19]  Minh N. Do,et al.  MCA: A Multichannel Approach to SAR Autofocus , 2009, IEEE Transactions on Image Processing.

[20]  P. Wedin On angles between subspaces of a finite dimensional inner product space , 1983 .

[21]  Justin K. Romberg,et al.  Lifting for Blind Deconvolution in Random Mask Imaging: Identifiability and Convex Relaxation , 2015, SIAM J. Imaging Sci..

[22]  L. Balzano,et al.  Blind Calibration of Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[23]  M. Talagrand,et al.  Probability in Banach Spaces: Isoperimetry and Processes , 1991 .

[24]  Xiao-Tong Yuan,et al.  Truncated power method for sparse eigenvalue problems , 2011, J. Mach. Learn. Res..

[25]  Prateek Jain,et al.  Phase Retrieval Using Alternating Minimization , 2013, IEEE Transactions on Signal Processing.

[26]  Yuejie Chi,et al.  Guaranteed Blind Sparse Spikes Deconvolution via Lifting and Convex Optimization , 2015, IEEE Journal of Selected Topics in Signal Processing.

[27]  Thomas Strohmer,et al.  Self-Calibration via Linear Least Squares , 2016, ArXiv.

[28]  M. Rudelson,et al.  On sparse reconstruction from Fourier and Gaussian measurements , 2008 .

[29]  Justin K. Romberg,et al.  Compressed Subspace Matching on the Continuum , 2014, ArXiv.

[30]  Y. Bresler,et al.  Blind gain and phase calibration for low-dimensional or sparse signal sensing via power iteration , 2017, 2017 International Conference on Sampling Theory and Applications (SampTA).

[31]  Laurent Jacques,et al.  Through the Haze: A Non-Convex Approach to Blind Calibration for Linear Random Sensing Models , 2016, ArXiv.

[32]  Sunav Choudhary,et al.  Sparse blind deconvolution: What cannot be done , 2014, 2014 IEEE International Symposium on Information Theory.

[33]  Felix Krahmer,et al.  Spectral Methods for Passive Imaging: Non-asymptotic Performance and Robustness , 2017, SIAM J. Imaging Sci..

[34]  T. Kailath,et al.  A least-squares approach to blind channel identification , 1995, IEEE Trans. Signal Process..

[35]  Yanjun Li,et al.  Identifiability in Bilinear Inverse Problems With Applications to Subspace or Sparsity-Constrained Blind Gain and Phase Calibration , 2017, IEEE Transactions on Information Theory.

[36]  Karim Abed-Meraim,et al.  Blind system identification , 1997, Proc. IEEE.

[37]  M. Talagrand The Generic chaining : upper and lower bounds of stochastic processes , 2005 .

[38]  Irène Waldspurger,et al.  Phase Retrieval With Random Gaussian Sensing Vectors by Alternating Projections , 2016, IEEE Transactions on Information Theory.

[39]  R. Adamczak,et al.  Concentration inequalities for non-Lipschitz functions with bounded derivatives of higher order , 2013, 1304.1826.

[40]  Prateek Jain,et al.  Low-rank matrix completion using alternating minimization , 2012, STOC '13.

[41]  Yanjun Li,et al.  A Unified Framework for Identifiability Analysis in Bilinear Inverse Problems with Applications to Subspace and Sparsity Models , 2015, ArXiv.

[42]  Yonina C. Eldar,et al.  Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow , 2016, IEEE Transactions on Information Theory.

[43]  G. Stewart Matrix Algorithms, Volume II: Eigensystems , 2001 .

[44]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[45]  Yanjun Li,et al.  Identifiability and Stability in Blind Deconvolution Under Minimal Assumptions , 2015, IEEE Transactions on Information Theory.

[46]  L. Tong,et al.  Multichannel blind identification: from subspace to maximum likelihood methods , 1998, Proc. IEEE.

[47]  Erwin Riegler,et al.  Information-theoretic limits of matrix completion , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[48]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[49]  R. Varga,et al.  Block diagonally dominant matrices and generalizations of the Gerschgorin circle theorem , 1962 .

[50]  Thomas Strohmer,et al.  Self-Calibration and Bilinear Inverse Problems via Linear Least Squares , 2016, SIAM J. Imaging Sci..

[51]  W. Kahan,et al.  The Rotation of Eigenvectors by a Perturbation. III , 1970 .

[52]  Justin K. Romberg,et al.  An Overview of Low-Rank Matrix Recovery From Incomplete Observations , 2016, IEEE Journal of Selected Topics in Signal Processing.

[53]  Minh N. Do,et al.  Subspace methods for computational relighting , 2013, Electronic Imaging.

[54]  John Wright,et al.  Complete Dictionary Recovery Over the Sphere II: Recovery by Riemannian Trust-Region Method , 2015, IEEE Transactions on Information Theory.

[55]  Thomas Strohmer,et al.  Self-calibration and biconvex compressive sensing , 2015, ArXiv.

[56]  Chrysostomos L. Nikias,et al.  EVAM: an eigenvector-based algorithm for multichannel blind deconvolution of input colored signals , 1995, IEEE Trans. Signal Process..

[57]  Moritz Hardt,et al.  Understanding Alternating Minimization for Matrix Completion , 2013, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[58]  Xiaodong Li,et al.  Optimal Rates of Convergence for Noisy Sparse Phase Retrieval via Thresholded Wirtinger Flow , 2015, ArXiv.

[59]  Eric Moulines,et al.  Subspace methods for the blind identification of multichannel FIR filters , 1995, IEEE Trans. Signal Process..

[60]  Shoham Sabach,et al.  Proximal Heterogeneous Block Implicit-Explicit Method and Application to Blind Ptychographic Diffraction Imaging , 2015, SIAM J. Imaging Sci..

[61]  Marius Junge,et al.  Generalized notions of sparsity and restricted isometry property. Part I: a unified framework , 2017, Information and Inference: A Journal of the IMA.

[62]  John Wright,et al.  Complete Dictionary Recovery Over the Sphere I: Overview and the Geometric Picture , 2015, IEEE Transactions on Information Theory.

[63]  Yanjun Li,et al.  Identifiability in Blind Deconvolution With Subspace or Sparsity Constraints , 2015, IEEE Transactions on Information Theory.

[64]  Kiryung Lee,et al.  RIP-like Properties in Subsampled Blind Deconvolution , 2015, ArXiv.

[65]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[66]  Zhihui Zhu,et al.  Super-Resolution of Complex Exponentials From Modulations With Unknown Waveforms , 2016, IEEE Transactions on Information Theory.

[67]  Inderjit S. Dhillon,et al.  Guaranteed Rank Minimization via Singular Value Projection , 2009, NIPS.

[68]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[69]  Justin Romberg,et al.  Multichannel myopic deconvolution in underwater acoustic channels via low-rank recovery. , 2017, The Journal of the Acoustical Society of America.

[70]  D. Donoho,et al.  Minimax risk of matrix denoising by singular value thresholding , 2013, 1304.2085.