SIGIBE: Solving random bilinear equations via gradient descent with spectral initialization

We investigate the problem of finding the real-valued vectors h, of size L, and x, of size P, from M independent measurements ym = 〈am, h〉〈bm, x〉, where am and bm are known random vectors. Recovery of the unknowns entails solving a set of bilinear equations, a challenging problem encountered in signal processing tasks such as blind deconvolution for channel equalization or image deblurring. Inspired by the Wirtinger flow approach to the related phase retrieval problem, we propose a solver that proceeds in two steps: (i) first a spectral method is used to obtain an initial guess; which is then (ii) refined using simple and scalable gradient descent iterations to minimize a natural non-convex formulation of the recovery problem. Our method - which we refer to as SIGIBE: Spectral Initialization and Gradient Iterations for Bilinear Equations - can accommodate arbitrary correlations between am and bm. Different from recent approaches to blind deconvolution using convex relaxation, SIGIBE does not require matrix lifting that could hinder the method's scalability. Numerical tests corroborate SIGIBE's effectiveness in various data settings, and show successful recovery with as few as M ≳ (L + P) measurements.

[1]  W. Marsden I and J , 2012 .

[2]  Santiago Segarra,et al.  Blind identification of graph filters with sparse inputs , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[3]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[4]  24th European Signal Processing Conference, EUSIPCO 2016, Budapest, Hungary, August 29 - September 2, 2016 , 2016, European Signal Processing Conference.

[5]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[6]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[7]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[8]  Yonina C. Eldar,et al.  Sparsity Constrained Nonlinear Optimization: Optimality Conditions and Algorithms , 2012, SIAM J. Optim..

[9]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[10]  Thomas Strohmer,et al.  Self-calibration and biconvex compressive sensing , 2015, ArXiv.

[11]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[12]  John D. Lafferty,et al.  A Convergent Gradient Descent Algorithm for Rank Minimization and Semidefinite Programming from Random Linear Measurements , 2015, NIPS.

[13]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[14]  Yonina C. Eldar,et al.  GESPAR: Efficient Phase Retrieval of Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[15]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[16]  Yonina C. Eldar,et al.  Sparsity Based Sub-wavelength Imaging with Partially Incoherent Light via Quadratic Compressed Sensing References and Links , 2022 .

[17]  Justin K. Romberg,et al.  Blind Deconvolution Using Convex Programming , 2012, IEEE Transactions on Information Theory.

[18]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[19]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[20]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[21]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[22]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2013, SIAM J. Imaging Sci..

[24]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[25]  James R Fienup,et al.  Phase retrieval algorithms: a personal tour [Invited]. , 2013, Applied optics.

[26]  Max Simchowitz,et al.  Low-rank Solutions of Linear Matrix Equations via Procrustes Flow , 2015, ICML.