Phase Retrieval Using Structured Sparsity: A Sample Efficient Algorithmic Framework

We consider the problem of recovering a signal $\mathbf{x}^* \in \mathbf{R}^n$, from magnitude-only measurements, $y_i = |\left\langle\mathbf{a}_i,\mathbf{x}^*\right\rangle|$ for $i=\{1,2,\ldots,m\}$. This is a stylized version of the classical phase retrieval problem, and is a fundamental challenge in bio-imaging systems, astronomical imaging, and speech processing. It is well known that the above problem is ill-posed, and therefore some additional assumptions on the signal and/or the measurements are necessary. In this paper, we first study the case where the underlying signal $\mathbf{x}^*$ is $s$-sparse. We develop a novel recovery algorithm that we call Compressive Phase Retrieval with Alternating Minimization, or CoPRAM. Our algorithm is simple and be obtained via a natural combination of the classical alternating minimization approach for phase retrieval with the CoSaMP algorithm for sparse recovery. Despite its simplicity, we prove that our algorithm achieves a sample complexity of $O(s^2 \log n)$ with Gaussian measurements $\mathbf{a}_i$, which matches the best known existing results; moreover, it also demonstrates linear convergence in theory and practice. Additionally, it requires no extra tuning parameters other than the signal sparsity level $s$. We then consider the case where the underlying signal $\mathbf{x}^*$ arises from structured sparsity models. We specifically examine the case of block-sparse signals with uniform block size of $b$ and block sparsity $k=s/b$. For this problem, we design a recovery algorithm that we call Block CoPRAM that further reduces the sample complexity to $O(ks \log n)$. For sufficiently large block lengths of $b=\Theta(s)$, this bound equates to $O(s \log n)$. To our knowledge, this constitutes the first end-to-end algorithm for phase retrieval where the Gaussian sample complexity has a sub-quadratic dependence on the signal sparsity level.

[1]  John Wright,et al.  A Geometric Analysis of Phase Retrieval , 2016, International Symposium on Information Theory.

[2]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[3]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[4]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[5]  Mayank Bakshi,et al.  SUPER: Sparse signals with unknown phases efficiently recovered , 2014, 2014 IEEE International Symposium on Information Theory.

[6]  J. Rodenburg,et al.  An improved ptychographical phase retrieval algorithm for diffractive imaging. , 2009, Ultramicroscopy.

[7]  Babak Hassibi,et al.  Recovery of sparse 1-D signals from the magnitudes of their Fourier transform , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[8]  M. Talagrand The Generic chaining : upper and lower bounds of stochastic processes , 2005 .

[9]  Yang Wang,et al.  Robust sparse phase retrieval made easy , 2014, 1410.5295.

[10]  Piya Pal,et al.  Sparse phase retrieval using partial nested fourier samplers , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[11]  Tom Goldstein,et al.  PhaseMax: Convex Phase Retrieval via Basis Pursuit , 2016, IEEE Transactions on Information Theory.

[12]  Robert W. Harrison,et al.  Phase problem in crystallography , 1993 .

[13]  K. Nugent,et al.  Unique phase recovery for nonperiodic objects. , 2003, Physical review letters.

[14]  Piotr Indyk,et al.  Fast Algorithms for Structured Sparsity , 2015, Bull. EATCS.

[15]  Piotr Indyk,et al.  Approximation-Tolerant Model-Based Compressive Sensing , 2014, SODA.

[16]  Rick P. Millane,et al.  Phase retrieval in crystallography and optics , 1990 .

[17]  Chandler Davis The rotation of eigenvectors by a perturbation , 1963 .

[18]  Yingbin Liang,et al.  Reshaped Wirtinger Flow for Solving Quadratic System of Equations , 2016, NIPS.

[19]  Volkan Cevher,et al.  Sparse Signal Recovery Using Markov Random Fields , 2008, NIPS.

[20]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[21]  Sundeep Rangan,et al.  Compressive phase retrieval via generalized approximate message passing , 2012, Allerton Conference.

[22]  Allen Y. Yang,et al.  CPRL -- An Extension of Compressive Sensing to the Phase Retrieval Problem , 2012, NIPS.

[23]  Yonina C. Eldar,et al.  GESPAR: Efficient Phase Retrieval of Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[24]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[25]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, ISIT.

[26]  Richard Baraniuk,et al.  Recovery of Clustered Sparse Signals from Compressive Measurements , 2009 .

[27]  Piotr Indyk,et al.  A Nearly-Linear Time Framework for Graph-Structured Sparsity , 2015, ICML.

[28]  Junzhou Huang,et al.  Learning with structured sparsity , 2009, ICML '09.

[29]  Xiaodong Li,et al.  Optimal Rates of Convergence for Noisy Sparse Phase Retrieval via Thresholded Wirtinger Flow , 2015, ArXiv.

[30]  Justin K. Romberg,et al.  Efficient Compressive Phase Retrieval with Constrained Sensing Vectors , 2015, NIPS.

[31]  Piotr Indyk,et al.  A fast approximation algorithm for tree-sparse recovery , 2014, 2014 IEEE International Symposium on Information Theory.

[32]  V. Bentkus An Inequality for Tail Probabilities of Martingales with Differences Bounded from One Side , 2003 .

[33]  Mahdi Soltanolkotabi,et al.  Structured Signal Recovery From Quadratic Measurements: Breaking Sample Complexity Barriers via Nonconvex Optimization , 2017, IEEE Transactions on Information Theory.

[34]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[35]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[36]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[37]  Zhang Fe Phase retrieval from coded diffraction patterns , 2015 .

[38]  Andrea J. Goldsmith,et al.  Exact and Stable Covariance Estimation From Quadratic Sampling via Convex Programming , 2013, IEEE Transactions on Information Theory.

[39]  Kannan Ramchandran,et al.  Compressed sensing using sparse-graph codes for the continuous-alphabet setting , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[40]  Felix Krahmer,et al.  Improved Recovery Guarantees for Phase Retrieval from Coded Diffraction Patterns , 2014, arXiv.org.

[41]  Deanna Needell,et al.  Greedy signal recovery review , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[42]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[43]  Ke Wei Solving systems of phaseless equations via Kaczmarz methods: a proof of concept study , 2015 .

[44]  Gang Wang,et al.  Sparse Phase Retrieval via Truncated Amplitude Flow , 2016, IEEE Transactions on Signal Processing.

[45]  Stefano Marchesini,et al.  Phase retrieval and saddle-point optimization. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[47]  David P. Woodruff,et al.  Lower bounds for sparse recovery , 2010, SODA '10.

[48]  Yonina C. Eldar,et al.  Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow , 2016, IEEE Transactions on Information Theory.

[49]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[50]  Volkan Cevher,et al.  Recovery of compressible signals in unions of subspaces , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[51]  Babak Hassibi,et al.  Sparse phase retrieval: Convex algorithms and limitations , 2013, 2013 IEEE International Symposium on Information Theory.

[52]  P. Massart,et al.  Adaptive estimation of a quadratic functional by model selection , 2000 .

[53]  J. Miao,et al.  Extending X-ray crystallography to allow the imaging of noncrystalline materials, cells, and single protein complexes. , 2008, Annual review of physical chemistry.

[54]  Piotr Indyk,et al.  Nearly Linear-Time Model-Based Compressive Sensing , 2014, ICALP.

[55]  Kannan Ramchandran,et al.  PhaseCode: Fast and Efficient Compressive Phase Retrieval Based on Sparse-Graph Codes , 2017, IEEE Transactions on Information Theory.

[56]  Xiaodong Li,et al.  Sparse Signal Recovery from Quadratic Measurements via Convex Programming , 2012, SIAM J. Math. Anal..

[57]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[58]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[59]  Sjoerd Dirksen,et al.  Tail bounds via generic chaining , 2013, ArXiv.

[60]  Prateek Jain,et al.  Phase Retrieval Using Alternating Minimization , 2013, IEEE Transactions on Signal Processing.

[61]  Yang Wang,et al.  Phase retrieval from very few measurements , 2013, ArXiv.