Phase Retrieval Using Alternating Minimization

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of Gerchberg and Saxton and Fienup is still the popular choice for solving many variants of this problem. The algorithm is based on alternating minimization; i.e., it alternates between estimating the missing phase information, and the candidate solution. Despite its wide usage in practice, no global convergence guarantees for this algorithm are known. In this paper, we show that a (resampling) variant of this approach converges geometrically to the solution of one such problem-finding a vector x from y, A, where y = |ATx| and |z| denotes a vector of element-wise magnitudes of z-under the assumption that A is Gaussian. Empirically, we demonstrate that alternating minimization performs similar to recently proposed convex techniques for this problem (which are based on “lifting” to a convex matrix problem) in sample complexity and robustness to noise. However, it is much more efficient and can scale to large problems. Analytically, for a resampling version of alternating minimization, we show geometric convergence to the solution, and sample complexity that is off by log factors from obvious lower bounds. We also establish close to optimal scaling for the case when the unknown vector is sparse. Our work represents the first theoretical guarantee for alternating minimization (albeit with resampling) for any variant of phase retrieval problems in the non-convex setting.

[1]  D. Gabor A New Microscopic Principle , 1948, Nature.

[2]  E. Leith,et al.  Reconstructed Wavefronts and Communication Theory , 1962 .

[3]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[4]  D. L. Misell Comment onA method for the solution of the phase problem in electron microscopy , 1973 .

[5]  L. G. Sodin,et al.  On the ambiguity of the image reconstruction problem , 1979 .

[6]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[7]  M. Hayes The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform , 1982 .

[8]  D. Youla,et al.  Image Restoration by the Method of Convex Projections: Part 1ߞTheory , 1982, IEEE Transactions on Medical Imaging.

[9]  H. Trussell,et al.  The feasible solution in signal restoration , 1984 .

[10]  J. Sanz Mathematical Considerations for the Problem of Fourier Transform Phase Retrieval from Magnitude , 1985 .

[11]  N. Hurt Phase Retrieval and Zero Crossings: Mathematical Methods in Image Reconstruction , 1989 .

[12]  Rick P. Millane,et al.  Phase retrieval in crystallography and optics , 1990 .

[13]  W. F. Ames,et al.  Phase retrieval and zero crossings (Mathematical methods in image reconstruction) , 1990 .

[14]  J. H. Seldin,et al.  Hubble Space Telescope characterized by using phase-retrieval algorithms. , 1993, Applied optics.

[15]  J. Abrahams,et al.  Methods used in the structure determination of bovine mitochondrial F1 ATPase. , 1996, Acta crystallographica. Section D, Biological crystallography.

[16]  G. Lorentz,et al.  Constructive approximation : advanced problems , 1996 .

[17]  J. Miao,et al.  Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens , 1999, Nature.

[18]  J. Miao,et al.  High resolution 3D x-ray diffraction microscopy. , 2002, Physical review letters.

[19]  Veit Elser Phase retrieval by iterated projections. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Heinz H. Bauschke,et al.  Hybrid projection-reflection method for phase retrieval. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[22]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[23]  S. Marchesini,et al.  Invited article: a [corrected] unified evaluation of iterative projection algorithms for phase retrieval. , 2006, The Review of scientific instruments.

[24]  Stefano Marchesini,et al.  Phase retrieval and saddle-point optimization. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  S Marchesini,et al.  Invited article: a [corrected] unified evaluation of iterative projection algorithms for phase retrieval. , 2006, The Review of scientific instruments.

[26]  Haesun Park,et al.  Sparse Nonnegative Matrix Factorization for Clustering , 2008 .

[27]  Hyunsoo Kim,et al.  Nonnegative Matrix Factorization Based on Alternating Nonnegativity Constrained Least Squares and Active Set Method , 2008, SIAM J. Matrix Anal. Appl..

[28]  Andrea Montanari,et al.  Matrix Completion from Noisy Entries , 2009, J. Mach. Learn. Res..

[29]  Wenbo V. Li,et al.  Gaussian integrals involving absolute value functions , 2009 .

[30]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[31]  G. Papanicolaou,et al.  Array imaging using intensity-only measurements , 2010 .

[32]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[33]  Hamootal Duadi,et al.  Digital Holography and Phase Retrieval , 2011 .

[34]  Yonina C. Eldar,et al.  Sparsity Based Sub-wavelength Imaging with Partially Incoherent Light via Quadratic Compressed Sensing References and Links , 2022 .

[35]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[36]  S. Sastry,et al.  Compressive Phase Retrieval From Squared Output Measurements Via Semidefinite Programming , 2011, 1111.6323.

[37]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[38]  Raghunandan H. Keshavan Efficient algorithms for collaborative filtering , 2012 .

[39]  Babak Hassibi,et al.  Recovery of sparse 1-D signals from the magnitudes of their Fourier transform , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[40]  Inderjit S. Dhillon,et al.  Low rank modeling of signed networks , 2012, KDD.

[41]  Yonina C. Eldar,et al.  Phase Retrieval: Stability and Recovery Guarantees , 2012, ArXiv.

[42]  Xiaodong Li,et al.  Phase Retrieval from Coded Diffraction Patterns , 2013, 1310.3240.

[43]  Felix Krahmer,et al.  A Partial Derandomization of PhaseLift Using Spherical Designs , 2013, Journal of Fourier Analysis and Applications.

[44]  J. Miao,et al.  Erratum: High Resolution 3D X-Ray Diffraction Microscopy [Phys. Rev. Lett.89, 088303 (2002)] , 2013 .

[45]  Xiaodong Li,et al.  Sparse Signal Recovery from Quadratic Measurements via Convex Programming , 2012, SIAM J. Math. Anal..

[46]  Prateek Jain,et al.  Low-rank matrix completion using alternating minimization , 2012, STOC '13.

[47]  Prateek Jain,et al.  Non-convex Robust PCA , 2014, NIPS.

[48]  Xiaodong Li,et al.  Solving Quadratic Equations via PhaseLift When There Are About as Many Equations as Unknowns , 2012, Found. Comput. Math..

[49]  Moritz Hardt,et al.  Understanding Alternating Minimization for Matrix Completion , 2013, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[50]  Yonina C. Eldar,et al.  GESPAR: Efficient Phase Retrieval of Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[51]  Prateek Jain,et al.  Fast Exact Matrix Completion with Finite Samples , 2014, COLT.

[52]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[53]  Yonina C. Eldar,et al.  Simultaneously Structured Models With Application to Sparse and Low-Rank Matrices , 2012, IEEE Transactions on Information Theory.

[54]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[55]  Qionghai Dai,et al.  Fourier ptychographic reconstruction using Wirtinger flow optimization. , 2014, Optics express.

[56]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[57]  Prateek Jain,et al.  Learning Sparsely Used Overcomplete Dictionaries via Alternating Minimization , 2013, SIAM J. Optim..