The global landscape of phase retrieval I: perturbed amplitude models

A fundamental task in phase retrieval is to recover an unknown signal x ∈ R from a set of magnitude-only measurements yi = |〈ai,x〉|, i = 1, . . . ,m. In this paper, we propose two novel perturbed amplitude models (PAMs) which have non-convex and quadratic-type loss function. When the measurements ai ∈ R n are Gaussian random vectors and the number of measurements m ≥ Cn, we rigorously prove that the PAMs admit no spurious local minimizers with high probability, i.e., the target solution x is the unique global minimizer (up to a global phase) and the loss function has a negative directional curvature around each saddle point. Thanks to the well-tamed benign geometric landscape, one can employ the vanilla gradient descent method to locate the global minimizer x (up to a global phase) without spectral initialization. We carry out extensive numerical experiments to show that the gradient descent algorithm with random initialization outperforms state-of-the-art algorithms with spectral initialization in empirical success rate and convergence speed.

[1]  John Wright,et al.  A Geometric Analysis of Phase Retrieval , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[2]  Xiaodong Li,et al.  Solving Quadratic Equations via PhaseLift When There Are About as Many Equations as Unknowns , 2012, Found. Comput. Math..

[3]  Yang Wang,et al.  Perturbed Amplitude Flow for Phase Retrieval , 2020, IEEE Transactions on Signal Processing.

[4]  Michael I. Jordan,et al.  How to Escape Saddle Points Efficiently , 2017, ICML.

[5]  A. Walther The Question of Phase Retrieval in Optics , 1963 .

[6]  Bing Gao,et al.  Phaseless Recovery Using the Gauss–Newton Method , 2016, IEEE Transactions on Signal Processing.

[7]  Jian-Feng Cai,et al.  Toward the Optimal Construction of a Loss Function Without Spurious Local Minima for Solving Quadratic Equations , 2018, IEEE Transactions on Information Theory.

[8]  J. Miao,et al.  Extending X-ray crystallography to allow the imaging of noncrystalline materials, cells, and single protein complexes. , 2008, Annual review of physical chemistry.

[9]  Yingbin Liang,et al.  A Nonconvex Approach for Phase Retrieval: Reshaped Wirtinger Flow and Incremental Algorithms , 2017, J. Mach. Learn. Res..

[10]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[11]  Yan Shuo Tan,et al.  Phase Retrieval via Randomized Kaczmarz: Theoretical Guarantees , 2017, ArXiv.

[12]  Prateek Jain,et al.  Phase Retrieval Using Alternating Minimization , 2013, IEEE Transactions on Signal Processing.

[13]  C. Sinan Güntürk,et al.  Convergence of the randomized Kaczmarz method for phase retrieval , 2017, ArXiv.

[14]  John Wright,et al.  Complete Dictionary Recovery Over the Sphere I: Overview and the Geometric Picture , 2015, IEEE Transactions on Information Theory.

[15]  Furong Huang,et al.  Escaping From Saddle Points - Online Stochastic Gradient for Tensor Decomposition , 2015, COLT.

[16]  Yang Wang,et al.  Linear convergence of randomized Kaczmarz method for solving complex-valued phaseless equations , 2021, SIAM J. Imaging Sci..

[17]  H. Sahinoglou,et al.  On phase retrieval of finite-length sequences using the initial time sample , 1991 .

[18]  Yang Wang,et al.  Solving phase retrieval with random initial guess is nearly as good as by spectral initialization , 2021, Applied and Computational Harmonic Analysis.

[19]  Tengyu Ma,et al.  Matrix Completion has No Spurious Local Minimum , 2016, NIPS.

[20]  Nathan Srebro,et al.  Global Optimality of Local Search for Low Rank Matrix Recovery , 2016, NIPS.

[21]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[22]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[23]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[24]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[25]  Robert W. Harrison,et al.  Phase problem in crystallography , 1993 .

[26]  Yonina C. Eldar,et al.  Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow , 2016, IEEE Transactions on Information Theory.

[27]  Michael I. Jordan,et al.  Gradient Descent Can Take Exponential Time to Escape Saddle Points , 2017, NIPS.

[28]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[29]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[30]  Michael I. Jordan,et al.  Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent , 2017, COLT.

[31]  O. Papaspiliopoulos High-Dimensional Probability: An Introduction with Applications in Data Science , 2020 .

[32]  Rick P. Millane,et al.  Phase retrieval in crystallography and optics , 1990 .

[33]  Meng Huang,et al.  On DC based Methods for Phase Retrieval , 2018, Springer Proceedings in Mathematics & Statistics.

[34]  Ke Wei Solving systems of phaseless equations via Kaczmarz methods: a proof of concept study , 2015 .

[35]  Anastasios Kyrillidis,et al.  Non-square matrix sensing without spurious local minima via the Burer-Monteiro approach , 2016, AISTATS.