Geometrical properties and accelerated gradient solvers of non-convex phase retrieval

We consider recovering a signal x ∈ ℝn from the magnitudes of Gaussian measurements by minimizing a second order yet non-smooth loss function. By exploiting existing concentration results of the loss function, we show that the non-convex loss function satisfies several quadratic geometrical properties. Based on these geometrical properties, we characterize the linear convergence of the sequence of function graph generated by the gradient flow on minimizing the loss function. Furthermore, we propose an accelerated version of the gradient flow, and establish an in-exact linear convergence of the generated sequence of function graph by exploiting the quadratic geometries of the loss function. Then, we verify the numerical advantages of the proposed algorithms over other state-of-art algorithms.

[1]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[2]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[3]  Ke Wei Solving systems of phaseless equations via Kaczmarz methods: a proof of concept study , 2015 .

[4]  Boris Polyak Gradient methods for the minimisation of functionals , 1963 .

[5]  Hui Zhang,et al.  Restricted strong convexity and its applications to convergence analysis of gradient-type methods in convex optimization , 2015, Optim. Lett..

[6]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[7]  Mark W. Schmidt,et al.  Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition , 2016, ECML/PKDD.

[8]  Xiaodong Li,et al.  Optimal Rates of Convergence for Noisy Sparse Phase Retrieval via Thresholded Wirtinger Flow , 2015, ArXiv.

[9]  Jieping Ye,et al.  Linear Convergence of Variance-Reduced Projected Stochastic Gradient without Strong Convexity , 2014, ArXiv.

[10]  Yingbin Liang,et al.  Provable Non-convex Phase Retrieval with Outliers: Median TruncatedWirtinger Flow , 2016, ICML.

[11]  John Wright,et al.  A Geometric Analysis of Phase Retrieval , 2016, International Symposium on Information Theory.

[12]  Yingbin Liang,et al.  Reshaped Wirtinger Flow for Solving Quadratic System of Equations , 2016, NIPS.

[13]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[14]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[15]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[16]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[17]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[18]  G. Papanicolaou,et al.  Array imaging using intensity-only measurements , 2010 .

[19]  Prateek Jain,et al.  Phase Retrieval Using Alternating Minimization , 2013, IEEE Transactions on Signal Processing.

[20]  Hui Zhang,et al.  The restricted strong convexity revisited: analysis of equivalence to error bound and quadratic growth , 2015, Optim. Lett..

[21]  Felix Krahmer,et al.  Improved Recovery Guarantees for Phase Retrieval from Coded Diffraction Patterns , 2014, arXiv.org.

[22]  Stephen J. Wright,et al.  Asynchronous Stochastic Coordinate Descent: Parallelism and Convergence Properties , 2014, SIAM J. Optim..