Solving large-scale systems of random quadratic equations via stochastic truncated amplitude flow

This work develops a new iterative algorithm, which is called stochastic truncated amplitude flow (STAF), to recover an unknown signal × ∊ R<sup>n</sup> from m "phaseless" quadratic equations of the form ψ<inf>1</inf>=|a<sup>τ</sup><inf>i</inf> x|, 1 ≤ i ≤ m. This problem is also known as phase retrieval, which is NP-hard in general. Building on an amplitude-based nonconvex least-squares formulation, STAF proceeds in two stages: s1) Orthogonality-promoting initialization computed using a stochastic variance reduced gradient algorithm; and, s2) Refinements of the initial point through truncated stochastic gradient-type iterations. Both stages handle a single equation per iteration, therefore lending STAF well to Big Data applications. Specifically for independent Gaussian {a<inf>i</inf>}<sup>m</sup><inf>i=1</inf> vectors, STAF recovers exactly any x exponentially fast when there are about as many equations as unknowns. Finally, numerical tests demonstrate that STAF improves upon its competing alternatives.

[1]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[2]  R. Balan,et al.  On signal reconstruction without phase , 2006 .

[3]  Prabhu Babu,et al.  PRIME: Phase Retrieval via Majorization-Minimization , 2015, IEEE Transactions on Signal Processing.

[4]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[5]  Tong Zhang,et al.  Accelerating Stochastic Gradient Descent using Predictive Variance Reduction , 2013, NIPS.

[6]  Panos M. Pardalos,et al.  Quadratic programming with one negative eigenvalue is NP-hard , 1991, J. Glob. Optim..

[7]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[8]  Gang Wang,et al.  Solving Almost all Systems of Random Quadratic Equations , 2017, NIPS 2017.

[9]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[10]  Gang Wang,et al.  Sparse Phase Retrieval via Truncated Amplitude Flow , 2016, IEEE Transactions on Signal Processing.

[11]  Yonina C. Eldar,et al.  GESPAR: Efficient Phase Retrieval of Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[12]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[13]  Ohad Shamir,et al.  Fast Stochastic Algorithms for SVD and PCA: Convergence Properties and Convexity , 2015, ICML.

[14]  Gang Wang,et al.  Solving large-scale systems of random quadratic equations via stochastic truncated amplitude flow , 2016, 2017 25th European Signal Processing Conference (EUSIPCO).

[15]  Yonina C. Eldar,et al.  Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow , 2016, IEEE Transactions on Information Theory.

[16]  Prateek Jain,et al.  Phase Retrieval Using Alternating Minimization , 2013, IEEE Transactions on Signal Processing.