Phase Retrieval Using Feasible Point Pursuit: Algorithms and Cramér–Rao Bound

Reconstructing a signal from squared linear (rank-1 quadratic) measurements is a challenging problem with important applications in optics and imaging, where it is known as phase retrieval. This paper proposes two new phase retrieval algorithms based on nonconvex quadratically constrained quadratic programming) formulations, and a recently proposed approximation technique dubbed feasible point pursuit (FPP). The first is designed for uniformly distributed bounded measurement errors, such as those arising from high-rate quantization (B-FPP). The second is designed for Gaussian measurement errors, using a least-squares criterion (LS-FPP). Their performance is measured against state-of-the-art algorithms and the Cramér-Rao bound (CRB), which is also derived here. Simulations show that LS-FPP outperforms the existing schemes and operates close to the CRB. Compact CRB expressions, properties, and insights are obtained by explicitly computing the CRB in various special cases-including when the signal of interest admits a sparse parametrization, using harmonic retrieval as an example.

[1]  Ananthram Swami,et al.  Cramer-Rao bounds for deterministic signals in additive and multiplicative noise , 1996, Signal Process..

[2]  Yoram Bresler,et al.  The stability of nonlinear least squares problems and the Cramer-Rao bound , 2000, IEEE Trans. Signal Process..

[3]  C. C. Wackerman,et al.  Phase-retrieval error: a lower bound , 1987 .

[4]  B. AfeArd CALCULATING THE SINGULAR VALUES AND PSEUDOINVERSE OF A MATRIX , 2022 .

[5]  Radu Balan,et al.  The fisher information matrix and the CRLB in a non-AWGN model for the phase retrieval problem , 2015, 2015 International Conference on Sampling Theory and Applications (SampTA).

[6]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[7]  Francisco Facchinei,et al.  Parallel and distributed methods for nonconvex optimization , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[9]  M. Kupperman Linear Statistical Inference and Its Applications 2nd Edition (C. Radhakrishna Rao) , 1975 .

[10]  Alfred O. Hero,et al.  Exploring estimator bias-variance tradeoffs using the uniform CR bound , 1996, IEEE Trans. Signal Process..

[11]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[12]  Robert J. Vanderbei,et al.  An Interior-Point Method for Semidefinite Programming , 1996, SIAM J. Optim..

[13]  Francisco Facchinei,et al.  Parallel and Distributed Methods for Constrained Nonconvex Optimization—Part I: Theory , 2016, IEEE Transactions on Signal Processing.

[14]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[15]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[16]  Meisam Razaviyayn,et al.  Successive Convex Approximation: Analysis and Applications , 2014 .

[17]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[18]  J. Rodenburg,et al.  Wave-front phase retrieval in transmission electron microscopy via ptychography , 2010 .

[19]  Radu Balan,et al.  Reconstruction of Signals from Magnitudes of Redundant Representations: The Complex Case , 2012, Found. Comput. Math..

[20]  O. Bunk,et al.  Diffractive imaging for periodic samples: retrieving one-dimensional concentration profiles across microfluidic channels. , 2007, Acta crystallographica. Section A, Foundations of crystallography.

[21]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[22]  Gang Wang,et al.  Solving Random Systems of Quadratic Equations via Truncated Generalized Gradient Flow , 2016, NIPS.

[23]  O. Bunk,et al.  Phase retrieval and differential phase-contrast imaging with low-brilliance X-ray sources , 2006 .

[24]  Yonina C. Eldar,et al.  Non-Coherent Direction of Arrival Estimation from Magnitude-Only Measurements , 2015, IEEE Signal Processing Letters.

[25]  Zhi-Quan Luo,et al.  A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization , 2012, SIAM J. Optim..

[26]  Moritz Diehl,et al.  Sequential Convex Programming Methods for Solving Nonlinear Optimization Problems with DC constraints , 2011 .

[27]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[28]  Nikolaos D. Sidiropoulos,et al.  Putting nonnegative matrix factorization to the test: a tutorial derivation of pertinent cramer—rao bounds and performance benchmarking , 2014, IEEE Signal Processing Magazine.

[29]  Gene H. Golub,et al.  Calculating the singular values and pseudo-inverse of a matrix , 2007, Milestones in Matrix Computation.

[30]  J. Miao,et al.  Extending X-ray crystallography to allow the imaging of noncrystalline materials, cells, and single protein complexes. , 2008, Annual review of physical chemistry.

[31]  Nikos D. Sidiropoulos,et al.  Least squares phase retrieval using feasible point pursuit , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[33]  Robert W. Harrison,et al.  Phase problem in crystallography , 1993 .

[34]  Nikos D. Sidiropoulos,et al.  Feasible Point Pursuit and Successive Approximation of Non-Convex QCQPs , 2014, IEEE Signal Processing Letters.

[35]  H. V. Trees,et al.  Exploring Estimator BiasVariance Tradeoffs Using the Uniform CR Bound , 2007 .

[36]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[37]  Francisco Facchinei,et al.  Parallel and Distributed Methods for Nonconvex Optimization-Part I: Theory , 2014 .

[38]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[39]  Stephen P. Boyd,et al.  Variations and extension of the convex–concave procedure , 2016 .

[40]  Dustin G. Mixon,et al.  Saving phase: Injectivity and stability for phase retrieval , 2013, 1302.4618.

[41]  Zhi-Quan Luo,et al.  Semidefinite Relaxation of Quadratic Optimization Problems , 2010, IEEE Signal Processing Magazine.

[42]  H. Sahinoglou,et al.  On phase retrieval of finite-length sequences using the initial time sample , 1991 .

[43]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.