Transfer orthogonal sparsifying transform learning for phase retrieval

Abstract The phase retrieval (PR) problem of recovering an image from its Fourier magnitudes is an important issue. Several PR algorithms have been proposed to address this problem. Recent efforts of exploiting sparsity were developed to improve the performance of PR algorithms, such as the reconstruction quality, robustness to noise, and convergence behavior. In this paper, we propose a novel sparsity-based algorithm, which can adaptively learn an orthogonal sparsifying transform, and reconstruct the image simultaneously from the Fourier magnitudes. However, the estimated images at the early iterations are extremely bad. Training samples from these images cannot provide much useful information for sparsifying transform learning. To avoid unnecessary updating, an orthogonal sparsifying transform learning method based on transfer learning is proposed. Through transfer learning, we transfer the fixed sparsifying transform to an adaptive one. We apply this new sparsifying transform learning method to PR, and exploit the alternating directions method of multipliers (ADMM) technique to solve the formulated problem. Since the learnt sparsifying transform is adaptive to data, it favors better sparsity. Using this learnt sparsifying transform for image reconstruction can improve the reconstruction quality at low oversampling ratios. Experimental results show that the proposed PR algorithm can improve nearly 6 dB compared with the recently proposed PR-TIHP- l 1 algorithm in terms of the average PSNR (Peak Signal to Noise Ratio) at oversampling ratio 2.47, 2.53, 2.59. Moreover, our algorithm is robust to noise and has better convergence behavior heuristically.

[1]  J R Fienup,et al.  Reconstruction of an object from the modulus of its Fourier transform. , 1978, Optics letters.

[2]  Yonina C. Eldar,et al.  Dictionary learning from phaseless measurements , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Kedar Khare,et al.  Sparsity assisted solution to the twin image problem in phase retrieval , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Thomas Blumensath,et al.  Compressed Sensing With Nonlinear Observations and Related Nonlinear Optimization Problems , 2012, IEEE Transactions on Information Theory.

[5]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[6]  Allen Y. Yang,et al.  Nonlinear basis pursuit , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[7]  M. Valipour,et al.  Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir , 2013 .

[8]  Xiaoli Ma,et al.  Eigenvector-based initial ranging process for OFDMA uplink systems , 2015, EURASIP Journal on Advances in Signal Processing.

[9]  J. Miao,et al.  Oversampling smoothness: an effective algorithm for phase retrieval of noisy diffraction intensities. , 2012, Journal of applied crystallography.

[10]  Emmanuel J. Candès,et al.  PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming , 2011, ArXiv.

[11]  Shuzhen Chen,et al.  Sparse representation utilizing tight frame for phase retrieval , 2015, EURASIP J. Adv. Signal Process..

[12]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[13]  J. Miao,et al.  Phase retrieval from the magnitude of the Fourier transforms of nonperiodic objects , 1998 .

[14]  Yoram Bresler,et al.  Efficient Blind Compressed Sensing Using Sparsifying Transforms with Convergence Guarantees and Application to Magnetic Resonance Imaging , 2015, SIAM J. Imaging Sci..

[15]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[16]  Qionghai Dai,et al.  Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient , 2016, Scientific Reports.

[17]  R. Glowinski,et al.  Numerical Methods for Nonlinear Variational Problems , 1985 .

[18]  Mohammad Valipour,et al.  Sprinkle and Trickle Irrigation System Design Using Tapered Pipes for Pressure Loss Adjusting , 2012 .

[19]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[20]  Mohammad Valipour,et al.  Simulation of open- and closed-end border irrigation systems using SIRMOD , 2015 .

[21]  D. R. Luke Relaxed averaged alternating reflections for diffraction imaging , 2004, math/0405208.

[22]  Yuxin Chen,et al.  Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems , 2015, NIPS.

[23]  Yonina C. Eldar,et al.  Phase Retrieval with Application to Optical Imaging: A contemporary overview , 2015, IEEE Signal Processing Magazine.

[24]  R. Glowinski Lectures on Numerical Methods for Non-Linear Variational Problems , 1981 .

[25]  Chao Yang,et al.  Alternating direction methods for classical and ptychographic phase retrieval , 2012 .

[26]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[27]  Alexandre d'Aspremont,et al.  Phase recovery, MaxCut and complex semidefinite programming , 2012, Math. Program..

[28]  Yonina C. Eldar,et al.  Phase Retrieval: An Overview of Recent Developments , 2015, ArXiv.

[29]  M. Valipour Optimization of neural networks for precipitation analysis in a humid region to detect drought and wet year alarms , 2016 .

[30]  Xiaodong Li,et al.  Phase Retrieval via Wirtinger Flow: Theory and Algorithms , 2014, IEEE Transactions on Information Theory.

[31]  Guanzheng Tan,et al.  Nonlinear compressed sensing based on composite mappings and its pointwise linearization , 2015, ArXiv.

[32]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[33]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[34]  Gang Chen,et al.  Dictionary transfer for image denoising via domain adaptation , 2012, 2012 19th IEEE International Conference on Image Processing.

[35]  Rick P. Millane,et al.  Phase retrieval in crystallography and optics , 1990 .

[36]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[37]  Zhang Fe Phase retrieval from coded diffraction patterns , 2015 .

[38]  Chandra Sekhar Seelamantula,et al.  Fienup Algorithm With Sparsity Constraints: Application to Frequency-Domain Optical-Coherence Tomography , 2014, IEEE Transactions on Signal Processing.

[39]  Mohammad Ali Gholami Sefidkouhi,et al.  Surface irrigation simulation models: a review , 2015 .

[40]  Cishen Zhang,et al.  Robust Compressive Phase Retrieval via L1 Minimization With Application to Image Reconstruction , 2013, ArXiv.

[41]  Yonina C. Eldar,et al.  Phase Retrieval via Matrix Completion , 2011, SIAM Rev..

[42]  Shi Liu,et al.  Iterative phase retrieval algorithms. I: optimization. , 2015, Applied optics.

[43]  Gerlind Plonka,et al.  Phase retrieval for Fresnel measurements using a shearlet sparsity constraint , 2014 .

[44]  Shuzhen Chen,et al.  Compressed sensing magnetic resonance imaging based on dictionary updating and block-matching and three-dimensional filtering regularisation , 2016, IET Image Process..

[45]  Veit Elser Phase retrieval by iterated projections. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[46]  Yoram Bresler,et al.  Learning overcomplete sparsifying transforms with block cosparsity , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[47]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[48]  Shun Qin,et al.  Compressed sensing phase retrieval with phase diversity , 2014 .