Image restoration of optical sparse aperture systems based on a dual target network

Abstract Optical sparse aperture (OSA) systems show great potential for the next generation astronomical telescope system due to its excellent high resolution with low volume and weight. However, the sparse arrangement causes its mid-frequency modulation transfer function to be lower compared with a single fully-filled aperture system, which further leads to blurred images and reduced contrast. Therefore, image restoration becomes an indispensable part for OSA systems. In this paper, a dual target network (DTN) is proposed for the image restoration of OSA systems. The noise in a raw image is estimated with interpolation and difference calculation. A block matching 3D filter is used as a denoiser. A denoised image is regarded as a degraded image which cannot be accurately modeled. To cope with the restoration problem, a dual target (negative structural similarity and the sum of fidelity and regularization term) network is trained. A function determined by the filling factor and the aperture distribution is trained as a correction term of the network. The trained network is used to deconvolve the denoised image. Simulation and experiment results show that the proposed method has good peak signal-to-noise ratio and structure similarity. For a Golay-6 system with a filling factor of 0.3245, when the signal-to-noise ratio is 30 dB, the DTN method increases the average peak signal to noise ratio from 22.6 dB to 31.7 dB and improves the average structural similarity from 0.77 to 0.90.

[1]  Zhichao Dong,et al.  Wide-band white light sparse-aperture Fizeau imaging interferometer testbed for a distributed small-satellites constellation. , 2018, Applied optics.

[2]  Michael K. Ng,et al.  Iterative Algorithms Based on Decoupling of Deblurring and Denoising for Image Restoration , 2008, SIAM J. Sci. Comput..

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  James H Burge,et al.  Optical design of interferometric telescopes with wide fields of view. , 2006, Applied optics.

[5]  Aden B. Meinel Cost Scaling Laws Applicable To Very Large Optical Telescopes , 1979, Other Conferences.

[6]  Antonin Bouchez,et al.  Giant Magellan Telescope: overview , 2012, Other Conferences.

[7]  Jun Wang,et al.  The research of filtering on images with noises of the three-mirror aperture optical system , 2014, Photonics Asia.

[8]  Ge Ren,et al.  Active sparse aperture imaging using independent transmitter modulation with improved incoherent Fourier ptychographic algorithm. , 2017, Optics express.

[9]  Zhiwei Zhou,et al.  Effect of noise on the performance of image restoration in an optical sparse aperture system , 2011 .

[10]  Zhengwei Shen,et al.  Iterative Adaptive Nonconvex Low-Rank Tensor Approximation to Image Restoration Based on ADMM , 2018, Journal of Mathematical Imaging and Vision.

[11]  James R. Fienup,et al.  Comparison of reconstruction algorithms for images from sparse-aperture systems , 2002, SPIE Optics + Photonics.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Yiping Xu,et al.  A Combination Algorithm for Image Denoising and Deblurring , 2010, International Conference on Wireless Communications, Networking and Mobile Computing.

[14]  Ting-Zhu Huang,et al.  An alternating iterative algorithm for image deblurring and denoising problems , 2014, Commun. Nonlinear Sci. Numer. Simul..

[15]  E. Huggins Introduction to Fourier Optics , 2007 .

[16]  Yuejin Zhao,et al.  Image restoration for synthetic aperture systems with a non-blind deconvolution algorithm via a deep convolutional neural network. , 2020, Optics express.

[17]  Markus Schöller,et al.  The Very Large Telescope Interferometer: Current facility and prospects , 2007 .

[18]  Yuewei Liu,et al.  A robust iterative algorithm for image restoration , 2017, EURASIP Journal on Image and Video Processing.

[19]  Bradley D Duncan,et al.  Improving mid-frequency contrast in sparse aperture optical imaging systems based upon the Golay-9 array. , 2010, Optics express.

[20]  Hao Chen,et al.  Image restoration via improved Wiener filter applied to optical sparse aperture systems , 2017 .

[21]  Yuesong Jiang,et al.  Noise Analysis and Image Restoration for Optical Sparse Aperture Systems , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[22]  Jonathan W. Arenberg,et al.  Stray light performance for the James Webb Space Telescope , 2014, Astronomical Telescopes and Instrumentation.

[23]  Allen J. Bronowicki Vibration Isolator for Large Space Telescopes , 2006 .

[24]  Dayong Wang,et al.  Wide-field imaging design and image restoration with optical sparse-aperture system , 2006, International Symposium on Advanced Optical Manufacturing and Testing Technologies (AOMATT).

[25]  Ge Ren,et al.  Adaptive piston correction of sparse aperture systems with stochastic parallel gradient descent algorithm. , 2018, Optics express.

[26]  Ji Han,et al.  Experimental study on imaging and image restoration of optical sparse aperture systems , 2007 .

[27]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[28]  Nicholas J Miller,et al.  Optical sparse aperture imaging. , 2007, Applied optics.

[29]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Chenghao Zhou,et al.  Mid-frequency MTF compensation of optical sparse aperture system. , 2018, Optics express.

[31]  Jong-Ki Han,et al.  PSNR estimation scheme using coefficient distribution of frequency domain in H.264 decoder , 2008 .

[32]  Qianshun Chang,et al.  A robust and fast combination algorithm for deblurring and denoising , 2015, Signal Image Video Process..