Cubic convolution for super-resolution from microscanned images

This paper presents a computationally efficient method for super-resolution reconstruction and restoration from microscanned images. Microscanning creates multiple low-resolution images with slightly varying sample-scene phase shifts. Microscanning can be implemented with a physical microscanner built into specialized imaging systems or by simply panning and/or tilting traditional imaging systems to acquire a temporal sequence of images. Digital processing can combine the low-resolution images to produce an image with higher pixel resolution (i.e., super-resolution) and higher fidelity. The cubic convolution method developed in this paper employs one-pass, small-kernel convolution to perform reconstruction (increasing resolution) and restoration (improving fidelity). The approach is based on an end-to-end, continuous-discrete-continuous model of the microscanning imaging process. The derivation yields a parametric form that can be optimized for the characteristics of the scene and the imaging system. Because cubic convolution is constrained to a small spatial kernel, the approach is efficient and is amenable to adaptive processing and to parallel implementation. Experimental results with simulated imaging and with real microscanned images indicate that the cubic convolution method efficiently and effectively increases resolution and fidelity for significantly improved image quality.

[1]  Thierry Blu,et al.  MOMS: maximal-order interpolation of minimal support , 2001, IEEE Trans. Image Process..

[2]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[3]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[4]  E. H. Linfoot Transmission factors and optical design , 1956 .

[5]  F. O. Huck,et al.  Wiener restoration of sampled image data: end-to-end analysis , 1988 .

[6]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[7]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[8]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[9]  Robert A. Schowengerdt,et al.  Image reconstruction by parametric cubic convolution , 1982, Comput. Graph. Image Process..

[10]  Stephen E. Reichenbach,et al.  Two-dimensional cubic convolution for one-pass image restoration and reconstruction , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[12]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[13]  Euncheol Choi,et al.  Super‐resolution approach to overcome physical limitations of imaging sensors: An overview , 2004, Int. J. Imaging Syst. Technol..

[14]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[15]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[16]  Cris L. Luengo Hendriks,et al.  Improving resolution to reduce aliasing in an undersampled image sequence , 2000 .

[17]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[18]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[19]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[20]  Stephen E. Reichenbach,et al.  Characterizing digital image acquisition devices , 1991 .

[21]  Florin Popentiu,et al.  Iterative identification and restoration of images , 1993, Comput. Graph..

[22]  Nirmal K. Bose,et al.  Mathematical analysis of super-resolution methodology , 2003, IEEE Signal Process. Mag..

[23]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[24]  Stephen E. Reichenbach,et al.  Small convolution kernels for high-fidelity image restoration , 1991, IEEE Trans. Signal Process..

[25]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[26]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[27]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .