Super-Resolution for Synthetic Zooming

Optical zooming is an important feature of imaging systems. In this paper, we investigate a low-cost signal processing alternative to optical zooming—synthetic zooming by super-resolution (SR) techniques. Synthetic zooming is achieved by registering a sequence of low-resolution (LR) images acquired at varying focal lengths and reconstructing the SR image at a larger focal length or increased spatial resolution. Under the assumptions of constant scene depth and zooming speed, we argue that the motion trajectories of all physical points are related to each other by a unique vanishing point and present a robust technique for estimating itsD coordinate. Such a line-geometry-based registration is the foundation of SR for synthetic zooming. We address the issue of data inconsistency arising from the varying focal length of optical lens during the zooming process. To overcome the difficulty of data inconsistency, we propose a two-stage Delaunay-triangulation-based interpolation for fusing the LR image data. We also present a PDE-based nonlinear deblurring to accommodate the blindness and variation of sensor point spread functions. Simulation results with real-world images have verified the effectiveness of the proposed SR techniques for synthetic zooming.

[1]  Irene Y. H. Gu,et al.  Coarse-to-fine planar object identification using invariant curve features and B-spline modeling , 2000, Pattern Recognit..

[2]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[5]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[6]  Michael K. Ng,et al.  High‐resolution image reconstruction from rotated and translated low‐resolution images with multisensors , 2004, Int. J. Imaging Syst. Technol..

[7]  Euncheol Choi,et al.  Super‐resolution approach to overcome physical limitations of imaging sensors: An overview , 2004, Int. J. Imaging Syst. Technol..

[8]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[9]  Aggelos K. Katsaggelos,et al.  High‐resolution images from compressed low‐resolution video: Motion estimation and observable pixels , 2004, Int. J. Imaging Syst. Technol..

[10]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yücel Altunbasak,et al.  Super-resolution reconstruction of compressed video using transform-domain statistics , 2004, IEEE Transactions on Image Processing.

[13]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[14]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[15]  오승준 [서평]「Digital Video Processing」 , 1996 .

[16]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[17]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[18]  Yehoshua Y. Zeevi,et al.  Forward-and-backward diffusion processes for adaptive image enhancement and denoising , 2002, IEEE Trans. Image Process..

[19]  BrownLisa Gottesfeld A survey of image registration techniques , 1992 .

[20]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[21]  Gary E. Ford,et al.  Mean curvature evolution and surface area scaling in image filtering , 1997, IEEE Trans. Image Process..

[22]  Rudolf Kingslake,et al.  Applied Optics and Optical Engineering , 1983 .

[23]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[24]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[25]  P. Olver,et al.  Affine Invariant Detection: Edge Maps, Anisotropic Diffusion, and Active Contours , 1999 .

[26]  Gerald C. Holst,et al.  CCD arrays, cameras, and displays , 1996 .

[27]  L. Álvarez,et al.  Signal and image restoration using shock filters and anisotropic diffusion , 1994 .

[28]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Yanjun Qi,et al.  A probabilistic model for camera zoom detection , 2002, Object recognition supported by user interaction for service robots.

[30]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.