Image upsampling via imposed edge statistics

In this paper we propose a new method for upsampling images which is capable of generating sharp edges with reduced input-resolution grid-related artifacts. The method is based on a statistical edge dependency relating certain edge features of two different resolutions, which is generically exhibited by real-world images. While other solutions assume some form of smoothness, we rely on this distinctive edge dependency as our prior knowledge in order to increase image resolution. In addition to this relation we require that intensities are conserved; the output image must be identical to the input image when downsampled to the original resolution. Altogether the method consists of solving a constrained optimization problem, attempting to impose the correct edge relation and conserve local intensities with respect to the low-resolution input image. Results demonstrate the visual importance of having such edge features properly matched, and the method's capability to produce images in which sharp edges are successfully reconstructed.

[1]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[2]  Hayit Greenspan,et al.  Image enhancement by nonlinear extrapolation in frequency space , 1994, Electronic Imaging.

[3]  Giovanni Ramponi,et al.  A simple edge-sensitive image interpolation filter , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[4]  Eero P. Simoncelli.  Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[5]  P. Pérez,et al.  Markov random fields and images , 1998 .

[6]  Arjen van der Schaaf,et al.  Natural image statistics and visual processing , 1998 .

[7]  Andrew Zisserman,et al.  Automated mosaicing with super-resolution zoom , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Narendra Ahuja,et al.  POCS based adaptive image magnification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  Annick Montanvert,et al.  Super-resolution inducing of an image , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[12]  Bryan S. Morse,et al.  Image magnification using level-set reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  M. Orchard,et al.  New edge-directed interpolation , 2001, IEEE Trans. Image Process..

[14]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[15]  Shmuel Peleg,et al.  Multi-sensor super-resolution , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[16]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[17]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[18]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[19]  Erik Reinhard,et al.  Second order image statistics in computer graphics , 2004, APGV '04.

[20]  William T. Freeman,et al.  Efficient graphical models for processing images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Jack Tumblin,et al.  Bixels: Picture Samples with Sharp Embedded Boundaries , 2004, Rendering Techniques.

[22]  Philip J. Willis,et al.  Image Interpolation by Pixel‐Level Data‐Dependent Triangulation , 2004, Comput. Graph. Forum.

[23]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[24]  Bruce Walter,et al.  Feature-Based Textures , 2004, Rendering Techniques.

[25]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[26]  Gene H. Golub,et al.  Numerical solution of saddle point problems , 2005, Acta Numerica.

[27]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[28]  Raanan Fattal.  Image upsampling via imposed edge statistics , 2007, SIGGRAPH 2007.