Image upsampling via imposed edge statistics

In this paper we propose a new method for upsampling images which is capable of generating sharp edges with reduced input-resolution grid-related artifacts. The method is based on a statistical edge dependency relating certain edge features of two different resolutions, which is generically exhibited by real-world images. While other solutions assume some form of smoothness, we rely on this distinctive edge dependency as our prior knowledge in order to increase image resolution. In addition to this relation we require that intensities are conserved; the output image must be identical to the input image when downsampled to the original resolution. Altogether the method consists of solving a constrained optimization problem, attempting to impose the correct edge relation and conserve local intensities with respect to the low-resolution input image. Results demonstrate the visual importance of having such edge features properly matched, and the method's capability to produce images in which sharp edges are successfully reconstructed.

[1]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[2]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[3]  P. Pérez,et al.  Markov random fields and images , 1998 .

[4]  Raanan Fattal.  Image upsampling via imposed edge statistics , 2007, SIGGRAPH 2007.

[5]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[6]  Philip J. Willis,et al.  Image Interpolation by Pixel‐Level Data‐Dependent Triangulation , 2004, Comput. Graph. Forum.

[7]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[8]  Hayit Greenspan,et al.  Image enhancement by nonlinear extrapolation in frequency space , 1994, Electronic Imaging.

[9]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[10]  Bryan S. Morse,et al.  Image magnification using level-set reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Shmuel Peleg,et al.  Multi-sensor super-resolution , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[12]  Eero P. Simoncelli.  Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[13]  Annick Montanvert,et al.  Super-resolution inducing of an image , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Arjen van der Schaaf,et al.  Natural image statistics and visual processing , 1998 .

[15]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[16]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[17]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[18]  Erik Reinhard,et al.  Second order image statistics in computer graphics , 2004, APGV '04.

[19]  Jack Tumblin,et al.  Bixels: Picture Samples with Sharp Embedded Boundaries , 2004, Rendering Techniques.

[20]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  William T. Freeman,et al.  Efficient graphical models for processing images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Gene H. Golub,et al.  Numerical solution of saddle point problems , 2005, Acta Numerica.

[23]  Narendra Ahuja,et al.  POCS based adaptive image magnification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[24]  Andrew Zisserman,et al.  Automated mosaicing with super-resolution zoom , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  Giovanni Ramponi,et al.  A simple edge-sensitive image interpolation filter , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[26]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[27]  Bruce Walter,et al.  Feature-Based Textures , 2004, Rendering Techniques.