Grouplet-based color image super-resolution

This paper addresses the problem of generating a super-resolution (SR) image from a single multi-valued low-resolution (LR) input image. The main application in our case lies in the exploitation of the cinema or TV archives for projections in higher resolutions (HD, 2K, 4K). We approach this problem from the perspective of image geometry-oriented interpolation. First, the geometry of the LR image is obtained by computing the grouplet transform. The grouplet orthogonal bases, that were introduced by Mallat in [1], are constructed with a multiscale association field that groups pixels to take advantage of geometrical image regularities. These bases are used to define a grouplet-based structure tensor in order to capture the geometry and directional features of the LR color image. Then, the SR image is synthesized by an adaptive directional interpolation using the extracted geometric information to preserve sharpness of edges and textures. This is accomplished by the minimization of a functional which is defined on the extracted geometric parameters of the LR image and oriented by the geometric flow defined by the grouplet transform. The proposed super-resolution algorithm outperforms the state-of-the-art methods in terms of the visual quality of the interpolated image.

[1]  Truong Q. Nguyen,et al.  Color Image Superresolution Based on a Stochastic Combinational Classification-Regression Algorithm , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Avideh Zakhor,et al.  Resolution enhancement of color video sequences , 1999, IEEE Trans. Image Process..

[3]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[4]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[6]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1999, IEEE Trans. Image Process..

[7]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Harry Shum,et al.  Face Hallucination: Theory and Practice , 2007, International Journal of Computer Vision.

[9]  Hao Jiang,et al.  A new direction adaptive scheme for image interpolation , 2002, Proceedings. International Conference on Image Processing.

[10]  Thomas W. Parks,et al.  Prediction of image detail , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[11]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[12]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[13]  Minh N. Do,et al.  Image interpolation using multiscale geometric representations , 2007, Electronic Imaging.

[14]  Mark D. Fairchild,et al.  A top down description of S-CIELAB and CIEDE2000 , 2003 .

[15]  Moshe Ben-Ezra,et al.  Penrose Pixels Super-Resolution in the Detector Layout Domain , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[17]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[18]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1997, Proceedings of International Conference on Image Processing.

[19]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[20]  Harry Shum,et al.  Patch based blind image super resolution , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.