Hyper-Resolution: Image detail reconstruction through parametric edges

Hyper-Resolution, a new technique for super-resolution reconstruction of images, is based on matching low-resolution target image details to their high-resolution counterparts from an image database. Central to the algorithm is a novel transform of image content from the orthogonal pixel space to a parametric space structured around edges. This approach offers improved quality, more flexibility and significantly faster performance than previous work in the field. Implementation strategies for achieving this efficiency are carefully outlined. The algorithm is evaluated by controlled assessment, qualitative evaluation, and applications to facial detail reconstruction and identification. The algorithm is finally analyzed through the comparison with alternative techniques.

[1]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[2]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[3]  Fujio Yamaguchi,et al.  Curves and Surfaces in Computer Aided Geometric Design , 1988, Springer Berlin Heidelberg.

[4]  Ares Lagae,et al.  Eurographics Symposium on Rendering 2003 , 2004 .

[5]  James H. Elder,et al.  Image Editing in the Contour Domain , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[8]  Bryan S. Morse,et al.  Image magnification using level-set reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Lijun Yin,et al.  Generating Realistic Facial Expressions with Wrinkles for Model-Based Coding , 2001, Comput. Vis. Image Underst..

[11]  Gerald Farin,et al.  Curves and surfaces for computer aided geometric design , 1990 .

[12]  Bruce Walter,et al.  Feature-Based Textures , 2004, Rendering Techniques.

[13]  Michal Irani,et al.  Image sequence enhancement using multiple motions analysis , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[15]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[16]  J.H. Elder,et al.  Scale space localization, blur, and contour-based image coding , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[18]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Pradeep Sen,et al.  Silhouette maps for improved texture magnification , 2004, Graphics Hardware.

[20]  Shree K. Nayar,et al.  Assorted pixels: multi-sampled imaging with structural models , 2005, SIGGRAPH Courses.

[21]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Lijun Yin,et al.  3D face recognition based on high-resolution 3D face modeling from frontal and profile views , 2003, WBMA '03.

[23]  Michael Elad,et al.  Super-Resolution Reconstruction of Image Sequences , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Thomas W. Parks,et al.  Optimal recovery approach to image interpolation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[25]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[26]  Lijun Yin,et al.  Synthesizing realistic facial animations using energy minimization for model-based coding , 2001, Pattern Recognit..

[27]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Jack Tumblin,et al.  Bixels: Picture Samples with Sharp Embedded Boundaries , 2004, Rendering Techniques.

[29]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[30]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[31]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..