Image enlargement method based on cubic surfaces with local features as constraints

Abstract The quality of image edges and textures plays a vital role in the visual effect of images. For keeping the features of image edges and textures better, we propose an image enlargement method based on cubic fitting surfaces with local features as constraints. The cubic fitting surface constructed with the edge and the distance as constraints effectively improves the approximation accuracy and shape retention, resulting in sharper edges in the initially enlarged image. The error between the cubic fitting surface and the input image surface leads to the error between the initially enlarged image and the input image. Using image self-similarity to filter the initially enlarged image can further improve its quality. In the iterative optimization process, the cubic surface with higher fitting accuracy is constructed on smaller regions of low resolution error images, which effectively improves the quality of the enlarged image and accelerates the convergence speed. Because the algorithm effectively utilizes the local feature information, compared with other state-of-the-art methods, the new method not only has higher PSNR/SSIM in numerical accuracy, but also has clear edges and textures visually.

[1]  Wenping Wang,et al.  Gradient guided image interpolation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[2]  Xin Zhang,et al.  Non-local feature back-projection for image super-resolution , 2016, IET Image Process..

[3]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[5]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[6]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[7]  Fan Zhang,et al.  Enlarging Image by Constrained Least Square Approach with Shape Preserving , 2015, Journal of Computer Science and Technology.

[8]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Xiao-Yuan Jing,et al.  Semi-Supervised Cross-View Projection-Based Dictionary Learning for Video-Based Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Xiao-Yuan Jing,et al.  Super-resolution Person re-identification with semi-coupled low-rank discriminant dictionary learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[12]  M. A. Pumar Zooming of terrain imagery using fractal-based interpolation , 1996, Comput. Graph..

[13]  Max A. Viergever,et al.  Piecewise polynomial kernels for image interpolation: a generalization of cubic convolution , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[14]  Qionghai Dai,et al.  CCR: Clustering and Collaborative Representation for Fast Single Image Super-Resolution , 2016, IEEE Transactions on Multimedia.

[15]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[16]  David Zhang,et al.  A face and palmprint recognition approach based on discriminant DCT feature extraction , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Lei Zhang,et al.  Nonlocal back-projection for adaptive image enlargement , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Horst Bischof,et al.  Fast and accurate image upscaling with super-resolution forests , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  J. A. Parker,et al.  Comparison of Interpolating Methods for Image Resampling , 1983, IEEE Transactions on Medical Imaging.

[20]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[21]  Christian Desrosiers,et al.  High-quality Image Restoration Using Low-Rank Patch Regularization and Global Structure Sparsity , 2019, IEEE Transactions on Image Processing.

[22]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Caiming Zhang,et al.  High-resolution images based on directional fusion of gradient , 2016, Computational Visual Media.

[24]  Michael Unser,et al.  Enlargement or reduction of digital images with minimum loss of information , 1995, IEEE Trans. Image Process..

[25]  Thomas S. Huang,et al.  Deeply Improved Sparse Coding for Image Super-Resolution , 2015, ArXiv.

[26]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[27]  Neeraj Kumar,et al.  Fast Learning-Based Single Image Super-Resolution , 2016, IEEE Transactions on Multimedia.

[28]  E. Maeland On the comparison of interpolation methods. , 1988, IEEE transactions on medical imaging.

[29]  Robert A. Schowengerdt,et al.  Image reconstruction by parametric cubic convolution , 1982, Comput. Graph. Image Process..

[30]  Xiao-Yuan Jing,et al.  Video-Based Person Re-Identification by Simultaneously Learning Intra-Video and Inter-Video Distance Metrics , 2016, IEEE Transactions on Image Processing.

[31]  Zongliang Gan,et al.  Improved Non-local Iterative Back-Projection Method for Image Super-Resolution , 2011, 2011 Sixth International Conference on Image and Graphics.

[32]  Michael Unser,et al.  Fast B-spline Transforms for Continuous Image Representation and Interpolation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Thierry Blu,et al.  Least-squares image resizing using finite differences , 2001, IEEE Trans. Image Process..

[34]  Xiaohai He,et al.  Single Image Super-Resolution via Adaptive Transform-Based Nonlocal Self-Similarity Modeling and Learning-Based Gradient Regularization , 2017, IEEE Transactions on Multimedia.

[35]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[36]  Shiguang Shan,et al.  Image to Video Person Re-Identification by Learning Heterogeneous Dictionary Pair With Feature Projection Matrix , 2018, IEEE Transactions on Information Forensics and Security.

[37]  Chongyu Chen,et al.  Structure-Preserving Image Super-Resolution via Contextualized Multitask Learning , 2017, IEEE Transactions on Multimedia.

[38]  Na Ding,et al.  Single Image Super-Resolution via Dynamic Lightweight Database with Local-Feature Based Interpolation , 2019, Journal of Computer Science and Technology.

[39]  Caiming Zhang,et al.  Cubic surface fitting to image by combination , 2010, Science China Information Sciences.

[40]  Fei Zhou,et al.  Consistent Coding Scheme for Single-Image Super-Resolution Via Independent Dictionaries , 2016, IEEE Transactions on Multimedia.

[41]  Caiming Zhang,et al.  Single-Image Super-Resolution Based on Rational Fractal Interpolation , 2018, IEEE Transactions on Image Processing.

[42]  Changhong Chen,et al.  Adaptive joint nonlocal means denoising back projection for image super resolution , 2013, 2013 IEEE International Conference on Image Processing.

[43]  Zhang Caiming,et al.  Cubic surface fitting to image with edges as constraints , 2013, 2013 IEEE International Conference on Image Processing.