Region-based super-resolution using adaptive diffusion regularization

In conventional super-resolution algorithms, a single scheme is usually adopted and applied for a whole image, regardless of region characteristics. Since an image consists of various regions having different characteristics, these algorithms may not provide equally good performance for all regions. To alleviate this fundamental drawback of the conventional approach, we propose a region-based super-resolution algorithm. In the algorithm, an image is first analyzed and segmented into smooth, intermediate, and edge regions. According to the region type, a different diffusion-based regularization term and different reconstruction parameters are then used. For regularization in edge regions in particular, we adopt directional smoothing based on adaptive anisotropic diffusion, rather than omni-directional smoothing, to restore the continuity and sharpness of edges and simultaneously reduce undesired noise. The reconstruction parameters are independently managed, depending on the region type, to maximize the visual quality of the whole image. Experimental results show that the proposed method improves the objective quality as well as the subjective visual quality of reconstructed high-resolution images.

[1]  Aggelos K. Katsaggelos,et al.  Iterative evaluation of the regularization parameter in regularized image restoration , 1992, J. Vis. Commun. Image Represent..

[2]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[4]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[5]  Wang Zheng-ming,et al.  Anisotropic nonlinear diffusion approach to image sharpening , 2005 .

[6]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[7]  Lisimachos P. Kondi,et al.  An image super-resolution algorithm for different error levels per frame , 2006, IEEE Transactions on Image Processing.

[8]  Hany Farid,et al.  Elastic registration in the presence of intensity variations , 2003, IEEE Transactions on Medical Imaging.

[9]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[10]  Sebastiano Battiato,et al.  Smart interpolation by anisotropic diffusion , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[11]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[12]  A. Murat Tekalp,et al.  Robust, object-based high-resolution image reconstruction from low-resolution video , 1997, IEEE Trans. Image Process..

[13]  Xiaokang Yang,et al.  Edge-image-based approach for stable super-resolution reconstruction , 2007 .

[14]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[15]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[16]  Yasser M. Kadah,et al.  Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion , 2002, IEEE Transactions on Biomedical Engineering.

[17]  Carlo S. Regazzoni,et al.  Statistical morphological skeleton for representing and coding noisy shapes , 1999 .

[18]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[19]  Turgay Çelik,et al.  Region-based super-resolution aided facial feature extraction from low-resolution sequences , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[20]  J. D. van Ouwerkerk,et al.  Image super-resolution survey , 2006, Image Vis. Comput..

[21]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[22]  Ki-Sang Hong,et al.  Variational approaches to super-resolution with contrast enhancement and anisotropic diffusion , 2003, J. Electronic Imaging.

[23]  Moon Gi Kang,et al.  Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration , 2003, IEEE Trans. Image Process..