Texture and edge preserving multiframe super-resolution

Super-resolution (SR) image reconstruction refers to methods where a higher resolution image is reconstructed using a set of overlapping aliased low-resolution observations of the same scene. Although edge preservation has been a widely explored topic in SR literature, texture-specific regularisation has recently gained interest. In this study, texture-specific regularisation is handled as a post-processing step. A two stage method is proposed, comprising multiple SR reconstructions with different regularisation parameters followed by a restoration step for preserving edges and textures. In the first stage, two maximum-a-posteriori estimators with two different amounts of regularisation are employed. In the second stage, pixel-to-pixel difference between these two estimates is post-processed to restore edges and textures. Frequency selective characteristics of discrete cosine transform and Gabor filters are utilised in the post-processing step. Experiments on synthetically generated images and real experiments demonstrate that the proposed methods give better results compared with the state-of-the-art SR methods especially on textures and edges.

[1]  Gozde Bozdagi Akar,et al.  Directionally adaptive super-resolution , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Masato Inoue,et al.  Posterior-Mean Super-Resolution With a Causal Gaussian Markov Random Field Prior , 2011, IEEE Transactions on Image Processing.

[3]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[4]  Emre Turgay,et al.  Context based super resolution image reconstruction , 2009, 2009 International Workshop on Local and Non-Local Approximation in Image Processing.

[5]  Michael Elad,et al.  Example-based single document image super-resolution: a global MAP approach with outlier rejection , 2007, Multidimens. Syst. Signal Process..

[6]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[7]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[8]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[9]  Masato Inoue,et al.  Posterior mean super-resolution with a compound Gaussian Markov random field prior , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[11]  Christopher M. Bishop,et al.  Bayesian Image Super-Resolution , 2002, NIPS.

[12]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[13]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[14]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[15]  Xiaokang Yang,et al.  Learning-based super-resolution method with a combining of both global and local constraints , 2012 .

[16]  A. Murat Tekalp,et al.  High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[18]  Jong Beom Ra,et al.  Region-based super-resolution using adaptive diffusion regularization , 2008 .

[19]  Liang Tang,et al.  A practical and adaptive framework for super-resolution , 2008, 2008 15th IEEE International Conference on Image Processing.

[20]  Nirmal K. Bose,et al.  Recursive implementation of total least squares algorithm for image reconstruction from noisy, undersampled multiframes , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[21]  Michael Elad,et al.  Example-Based Regularization Deployed to Super-Resolution Reconstruction of a Single Image , 2009, Comput. J..

[22]  Shin Ishii,et al.  Superresolution with compound Markov random fields via the variational EM algorithm , 2009, Neural Networks.

[23]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[25]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[26]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[27]  Nikolas P. Galatsanos,et al.  Variational Bayesian Image Restoration With a Product of Spatially Weighted Total Variation Image Priors , 2010, IEEE Transactions on Image Processing.

[28]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[29]  C. N. Ravi Kumar,et al.  A novel super resolution reconstruction of low reoslution images progressively using dct and zonal filter based denoising , 2011, ArXiv.

[30]  Ajith Abraham,et al.  DCT Based Texture Classification Using Soft Computing Approach , 2004, ArXiv.

[31]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[32]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[33]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[34]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Stephen J. Roberts,et al.  A Sampled Texture Prior for Image Super-Resolution , 2003, NIPS.

[36]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[37]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..

[38]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[39]  Hyun-Kyu Yu,et al.  Improving 60-GHz band radio-frequency with radio-over-fiber link characteristics of optical transmitter system-on-packaging , 2008 .