Bayesian image interpolation using Markov random fields driven by visually relevant image features

Abstract In this paper we present a Markov Random Field (MRF) based image interpolation procedure suited to both noise-free and noisy measurements. Specifically, after introducing a MRF characterized by means of a novel complex line process representing the visually relevant image features, we derive the global Maximum A Posteriori (MAP) interpolator under the hypothesis of spatially variant additive Gaussian noise. Besides, we derive a closed form local Bayesian MAP interpolator, on the base of which we develop a suboptimal, computationally efficient, single pass interpolation procedure. Numerical simulations demonstrate that the interpolation procedure outperforms state-of-the-art techniques, from both a subjective and objective point of view, in the case of noise-free and noisy measurements.

[1]  Giovanni Jacovitti,et al.  Multiresolution circular harmonic decomposition , 2000, IEEE Trans. Signal Process..

[2]  Eric Dubois,et al.  Fast and reliable structure-oriented video noise estimation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Aggelos K. Katsaggelos,et al.  Bayesian multichannel image restoration using compound Gauss-Markov random fields , 2003, IEEE Trans. Image Process..

[4]  Moshe Porat,et al.  On texture and image interpolation using Markov models , 2009, Signal Process. Image Commun..

[5]  T. P. Athira,et al.  Complex Wavelet Transform Based Image Denoising and Zooming Under the LMMSE Framework , 2014 .

[6]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Richard G. Baraniuk,et al.  Interpolation and denoising of nonuniformly sampled data using wavelet-domain processing , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[8]  J. Besag,et al.  Bayesian image restoration, with two applications in spatial statistics , 1991 .

[9]  Stefania Colonnese,et al.  Markov Random Fields using complex line process: An application to Bayesian image restoration , 2011, 3rd European Workshop on Visual Information Processing.

[10]  Patrizio Campisi,et al.  Blind Image Deblurring Driven by Nonlinear Processing in the Edge Domain , 2004, EURASIP J. Adv. Signal Process..

[11]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[12]  Gabriella Olmo,et al.  Data-Dependent Pre- and Postprocessing Multiple Description Coding of Images , 2007, IEEE Transactions on Image Processing.

[13]  Peyman Milanfar,et al.  Spatio-temporal video interpolation and denoising using motion-assisted steering kernel (MASK) regression , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Alessandro Neri,et al.  Blind image deconvolution using Bussgang techniques: Applications to deblurring and texture synthesis , 2007 .

[15]  Mohammed Ghazal,et al.  A Real-Time Technique for Spatio–Temporal Video Noise Estimation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[17]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[18]  Stefania Colonnese,et al.  Poliphase subsampling multiple description coding using robust edge-preserving interpolation , 2010, 2010 18th European Signal Processing Conference.

[19]  Jing Li,et al.  Restoration and reconstruction from overlapping images for multi-image fusion , 2001, IEEE Trans. Geosci. Remote. Sens..

[20]  Patrizio Campisi,et al.  Multichannel blind image deconvolution using the Bussgang algorithm: spatial and multiresolution approaches , 2003, IEEE Trans. Image Process..

[21]  A. Pietrosanto,et al.  Uncertainty characterization in image based measurements: a preliminary discussion , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[22]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[23]  Bryan Usevitch,et al.  A tutorial on modern lossy wavelet image compression: foundations of JPEG 2000 , 2001, IEEE Signal Process. Mag..

[24]  Dmitriy Vatolin,et al.  Edge-Directed Interpolation in a Bayesian Framework , 2009, BMVC.

[25]  Yeon Ju Lee,et al.  Nonlinear Image Upsampling Method Based on Radial Basis Function Interpolation , 2010, IEEE Transactions on Image Processing.

[26]  Alessandro Neri,et al.  Multiscale image features analysis with circular harmonic wavelets , 1995, Optics + Photonics.

[27]  Roberto Rinaldo,et al.  Polyphase spatial subsampling multiple description coding of video streams with H264 , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[28]  Yücel Altunbasak,et al.  Super-resolution reconstruction of hyperspectral images , 2005 .

[29]  Xiaolin Wu,et al.  Image interpolation with hidden Markov model , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Jean-Yves Guillemaut,et al.  Moving Camera Registration for Multiple Camera Setups in Dynamic Scenes , 2010, BMVC.

[31]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Jan Flusser,et al.  A Unified Approach to Superresolution and Multichannel Blind Deconvolution , 2007, IEEE Transactions on Image Processing.

[33]  Nikolas P. Galatsanos,et al.  Bayesian Restoration Using a New Nonstationary Edge-Preserving Image Prior , 2006, IEEE Transactions on Image Processing.

[34]  Stefania Colonnese,et al.  Fast image interpolation using Circular Harmonic Functions , 2010, 2010 2nd European Workshop on Visual Information Processing (EUVIP).

[35]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[36]  M. Unser,et al.  Interpolation revisited [medical images application] , 2000, IEEE Transactions on Medical Imaging.

[37]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[38]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[39]  Pramod K. Varshney,et al.  Quality-Based Fusion of Multiple Video Sensors for Video Surveillance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Truong Q. Nguyen,et al.  Markov Random Field Model-Based Edge-Directed Image Interpolation , 2007, IEEE Transactions on Image Processing.

[41]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[42]  Stéphane Mallat,et al.  Wavelets for a vision , 1996, Proc. IEEE.

[43]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.