Parameter estimation in Bayesian high-resolution image reconstruction with multisensors

In this paper, we consider the estimation of the unknown parameters for the problem of reconstructing a high-resolution image from multiple undersampled, shifted, degraded frames with subpixel displacement errors. We derive mathematical expressions for the iterative calculation of the maximum likelihood estimate of the unknown parameters given the low resolution observed images. These iterative procedures require the manipulation of block-semi circulant (BSC) matrices, that is, block matrices with circulant blocks. We show how these BSC matrices can be easily manipulated in order to calculate the unknown parameters. Finally the proposed method is tested on real and synthetic images.

[1]  Peyman Milanfar,et al.  Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement , 2001, IEEE Trans. Image Process..

[2]  A. S. Fruchter,et al.  Drizzle: A Method for the Linear Reconstruction of Undersampled Images , 1998 .

[3]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[4]  T. Kanade,et al.  SUPER-RESOLUTION: RECONSTRUCTION OR RECOGNITION? , 2001 .

[5]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Nikolas P. Galatsanos,et al.  Reconstruction of a High Resolution Image from Multiple Low Resolution Images , 2002 .

[7]  Nikolas P. Galatsanos,et al.  Hyperparameter estimation in image restoration problems with partially known blurs , 2002 .

[8]  Nirmal K. Bose,et al.  High‐resolution image reconstruction with multisensors , 1998, Int. J. Imaging Syst. Technol..

[9]  Peyman Milanfar,et al.  A wavelet-based interpolation-restoration method for superresolution (wavelet superresolution) , 2000 .

[10]  Michael K. Ng,et al.  A Fast MAP Algorithm for High-Resolution Image Reconstruction with Multisensors , 2001, Multidimens. Syst. Signal Process..

[11]  Raymond H. Chan,et al.  Wavelet Algorithms for High-Resolution Image Reconstruction , 2002, SIAM J. Sci. Comput..

[12]  M. Ng,et al.  Cosine transform preconditioners for high resolution image reconstruction , 2000 .

[13]  Andrew Zisserman,et al.  Super-resolution from multiple views using learnt image models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .

[15]  Deepu Rajan,et al.  An MRF-Based Approach to Generation of Super-Resolution Images from Blurred Observations , 2004, Journal of Mathematical Imaging and Vision.

[16]  Nikolas P. Galatsanos,et al.  Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation , 1992, IEEE Trans. Image Process..

[17]  Aggelos K. Katsaggelos,et al.  Bayesian Image Estimation from an Incomplete Set of Blurred, Undersampled Low Resolution Images , 2003, IbPRIA.

[18]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[19]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[20]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[21]  Nirmal K. Bose,et al.  Advances in superresolution using L-curve , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[22]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[23]  Eric L. Miller,et al.  Simultaneous multiple regularization parameter selection by means of the L-hypersurface with applications to linear inverse problems posed in the wavelet transform domain , 1998, Optics & Photonics.

[24]  A.K. Katsaggelos,et al.  A general framework for frequency domain multi-channel signal processing , 1993, IEEE Trans. Image Process..

[25]  Gene H. Golub,et al.  Blind Superresolution with Generalized Cross-Validation using Gauss-Type Quadrature Rules , 1999 .

[26]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[27]  G. Golub,et al.  Blind restoration/superresolution with generalized cross-validation using Gauss-type quadrature rules , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[28]  Raymond H. Chan,et al.  Preconditioned iterative methods for high-resolution image reconstruction with multisensors , 1998, Optics & Photonics.

[29]  Kiyoharu Aizawa,et al.  A scheme for acquiring very high resolution images using multiple cameras , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  T. Chan,et al.  A wavelet method for high-resolution image reconstruction with displacement errors , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[31]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[32]  Aggelos K. Katsaggelos,et al.  Bayesian and regularization methods for hyperparameter estimation in image restoration , 1999, IEEE Trans. Image Process..

[33]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[34]  Nikolas P. Galatsanos,et al.  Reconstruction of a high resolution image from registration and restoration of low resolution images , 1994, Proceedings of 1st International Conference on Image Processing.

[35]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[36]  Aggelos K. Katsaggelos,et al.  Bayesian high resolution image reconstruction with incomplete multisensor low resolution systems , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[37]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Nikolas P. Galatsanos,et al.  Multichannel restoration of single channel images using a wavelet-based subband decomposition , 1994, IEEE Trans. Image Process..