Statistical performance analysis of superresolution image reconstruction

Recently, there has been much work developing super-resolution algorithms for combining a set of low quality images to produce a set of higher quality images. In most cases, such algorithms must first register the collection of images to a common sampling grid and then reconstruct the high resolution image. While many such algorithms have been proposed to address each one of these subproblems, no work has addressed the overall performance limits for this joint estimation problem. In this paper, we analyze the performance limits from statistical first principles using the Cramer-Rao bound. We offer insight into the fundamental bottlenecks limiting the performance of multiframe image reconstruction algorithms and hence super-resolution.

[1]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[2]  Michael Unser,et al.  Generalized sampling: stability and performance analysis , 1997, IEEE Trans. Signal Process..

[3]  Harry Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[5]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[6]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  F. Graybill,et al.  Matrices with Applications in Statistics. , 1984 .

[8]  Peyman Milanfar,et al.  Fundamental performance limits in image registration , 2003, IEEE Transactions on Image Processing.

[9]  J. Schmee Matrices with Applications in Statistics , 1982 .

[10]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[11]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[12]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[13]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[15]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .