Aliasing is Good for You: Joint Registration and Reconstruction for Super-Resolution

In many applications, the sampling frequency is limited by the physical characteristics of the components: the pixel pitch, the rate of the A/D converter, etc. A low-pass filter is then often applied before the sampling operation to avoid aliasing. However, when multiple copies are available, it is possible to use the information that is inherently present in the aliasing to reconstruct a higher resolution signal. If the different copies have unknown relative offsets, this is a non-linear problem in the offsets and the signal coefficients. They are not easily separable in the set of equations describing the super-resolution problem. Thus, we perform joint registration and reconstruction from multiple unregistered sets of samples. We give a mathematical formulation for the problem when there are M sets of N samples of a signal that is described by L expansion coefficients. We prove that the solution of the registration and reconstruction problem is generically unique if MN >= L+M-1. We describe two subspace-based methods to compute this solution. Their complexity is analyzed, and some heuristic methods are proposed. Finally, some numerical simulation results on one and two-dimensional signals are given to show the performance of these methods.

[1]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[3]  Michael Unser,et al.  Generalized sampling: stability and performance analysis , 1997, IEEE Trans. Signal Process..

[4]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[5]  Sabine Süsstrunk,et al.  Super-resolution from highly undersampled images , 2005, IEEE International Conference on Image Processing 2005.

[6]  Matthias Schwab,et al.  Making scientific computations reproducible , 2000, Comput. Sci. Eng..

[7]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[8]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[9]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[10]  A. Papoulis,et al.  Generalized sampling expansion , 1977 .

[11]  F. Marvasti Nonuniform sampling : theory and practice , 2001 .

[12]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[13]  Michael Unser,et al.  Generalized sampling without bandlimiting constraints , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[15]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[16]  Thomas Strohmer,et al.  Computationally attractive reconstruction of bandlimited images from irregular samples , 1997, IEEE Trans. Image Process..

[17]  Martin Vetterli,et al.  Reconstruction of irregularly sampled discrete-time bandlimited signals with unknown sampling locations , 2000, IEEE Trans. Signal Process..

[18]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .