Multiframe Super-Resolution Reconstruction of Small Moving Objects

Multiframe super-resolution (SR) reconstruction of small moving objects against a cluttered background is difficult for two reasons: a small object consists completely of “mixed” boundary pixels and the background contribution changes from frame-to-frame. We present a solution to this problem that greatly improves recognition of small moving objects under the assumption of a simple linear motion model in the real-world. The presented method not only explicitly models the image acquisition system, but also the space-time variant fore- and background contributions to the “mixed” pixels. The latter is due to a changing local background as a result of the apparent motion. The method simultaneously estimates a subpixel precise polygon boundary as well as a high-resolution (HR) intensity description of a small moving object subject to a modified total variation constraint. Experiments on simulated and real-world data show excellent performance of the proposed multiframe SR reconstruction method.

[1]  Joost van de Weijer,et al.  Least Squares and Robust Estimation of Local Image Structure , 2003, International Journal of Computer Vision.

[2]  Klamer Schutte,et al.  Superresolution reconstruction for moving point target detection , 2008 .

[3]  Klamer Schutte,et al.  Signal conditioning algorithms for enhanced tactical sensor imagery , 2003, SPIE Defense + Commercial Sensing.

[4]  Klamer Schutte,et al.  Super-Resolution on Moving Objects and Background , 2006, 2006 International Conference on Image Processing.

[5]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[6]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[7]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[8]  Daniel Ménard,et al.  Floating-to-Fixed-Point Conversion for Digital Signal Processors , 2006, EURASIP J. Adv. Signal Process..

[9]  Shree K. Nayar,et al.  Video super-resolution using controlled subpixel detector shifts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[11]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Klamer Schutte,et al.  Performance of optimal registration estimators , 2005, SPIE Defense + Commercial Sensing.

[13]  Klamer Schutte,et al.  Super-Resolution on small moving objects , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Klamer Schutte,et al.  Influence of signal-to-noise ratio and point spread function on limits of superresolution , 2005, IS&T/SPIE Electronic Imaging.

[15]  Russell C. Hardie,et al.  High resolution image reconstruction from digital video with global and non-global scene motion , 1997, Proceedings of International Conference on Image Processing.

[16]  Lucas J. van Vliet,et al.  On the Location Error of Curved Edges in Low-Pass Filtered 2-D and 3-D Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  High Frequency Component Compensation based Super-Resolution Algorithm for Face Video Enhancement , 2004, ICPR.

[18]  Fionn Murtagh,et al.  Deconvolution in Astronomy: A Review , 2002 .

[19]  Michael Elad,et al.  Video-to-Video Dynamic Super-Resolution for Grayscale and Color Sequences , 2006, EURASIP J. Adv. Signal Process..

[20]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[21]  Russell C. Hardie,et al.  High Resolution Image Reconstruction from Digital Video with In-Scene Motion , 1997 .

[22]  A. Murat Tekalp,et al.  Robust, object-based high-resolution image reconstruction from low-resolution video , 1997, IEEE Trans. Image Process..

[23]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[24]  Frederick W. Wheeler,et al.  Moving Vehicle Registration and Super-Resolution , 2007, 36th Applied Imagery Pattern Recognition Workshop (aipr 2007).

[25]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[26]  Klamer Schutte,et al.  Super-resolution of Faces using the Epipolar Constraint , 2007, BMVC.

[27]  G. Zack,et al.  Automatic measurement of sister chromatid exchange frequency. , 1977, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.