High resolution image reconstruction from digital video by exploitation of non-global motion

Many imaging systems utilize detector arrays that do not sample the scene according to the Nyquist criterion. As a result, the higher spatial frequencies admitted by the optics are aliased. This creates undesirable artifacts in the imagery. Furthermore, the blurring effects of the optics and the finite detector size also degrade the image quality. Several approaches for increasing the sampling rate have been suggested in the literature such as microscanning. Here we propose an algorithm to include the possibility of non-global motion. We show that the motion of rigid objects within the scene is often sufficient to up-sample the object. The experimental results presented illustrate the breakdown of global reconstruction algorithms in the presence of non-global rigid motion. We also present results using the proposed method that treats individual moving objects and background separately. The results include data from an infrared detector.

[1]  Russell C. Hardie,et al.  High-resolution image reconstruction from digital video by exploitation of nonglobal motion , 1999 .

[2]  A. Schaum,et al.  Analytic Methods of Image Registration: Displacement Estimation and Resampling , 1991 .

[3]  Russell C. Hardie,et al.  High-resolution image reconstruction of digital video with nonglobal rigid body motion , 1998, Defense, Security, and Sensing.

[4]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[5]  Steven K. Rogers,et al.  Discrete, spatiotemporal, wavelet multiresolution analysis method for computing optical flow , 1994 .

[6]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[7]  A. Murat Tekalp,et al.  Motion segmentation by multistage affine classification , 1997, IEEE Trans. Image Process..

[8]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[9]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[10]  Russell C. Hardie,et al.  High resolution image reconstruction from digital video with global and non-global scene motion , 1997, Proceedings of International Conference on Image Processing.

[11]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[12]  Robert L. Stevenson,et al.  Estimation of subpixel-resolution motion fields from segmented image sequences , 1998, Defense, Security, and Sensing.

[13]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[14]  Stephen C. Cain,et al.  High-resolution image reconstruction from a sequence of rotated and translated infrared images , 1997, Defense, Security, and Sensing.

[15]  J. Goodman Introduction to Fourier optics , 1969 .

[16]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[17]  R.L. Stevenson,et al.  Bayesian estimation of subpixel-resolution motion fields and high-resolution video stills , 1997, Proceedings of International Conference on Image Processing.

[18]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..