Image Motion Estimation From Motion Smear-A New Computational Model

Motion smear is an important visual cue for motion perception by the human vision system (HVS). However, in image analysis research, exploiting motion smear has been largely ignored. Rather, motion smear is usually considered as a degradation of images that needs to be removed. In this paper, the authors establish a computational model that estimates image motion from motion smear information-"motion from smear". In many real situations, the shutter of the sensing camera must be kept open long enough to produce images of adequate signal-to-noise ratio (SNR), resulting in significant motion smear in images. The authors present a new motion blur model and an algorithm that enables unique estimation of image motion. A prototype sensor system that exploits the new motion blur model has been built to acquire data for "motion-from-smear". Experimental results on images with both simulated smear and real smear, using the authors' "motion-from-smear" algorithm as well as a conventional motion estimation technique, are provided. The authors also show that temporal aliasing does not affect "motion-from-smear" to the same degree as it does algorithms that use displacement as a cue. "Motion-from-smear" provides an additional tool for motion estimation and effectively complements the existing techniques when apparent motion smear is present.

[1]  C. H. Graham,et al.  AREA AND THE INTENSITY-TIME RELATION IN THE PERIPHERAL RETINA , 1935 .

[2]  H. Barlow Temporal and spatial summation in human vision at different background intensities , 1958, The Journal of physiology.

[3]  Benjamin C. Kuo,et al.  Digital Control Systems , 1977 .

[4]  J. N. Pedersen,et al.  The snapping response of the toad, Bufo bufo, towards prey dummies at very low light intensities , 1981 .

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[7]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[8]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[9]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[10]  Anastasios N. Venetsanopoulos,et al.  Regularization theory in image restoration-the stabilizing functional approach , 1990, IEEE Trans. Acoust. Speech Signal Process..

[11]  Aggelos K. Katsaggelos,et al.  Maximum Likelihood Identification and Restoration of Images Using the Expectation-Maximization Algorithm , 1991 .

[12]  A. Murat Tekalp,et al.  Maximum likelihood parametric blur identification based on a continuous spatial domain model , 1992, IEEE Trans. Image Process..

[13]  Jonathan A. Marshall,et al.  Unsmearing Visual Motion: Development of Long-Range Horizontal Intrinsic Connections , 1992, NIPS.