A harmonic retrieval framework for discontinuous motion estimation

Motion discontinuities arise when there are occlusions or multiple moving objects in the scene that is imaged. Conventional regularization techniques use smoothness constraints but are not applicable to motion discontinuities. In this paper, we show that discontinuous (or multiple) motion estimation can be viewed as a multicomponent harmonic retrieval problem. From this viewpoint, a number of established techniques for harmonic retrieval ran be applied to solve the challenging problem of discontinuous (or multiple) motion. Compared with existing techniques, the resulting algorithm is not iterative, which not only implies computational efficiency but also obviates concerns regarding convergence or local minima. It also adds flexibility to spatio-temporal techniques which have suffered from lack of explicit modeling of discontinuous motion. Experimental verification of our framework on both synthetic data as well as real image data is provided.

[1]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  Georgios B. Giannakis,et al.  Spatio-temporal approach for time-varying image motion estimation , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  T. Albright.  Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[5]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[6]  Jun Zhang,et al.  The application of mean field theory to image motion estimation , 1995, IEEE Trans. Image Process..

[7]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[8]  C. W. Therrien,et al.  Decision, Estimation and Classification: An Introduction to Pattern Recognition and Related Topics , 1989 .

[9]  Robert H. Shumway,et al.  Replicated time-series regression: An approach to signal estimation and detection , 1983 .

[10]  Michael J. Black.  Recursive Non-Linear Estimation of Discontinuous Flow Fields , 1994, ECCV.

[11]  Luc Van Gool,et al.  Determination of Optical Flow and its Discontinuities using Non-Linear Diffusion , 1994, ECCV.

[12]  Mubarak Shah,et al.  Motion segmentation and estimation , 1994, Proceedings of 1st International Conference on Image Processing.

[13]  Larry B. Stotts,et al.  Optical moving target detection with 3-D matched filtering , 1988 .

[14]  Eric Dubois,et al.  Bayesian Estimation of Motion Vector Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Worthy N. Martin,et al.  Image Motion Estimation From Motion Smear-A New Computational Model , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Valdis Berzins,et al.  Dynamic Occlusion Analysis in Optical Flow Fields , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ajit Singh,et al.  Optic flow computation : a unified perspective , 1991 .

[18]  David J. Heeger,et al.  Optical flow from spatialtemporal filters , 1987 .

[19]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Patrick Bouthemy,et al.  Motion estimation and segmentation using a global Bayesian approach , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[21]  Ellen C. Hildreth,et al.  Computations Underlying the Measurement of Visual Motion , 1984, Artif. Intell..

[22]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[23]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[24]  Steven D. Blostein,et al.  An error-weighted regularization algorithm for image motion-field estimation , 1993, IEEE Trans. Image Process..

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  James L. Flanagan,et al.  Technologies for multimedia communications , 1994, Proc. IEEE.

[27]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..