The Effect of Presmoothing Image Sequences on the Computation of Optical Flow

The computation of optical flow has been proposed as a pre-processing step for many high-level vision algorithms. One of the main approaches to the optical flow problem is the gradient-based approach which differentiates the image intensity to compute the optical flow. Often motion vectors computed using various approaches are not reliable. Spatial smoothing of the image sequence is advisable in order to improve velocity estimates in the presence of noise. That is, the application of some kind of linear operation to the images in the sequence before solving for the flow. The pre-processing typically takes the form of some type of spatial Gaussian smoothing or scale specific band-pass filtering of the input images. The main objectives of such filtering have been to lessen the effects of noise, to isolate image structure of interest and to attenuate temporal aliasing and quantization effects in the input images. This paper investigates the effect of presmoothing on this computation of optical flow. The well known method of Horn and Schunck as well as our own finite element method are implemented and tested for improvements due to presmoothing. Discussions are provided on the effects of presmoothing for a variety of image sequences. In our experiments, smoothing is carried out on a selection of well known sequences in both time and space. Improvements are shown using presmoothing.

[1]  T. M. Chin,et al.  Probabilistic and sequential computation of optical flow using temporal coherence , 1994, IEEE Trans. Image Process..

[2]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Hidetoshi Miike,et al.  Detection of motion fields under spatio-temporal non-uniform illumination , 1999, Image Vis. Comput..

[4]  Philip J. Morrow,et al.  Adaptive Grid Refinement Procedures for Efficient Optical Flow Computation , 2004, International Journal of Computer Vision.

[5]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[6]  Bryan Scotney,et al.  Evaluation of Inverse Finite Element Techniques for Gradient Based Motion Estimation , 2001 .

[7]  Atsushi Nomura,et al.  Spatio-temporal optimization method for determining motion vector fields under non-stationary illumination , 2000, Image Vis. Comput..

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  Michael J. Black,et al.  Skin and bones: multi-layer, locally affine, optical flow and regularization with transparency , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[11]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[12]  Dong-Gyu Sim,et al.  A Two-Stage Algorithm for Motion Discontinuity-Preserving Optical Flow Estimation , 1997, Comput. Vis. Image Underst..

[13]  Michael Spann,et al.  Robust Optical Flow Computation Based on Least-Median-of-Squares Regression , 1999, International Journal of Computer Vision.

[14]  Isabelle Herlin,et al.  Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications , 2004, International Journal of Computer Vision.