Robust optical flow estimation using semi-invariant local features

This paper presents a robust algorithm for computation of 2-D optical flow using the principle of conservation of a set of invariant local features that are representatives of local gray-level properties in an image. Specifically, a set of rotation-invariant local orthogonal Zernike moments is used as invariant features. These are inherently integral-based features, and therefore are expected to be robust against possible variations of intensity values that may occur over a sequence of images due to sensor noise, varying illumination etc. The 2-D local optical flow field is obtained using singular value decomposition of an overdetermined set of linear equations of velocity field components, resulting from the principle of conservation of invariant features in a small neighborhood. The proposed moment-based approach is compared with two existing optical flow techniques. Experimental results with synthetic as well as real sequences are presented to demonstrate the overall robustness of the proposed approach.

[1]  Sugata Ghosal,et al.  Detection of composite edges , 1994, IEEE Trans. Image Process..

[2]  Vishal Markandey,et al.  Multispectral constraints for optical flow computation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[4]  Sugata Ghosal,et al.  Orthogonal moment operators for subpixel edge detection , 1993, Pattern Recognit..

[5]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Robert J. Woodham.  Multiple light source optical flow , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[7]  Larry S. Davis,et al.  Motion estimation based on multiple local constraints and nonlinear smoothing , 1983, Pattern Recognit..

[8]  Alessandro Verri,et al.  Computing optical flow from an overconstrained system of linear algebraic equations , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[9]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[10]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[11]  R. Haralick,et al.  The Facet Approach to Optic Flow , 1983 .

[12]  Yuan-Fang Wang,et al.  Experiments in computing optical flow with the gradient-based, multiconstraint method , 1987, Pattern Recognit..

[13]  Sugata Ghosal,et al.  Segmentation of range images: an orthogonal moment-based integrated approach , 1993, IEEE Trans. Robotics Autom..