Multiple Constraints to Compute Optical Flow

The computation of the optical flow field from an image sequence requires the definition of constraints on the temporal change of image features. In this paper, we consider the implications of using multiple constraints in the computational schema. In the first step, it is shown that differential constraints correspond to an implicit feature tracking. Therefore, the best results (either in terms of measurement accuracy, and speed in the computation) are obtained by selecting and applying the constraints which are best "tuned" to the particular image feature under consideration. Considering also multiple image points not only allows us to obtain a (locally) better estimate of the velocity field, but also to detect erroneous measurements due to discontinuities in the velocity field. Moreover, by hypothesizing a constant acceleration motion model, also the derivatives of the optical flow are computed. Several experiments are presented from real image sequences.

[1]  Jerry L. Prince,et al.  On optimal brightness functions for optical flow , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Hans-Hellmut Nagel,et al.  Estimation of Optical Flow Based on Higher-Order Spatiotemporal Derivatives in Interlaced and Non-Interlaced Image Sequences , 1995, Artif. Intell..

[3]  Vishal Markandey,et al.  Multispectral constraints for optical flow computation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Giulio Sandini,et al.  Dynamic aspects in active vision , 1992, CVGIP Image Underst..

[5]  John M. Gauch,et al.  Using color to compute optical flow , 1993, Other Conferences.

[6]  Massimo Tistarelli,et al.  Multiple Constraints for Optical Flow , 1994, ECCV.

[7]  D. M. Freeman,et al.  Equivalence of subpixel motion estimators based on optical flow and block matching , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[8]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[9]  Hans-Hellmut Nagel,et al.  Motion Boundary Detection in Image Sequences by Local Stochastic Tests , 1994, ECCV.

[10]  Alessandro Verri,et al.  Computing optical flow from an overconstrained system of linear algebraic equations , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  Paolo Nesi,et al.  Variational approach to optical flow estimation managing discontinuities , 1993, Image Vis. Comput..

[12]  P. Sopp Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[13]  Brian G. Schunck,et al.  Image Flow Segmentation and Estimation by Constraint Line Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert J. Woodham Multiple light source optical flow , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[15]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Alberto Del Bimbo,et al.  Optical flow from constraint lines parametrization , 1993, Pattern Recognit..