Motion from Color

Abstract The use of color images for motion estimation is investigated in this work. Beyond the straightforward approach of using the color components as separate images of the same scene, a new method, based on exploiting color invariance under motion, is discussed. Two different sets of color-related, locally computable motion “invariants” are analyzed and tested in this paper, and the results of motion estimation based on them are compared to the direct use of the RGB brightness functions.

[1]  Hans-Hellmut Nagel,et al.  Optical Flow Estimation: Advances and Comparisons , 1994, ECCV.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Ajit Singh,et al.  Optic flow computation : a unified perspective , 1991 .

[4]  J. Sproston.  Matrix computation for engineers and scientists , 1980 .

[5]  William Feller,et al.  On Second Order Differential Operators , 1955 .

[6]  R. Haralick,et al.  The Facet Approach to Optic Flow , 1983 .

[7]  Yuan-Fang Wang,et al.  Experiments in computing optical flow with the gradient-based, multiconstraint method , 1987, Pattern Recognit..

[8]  Brian V. Funt,et al.  Color constancy under varying illumination , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Alessandro Verri,et al.  Computing optical flow from an overconstrained system of linear algebraic equations , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .

[12]  Naoya Ohta,et al.  Optical flow detection by color images , 1990 .

[13]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[14]  J. Ortega.  Numerical Analysis: A Second Course , 1974 .

[15]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[16]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[17]  H. Trussell.  DSP solutions run the gamut for color systems , 1993, IEEE Signal Processing Magazine.

[18]  Alan Jennings,et al.  Matrix Computation for Engineers and Scientists , 1977 .

[19]  Berthold K. P. Horn.  Exact reproduction of colored images , 1983, Comput. Vis. Graph. Image Process..

[20]  Larry S. Davis,et al.  Motion estimation based on multiple local constraints and nonlinear smoothing , 1983, Pattern Recognit..

[21]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.