On Discontinuous Optical Flow

Retinal image motion and optical flow as its approximation are  fundamental concepts in the field of vision, perceptual and computational. However, the  computation of optical flow remains a challenging problem as image motion  includes discontinuities and multiple values mostly due to scene geometry, surface  translucency and various photometric effects such as surface reflectance. In this  contribution, we analyze image motion in the frequency space with respect to motion  iscontinuities and surface translucence. We derive, under models of constant and  linear optical flow, the frequency structure of motion discontinuities due to occlusion and we demonstrate its various geometrical properties. The aperture  problem is investigated and we show that the information content of an  occlusion almost always disambiguates the velocity of an occluding signal suffering from the aperture problem.

[1]  Alessandro Verri,et al.  Identifying multiple motions from optical flow , 1992, ECCV.

[2]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[3]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[4]  Michal Irani,et al.  Recovery of ego-motion using image stabilization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  F. W. Mounts.  A video encoding system with conditional picture-element replenishment , 1969 .

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Ramesh C. Jain,et al.  Direct Computation of the Focus of Expansion , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ian Overington.  Gradient-Based Flow Segmentation and Location of the Focus of Expansion , 1987, Alvey Vision Conference.

[9]  Ramesh C. Jain,et al.  Segmentation of Frame Sequences Obtained by a Moving Observer , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Muralidhara Subbarao.  Bounds on time-to-collision and rotational component from first-order derivatives of image flow Stony Brook, New York 11794-2350 , 1990 .

[11]  T. Sato,et al.  Motion-detection model with two stages: Spatiotemporal filtering and feature matching , 1992 .

[12]  Andrea Giachetti,et al.  The use of optical flow for the autonomous navigation , 1994, ECCV.

[13]  J. H. Duncan,et al.  On the Detection of Motion and the Computation of Optical Flow , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  James A. Storer,et al.  A split-merge parallel block-matching algorithm for video displacement estimation , 1992, Data Compression Conference, 1992..

[16]  J. Barron,et al.  A theoretical framework for discontinuous optical flow in fourier space , 1997 .

[17]  E. Dubois,et al.  The sampling and reconstruction of time-varying imagery with application in video systems , 1985, Proceedings of the IEEE.

[18]  Jacques Droulez,et al.  Stereo Correspondence From Optic Flow , 1990, ECCV.

[19]  Venkataraman Sundareswaran.  A Fast Method to Estimate Sensor Translation , 1992, ECCV.

[20]  Wilfried Enkelmann,et al.  Obstacle detection by evaluation of optical flow fields from image sequences , 1990, Image Vis. Comput..

[21]  D Regan,et al.  How do we avoid confounding the direction we are looking and the direction we are moving? , 1982, Science.

[22]  Suzanne Beauchemin,et al.  The Local Frequency Structure of 1D Occluding Image Signals , 1997 .

[23]  Jerry L. Prince,et al.  Motion estimation from tagged MR image sequences , 1992, IEEE Trans. Medical Imaging.

[24]  Thomas S. Huang,et al.  Estimating three-dimensional motion parameters of a rigid planar patch , 1981 .

[25]  Vincent Torre,et al.  The Accuracy of the Computation of Optical Flow and of the Recovery of Motion Parameters , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Steven D. Blostein,et al.  An error-weighted regularization algorithm for image motion-field estimation , 1993, IEEE Trans. Image Process..

[27]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  A. Liptay,et al.  1 Optical Flow to Measure Minute Increments in Plant , 1994 .

[29]  Nicola Ancona.  A Fast Obstacle Detection Method based on Optical Flow , 1992, ECCV.

[30]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  David J. Fleet.  Measurement of image velocity , 1992 .

[32]  Rama Chellappa,et al.  Time-to-X: analysis of motion through temporal parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[33]  K. Prazdny,et al.  Motion and Structure from Optical Flow , 1979, IJCAI.

[34]  Muralidhara Subbarao,et al.  Bounds on time-to-collision and rotational component from first-order derivatives of image flow , 1990, Comput. Vis. Graph. Image Process..

[35]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  John K. Tsotsos,et al.  Techniques for disparity measurement , 1991, CVGIP Image Underst..

[37]  Libor Spacek,et al.  Edge detection and motion detection , 1986, Image Vis. Comput..

[38]  Michael J. Black,et al.  A model for the detection of motion over time , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[39]  P. Pirsch,et al.  Advances in picture coding , 1985, Proceedings of the IEEE.

[40]  J. Hay,et al.  Optical motions and space perception: an extension of Gibson's analysis. , 1966, Psychological review.

[41]  Rama Chellappa,et al.  Automatic feature point extraction and tracking in image sequences for unknown camera motion , 1993, 1993 (4th) International Conference on Computer Vision.

[42]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[43]  Keith Langley,et al.  Vertical and horizontal disparities from phase , 1991, Image Vis. Comput..

[44]  David W. Murray,et al.  Scene Segmentation from Visual Motion Using Global Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.