Depth-from-motion estimation based on a multiscale analysis of motion constraint equation validity

We present a new method of estimating the depth-from-motion in a image sequence. It is assumed that the camera motion is known and the scene is rigid. Our idea is to evaluate carefully the pixels where the brightness change constraint equation is valid, and consequently the depth value is reliable. A confidence measure is derived from local analysis. This analysis is performed at various levels of resolution, increasing the number of reliable pixels. The depth values obtained at each level are then fused within a statistical framework, allowing one to also integrate the temporal information. Results are shown for real and synthetic images used in the performance evaluation.

[1]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[2]  Joseph K. Kearney,et al.  Optical Flow Estimation: An Error Analysis of Gradient-Based Methods with Local Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Eero P. Simoncelli Distributed representation and analysis of visual motion , 1993 .

[4]  Shahriar Negahdaripour,et al.  Motion recovery from image sequences using only first order optical flow information , 1992, International Journal of Computer Vision.

[5]  Joachim Heel Temporal surface reconstruction , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.