Relative depth from monocularoptical flow

We present a method to compute the relative depth of moving objects in video sequences. The method relies on the fact that the boundary between two moving objects follows the movement of the object which is closest to the camera. Thus, the input of the method is a segmentation (to know the boundaries of objects) and an optical flow (to know the movement of the objects). The output of the method is a relative ordering of the neighboring segments. In fact, this output only provides a cue of the desired relative ordering, just like T-junctions typically provide a cue of the relative ordering of the objects around them. These cues can be used later as heuristics or as starting points for higher-level algorithms for image and video-processing.

[1]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[2]  Yiannis Aloimonos,et al.  Motion segmentation using occlusions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  J. Morel,et al.  A multiscale algorithm for image segmentation by variational method , 1994 .

[4]  Ferran Marqués,et al.  Trajectory Tree as an Object-Oriented Hierarchical Representation for Video , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lionel Moisan,et al.  Edge Detection by Helmholtz Principle , 2001, Journal of Mathematical Imaging and Vision.

[7]  B. S. Manjunath,et al.  Probabilistic occlusion boundary detection on spatio-temporal lattices , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[9]  Mariella Dimiccoli,et al.  Monocular Depth by Nonlinear Diffusion , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[10]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[11]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Irfan A. Essa,et al.  Depth layers from occlusions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Michael J. Black,et al.  Layered image motion with explicit occlusions, temporal consistency, and depth ordering , 2010, NIPS.

[14]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.