Motion segmentation in videos from time of flight cameras

This paper investigates motion estimation and segmentation of independently moving objects in video sequences from a range camera. Specifically, we present a motion estimation algorithm which is based on fusion of range flow and optical flow constraint equations. The flow fields are used to derive long-term point trajectories. A segmentation technique groups the trajectories according to their motion and depth similarity into spatio-temporal objects. We show results on a real world scene captured with a time of flight camera.

[1]  W. Christian INTEGRATED RANGE CAMERA CALIBRATION USING IMAGE SEQUENCES FROM HAND-HELD OPERATION , 2008 .

[2]  Hagen Spies,et al.  The Fusion of Image and Range Flow , 2000, Theoretical Foundations of Computer Vision.

[3]  Bernd Jähne,et al.  Range Flow Estimation based on Photonic Mixing Device Data , 2008, Int. J. Intell. Syst. Technol. Appl..

[4]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[5]  Seth J. Teller,et al.  Particle Video: Long-Range Motion Estimation Using Point Trajectories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Bernd Jähne,et al.  Regularised Range Flow , 2000, ECCV.

[7]  Marc Rioux,et al.  Direct Estimation of Range Flow on Deformable Shape From a Video Rate Range Camera , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Norbert Pfeifer,et al.  Modelling and Compensating Internal Light Scattering in Time of Flight Range Cameras , 2012 .

[9]  Jitendra Malik,et al.  Object Segmentation by Long Term Analysis of Point Trajectories , 2010, ECCV.

[10]  Ivan Laptev,et al.  Track to the future: Spatio-temporal video segmentation with long-range motion cues , 2011, CVPR 2011.

[11]  Kurt Keutzer,et al.  Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow , 2010, ECCV.

[12]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.