Visual tracking and segmentation using Time-of-Flight sensor

Time-of-Flight (TOF) sensors provide range information at each pixel in addition to intensity information. They are becoming more widely available and more affordable. This paper examines the utility of dense TOF range data for image segmentation and tracking. Energy based formulations for image segmentation are used, which consist of a data term and a smoothness term. The paper proposes novel methods to incorporate range information, obtained from the TOF sensor, into the data and the smoothness term of the energy. Graph cut is used to minimize the energy.

[1]  Olaf Kähler,et al.  On fusion of range and intensity information using Graph-Cut for planar patch segmentation , 2008, Int. J. Intell. Syst. Technol. Appl..

[2]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  Rasmus Larsen,et al.  Cluster tracking with Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Thomas B. Moeslund,et al.  Fusion of range and intensity information for view invariant gesture recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Jochen Teizer,et al.  Human Motion Analysis Using 3D Range Imaging Technology , 2009 .

[7]  Yogesh Rathi,et al.  Tracking Through Clutter Using Graph Cuts , 2007, BMVC.

[8]  Behzad Dariush,et al.  Controlled human pose estimation from depth image streams , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Luigi di Stefano,et al.  People Tracking Using a Time-of-Flight Depth Sensor , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[11]  Wei Chen,et al.  Efficiently Solving the Piecewise Constant Mumford-Shah Model using Graph Cuts , 2005 .