Appearance based object tracking in stereo sequences

A novel algorithm is proposed, that performs tracking of rigid objects in 3D videos, without knowledge of the camera calibration parameters, by exploiting only visual information obtained from the left and right video channels, namely luminance and disparity information. The proposed algorithm exploits noisy disparity maps that have been extracted by a real-time disparity estimation algorithm. The algorithm employs two appearance-based representation methods for describing the object texture. The first one combines luminance with disparity information and the second one employs Local Steering Kernel (LSK) descriptors.

[1]  Michael Harville,et al.  Stereo person tracking with adaptive plan-view templates of height and occupancy statistics , 2004, Image Vis. Comput..

[2]  Hans-Peter Seidel,et al.  Accurate Real-Time Disparity Estimation with Variational Methods , 2009, ISVC.

[3]  George Bebis,et al.  Robust Video-Based Surveillance by Integrating Target Detection with Tracking , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Haibin Ling,et al.  Robust Visual Tracking using 1 Minimization , 2009 .

[5]  Xin Yang,et al.  Multi-object detection and tracking by stereo vision , 2010, Pattern Recognit..

[6]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[7]  Juan R. Torregrosa,et al.  Handling occlusion in object tracking in stereoscopic video sequences , 2009, Math. Comput. Model..

[8]  Larry H. Matthies,et al.  Robust and Efficient Stereo Feature Tracking for Visual Odometry , 2008, 2008 IEEE International Conference on Robotics and Automation.

[9]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[10]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[11]  Rafael Muñoz-Salinas,et al.  People detection and tracking using stereo vision and color , 2007, Image Vis. Comput..

[12]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[13]  Peyman Milanfar,et al.  Training-Free, Generic Object Detection Using Locally Adaptive Regression Kernels , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hai Tao,et al.  Fusion of local appearance with stereo depth for object tracking , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[15]  Trevor Darrell,et al.  Integrated Person Tracking Using Stereo, Color, and Pattern Detection , 2000, International Journal of Computer Vision.