A robust model-based tracker combining geometrical and color edge information

This paper focuses on the issue of estimating the complete 3D pose of the camera with respect to a potentially textureless object, through model-based tracking. We propose to robustly combine complementary geometrical and color edge-based features in the minimization process, and to integrate a multiple-hypotheses framework in the geometrical edge-based registration phase. In order to deal with complex 3D models, our method takes advantage of GPU acceleration. Promising results, outperforming classical state-of-art approaches, have been obtained for space robotics applications on various real and synthetic image sequences and using satellite mock-ups as targets.

[1]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[2]  Éric Marchand,et al.  Using multiple hypothesis in model-based tracking , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Didier Stricker,et al.  Real-time 3D Camera Tracking for Industrial Augmented Reality Applications , 2005, WSCG.

[4]  Alois Knoll,et al.  Robust contour-based object tracking integrating color and edge likelihoods , 2008, VMV.

[5]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[6]  Henrik I. Christensen,et al.  Robust 3D visual tracking using particle filtering on the special Euclidean group: A combined approach of keypoint and edge features , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Éric Marchand,et al.  Real-time Hybrid Tracking using Edge and Texture Information , 2007, Int. J. Robotics Res..

[8]  Éric Marchand,et al.  Tracking complex targets for space rendezvous and debris removal applications , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Michael Beetz,et al.  The Contracting Curve Density Algorithm: Fitting Parametric Curve Models to Images Using Local Self-Adapting Separation Criteria , 2004, International Journal of Computer Vision.

[10]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[11]  Tom Drummond,et al.  Tightly integrated sensor fusion for robust visual tracking , 2004, Image Vis. Comput..

[12]  David W. Murray,et al.  Full-3D Edge Tracking with a Particle Filter , 2006, BMVC.

[13]  Éric Marchand,et al.  Vision-based space autonomous rendezvous: A case study , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Avinash C. Kak,et al.  A New Kalman-Filter-Based Framework for Fast and Accurate Visual Tracking of Rigid Objects , 2008, IEEE Transactions on Robotics.

[15]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Christophe Bonnal,et al.  Active debris removal: Recent progress and current trends , 2013 .

[17]  Vincent Lepetit,et al.  Combining edge and texture information for real-time accurate 3D camera tracking , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[18]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[19]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[21]  Didier Stricker,et al.  Tracking of industrial objects by using CAD models , 2007, J. Virtual Real. Broadcast..