Efficient Homography-Based Tracking and 3-D Reconstruction for Single-Viewpoint Sensors

This paper addresses the problem of motion estimation and 3-D reconstruction through visual tracking with a single-viewpoint sensor and, in particular, how to generalize tracking to calibrated omnidirectional cameras. We analyze different minimization approaches for the intensity-based cost function (sum of squared differences). In particular, we propose novel variants of the efficient second-order minimization (ESM) with better computational complexities and compare these algorithms with the inverse composition (IC) and the hyperplane approximation (HA). Issues regarding the use of the IC and HA for 3-D tracking are discussed. We show that even though an iteration of ESM is computationally more expensive than an iteration of IC, the faster convergence rate makes it globally faster. The tracking algorithm was validated by using an omnidirectional sensor mounted on a mobile robot.

[1]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Ian D. Reid,et al.  Real-Time SLAM Relocalisation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[4]  Iain Matthews,et al.  Efficient Image Alignment with Outlier Rejection , 2002 .

[5]  Patrick Rives,et al.  Real-time Robust Detection of Planar Regions in a Pair of Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  S. Baker,et al.  Lucas-Kanade 20 Years On: Part 5 , 2004 .

[7]  Dana Cobzas,et al.  3D SSD tracking with estimated 3D planes , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[8]  Michel Dhome,et al.  Hyperplane Approximation for Template Matching , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Paul Newman,et al.  Probabilistic Appearance Based Navigation and Loop Closing , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Selim Benhimane,et al.  Real-time image-based tracking of planes using efficient second-order minimization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[11]  T. Kanade,et al.  Parameterizing Homographies CMU-RI-TR-06-11 , 2006 .

[12]  S. B. Kang,et al.  Panoramic vision : sensors, theory, and applications , 2001 .

[13]  Adrien Bartoli,et al.  A random sampling strategy for piecewise planar scene segmentation , 2007, Comput. Vis. Image Underst..

[14]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[15]  José Miguel Buenaposada,et al.  Real-time tracking and estimation of plane pose , 2002, Object recognition supported by user interaction for service robots.

[16]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Helder Araújo,et al.  Issues on the geometry of central catadioptric image formation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Philippe Martinet,et al.  2 1/2 D visual servoing with central catadioptric cameras , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Ezio Malis,et al.  Improving vision-based control using efficient second-order minimization techniques , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[22]  Radu Horaud,et al.  Visual Servoing/Tracking Using Central Catadioptric Images , 2002, ISER.

[23]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[24]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[25]  Toms Svoboda,et al.  Central Panoramic Cameras: Geometry and Design , 1997 .

[26]  Stefano Soatto,et al.  A semi-direct approach to structure from motion , 2003, The Visual Computer.

[27]  Patrick Rives,et al.  Accurate Quadrifocal Tracking for Robust 3D Visual Odometry , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[29]  Patrick Rives,et al.  An Efficient Direct Method for Improving visual SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[30]  Ian D. Reid,et al.  Locally Planar Patch Features for Real-Time Structure from Motion , 2004, BMVC.

[31]  Patrick Rives,et al.  Homography-based Tracking for Central Catadioptric Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Selim Benhimane,et al.  A new approach to vision-based robot control with omni-directional cameras , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[33]  Kostas Daniilidis,et al.  Mirrors in motion: epipolar geometry and motion estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..

[36]  Helder Araújo,et al.  Geometric properties of central catadioptric line images and their application in calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .