Visual tracking of planes with an uncalibrated central catadioptric camera

This paper addresses the problem of tracking a planar region of the scene using an uncalibrated omnidirectional camera. Omnidirectional cameras are a popular choice of visual sensors in robotics because the large field of view is well adapted to motion estimation and obstacle avoidance. The novelty of this work resides in simplifying the calibration phase by providing a direct approach to tracking without any prior knowledge of the camera, lens or mirror parameters. We deal with a nonlinear optimization problem that can be solved for small displacements between two images like those acquired at video rate by a camera mounted on a robot. In order to assess the performance of the proposed method, we perform experiments with synthetic and real data.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Patrick Rives,et al.  Homography-based Tracking for Central Catadioptric Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  R. Benosman,et al.  A brief historical perspective on panorama , 2001 .

[5]  José Miguel Buenaposada,et al.  Real-time tracking and estimation of plane pose , 2002, Object recognition supported by user interaction for service robots.

[6]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Helder Araújo,et al.  Issues on the geometry of central catadioptric image formation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[9]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[13]  Ezio Malis,et al.  Improving vision-based control using efficient second-order minimization techniques , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Patrick Rives,et al.  Efficient Homography-Based Tracking and 3-D Reconstruction for Single-Viewpoint Sensors , 2008, IEEE Transactions on Robotics.