Partially Calibrated Camera Based Pose Estimation of Mobile Robots with Application to Visual Tracking

In this paper, a new method is developed for relative pose estimation of a monocular camera mounted on a wheeled mobile robot. Different from most of the previous works, the proposed method requires the camera be partially calibrated instead of fully calibrated, and it works for both coplanar and non-planar scenes. Specifically, two image frames are utilized to extract the geometric relationship by considering the planar motion constraint of the mobile robot. Then the relative pose information of the camera is derived based on the developed geometric relationship. To evaluate the effectiveness of the proposed method, the comparison between the proposed method and the classical multi-view geometry based approaches is presented via simulation. Furthermore, practical relevance of the proposed method is illustrated by the application example for the visual trajectory tracking of the mobile robot. Both simulation and experimental results indicate that the proposed method can achieve sufficient pose estimation accuracy to accomplish the visual tracking task.

[1]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[2]  Jian Chen,et al.  A 2-point pose estimation algorithm for monocular visual odometry of ground vehicles , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  David Nister,et al.  Recent developments on direct relative orientation , 2006 .

[4]  Ehud Rivlin,et al.  Visual Homing: Surfing on the Epipoles , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Jian Chen,et al.  Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots , 2017, IEEE Transactions on Cybernetics.

[6]  Gonzalo López-Nicolás,et al.  A Sliding-Mode-Control Law for Mobile Robots Based on Epipolar Visual Servoing From Three Views , 2011, IEEE Transactions on Robotics.

[7]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[8]  Henk Nijmeijer,et al.  Tracking Control of Mobile Robots: A Case Study in Backstepping , 1997, Autom..

[9]  Hongdong Li A Simple Solution to the Six-Point Two-View Focal-Length Problem , 2006, ECCV.

[10]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[11]  Nguyen Tan Luy,et al.  Reinforecement learning-based optimal tracking control for wheeled mobile robot , 2012, 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[12]  Héctor M. Becerra Visual control for memory-based navigation using the trifocal tensor , 2012, World Automation Congress 2012.

[13]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[14]  Carlos Sagüés,et al.  A single visual-servo controller of mobile robots with super-twisting control , 2014, Robotics Auton. Syst..

[15]  Xuebo Zhang,et al.  Visual Servo Regulation of Wheeled Mobile Robots With an Uncalibrated Onboard Camera , 2016, IEEE/ASME Transactions on Mechatronics.

[16]  Yang Li,et al.  Unified tracking and regulation visual servoing of wheeled mobile robots with euclidean reconstruction , 2017, 2017 American Control Conference (ACC).

[17]  Josechu J. Guerrero,et al.  Visual control through the trifocal tensor for nonholonomic robots , 2010, Robotics Auton. Syst..