Inclusion of peripheral correspondences in object and pose estimation for visual servoing path-planning

This article addresses the utilization of peripheral image correspondences obtained in cameras obeying the unified model for path-planning-based visual servoing applications. The proposed approach consists of reprojecting available image correspondences onto an oriented virtual plane, which is designed to carry as many reprojections as possible from correspondences, especially those in periphery region. To realize this, a key transformation matrix is proposed and applied to spherical projections of those correspondences. After this transformation, object and pose estimation are realized via the minimization of algebraic and geometric errors by introducing appropriate parametrization and strategies. The geometric error will be defined either on the virtual plane or on the spherical surface. Minimization of error function defined on the spherical surface provides much more accurate estimation results in object structure than that of other error functions as demonstrated in simulation examples. At last, experiment with a fisheye camera mounted on a robot validates the effectiveness of the proposed method.

[1]  Graziano Chesi,et al.  Visual Servoing Path Planning for Cameras Obeying the Unified Model , 2012, Adv. Robotics.

[2]  Philippe Martinet,et al.  A generic fisheye camera model for robotic applications , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Graziano Chesi,et al.  Motion planning from demonstrations and polynomial optimization for visual servoing applications , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Éric Marchand,et al.  Pose Estimation for Augmented Reality: A Hands-On Survey , 2016, IEEE Transactions on Visualization and Computer Graphics.

[5]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Tao Zhang,et al.  Unsupervised learning to detect loops using deep neural networks for visual SLAM system , 2017, Auton. Robots.

[8]  Laurent Kneip,et al.  OpenGV: A unified and generalized approach to real-time calibrated geometric vision , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Helder Araujo,et al.  Visual Servoing and Pose Estimation with Cameras Obeying the Unified Model , 2010 .

[10]  Graziano Chesi,et al.  Visual Servoing Path-Planning with Elliptical Projections , 2016, ICINCO.

[11]  T. Shen.  Motion and Structure Estimation for Cameras Obeying the Unified Model , 2011 .

[12]  Éric Marchand,et al.  Using mutual information for appearance-based visual path following , 2013, Robotics Auton. Syst..

[13]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yeung Sam Hung,et al.  Fast multiple-view L2 triangulation with occlusion handling , 2011, Comput. Vis. Image Underst..

[15]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[16]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Graziano Chesi,et al.  Optimized vision-based robot motion planning from multiple demonstrations , 2018, Auton. Robots.

[18]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[19]  Francisco Simões,et al.  Depth-assisted rectification for real-time object detection and pose estimation , 2015, Machine Vision and Applications.