Precise outline matching criteria for target pose estimation and odometry from stereo video

We introduce and investigate several criteria for matching the outer contour generated by a model of the manipulation target against the image data captured with a stereo camera rig. The more complex criteria are intended for the initial stage of scene analysis, to provide pose and location estimation for path planning, and the faster methods can be used in real-time, e.g. for providing feedback during visual servoing. We exemplify the methodology for the case of cylinder pose estimation, which is an often analyzed case in the literature, and we first investigate the pose estimation performance using simulated images, where the ground truth is perfectly known. Experimental results using real video sequences captured from the mobile manipulator iMoro are showing very good matching for target pose estimation, in agreement with results on simulated data. The visual odometry results using the pose estimation over successive frames show a smooth path estimation and a simulation study infers small localization errors along the path.

[1]  Y. C. Shiu,et al.  Pose determination of circular cylinders using elliptical and side projections , 1991, IEEE 1991 International Conference on Systems Engineering.

[2]  Éric Marchand,et al.  Pose Estimation for Augmented Reality: A Hands-On Survey , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Christophe Doignon,et al.  A Degenerate Conic-Based Method for a Direct Fitting and 3-D Pose of Cylinders with a Single Perspective View , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Baoxin Li,et al.  Circular generalized cylinder fitting for 3D reconstruction in endoscopic imaging based on MRF , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Tim D. Barfoot,et al.  Optimizing Camera Perspective for Stereo Visual Odometry , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[10]  Chang Liu,et al.  Relative pose estimation for cylinder-shaped spacecrafts using single image , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Jouni Mattila,et al.  Fault Tolerant Control Architecture Design for Mobile Manipulation in Scientific Facilities , 2015 .