3D Mapping and 6D Pose Computation for Real Time Augmented Reality on Cylindrical Objects

Visual Augmented Reality (AR) typically overlays virtual computer graphics or other virtual contents on the real world videos, attracting much interest from both academic and industrial communities. Although AR techniques on planes are well studied, cylindrical objects are seldom used for augmented reality. In this paper, we propose a new method for 3D reconstruction and 6D pose computation for augmented reality on a cylindrical object. The 6D pose is the relative pose between the camera and the cylindrical object, which is very convenient to make augmented reality. First, we capture some images with a cylindrical object and then reconstruct its 3D model with textures offline by using projective invariance and image contours. Second, according to the 3D model, we track the 6D relative pose between the camera and the cylindrical object online, where we propose a linear P3P RANSAC to remove outliers. Finally, the virtual images are exactly aligned with the cylindrical object in the real world. Experimental results show that the proposed method outperforms the state of the arts in terms of 3D mapping and 6D pose computation on cylindrical objects.

[1]  Hauke Strasdat,et al.  Visual SLAM: Why filter? , 2012, Image Vis. Comput..

[2]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Guang-Zhong Yang,et al.  Real-time surgical tool tracking and pose estimation using a hybrid cylindrical marker , 2017, International Journal of Computer Assisted Radiology and Surgery.

[5]  Long Quan,et al.  Conic Reconstruction and Correspondence From Two Views , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Yihong Wu,et al.  Efficient conic fitting with an analytical Polar-N-Direction geometric distance , 2019, Pattern Recognit..

[7]  Youdong Chen,et al.  Radius and Orientation Measurement for Cylindrical Objects by a Light Section Sensor , 2016, Sensors.

[8]  Paulo R. S. Mendonça,et al.  Structure and motion estimation from apparent contours under circular motion , 2002, Image Vis. Comput..

[9]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Andrew Zisserman,et al.  Quadric reconstruction from dual-space geometry , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Zhanyi Hu,et al.  Euclidean reconstruction of a circular truncated cone only from its uncalibrated contours , 2006, Image Vis. Comput..

[12]  Yang Gao,et al.  Fast Cylinder and Plane Extraction from Depth Cameras for Visual Odometry , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[14]  Alexandre Bernardino,et al.  Robust cylinder detection and pose estimation using 3D point cloud information , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[15]  Paulo R. S. Mendonça,et al.  Estimation of epipolar geometry from apparent contours: affine and circular motion cases , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[17]  Roberto Cipolla,et al.  Affine Reconstruction of Curved Surfaces from Uncalibrated Views of Apparent Contours , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Adilson Berveglieri,et al.  Reconstruction of Cylindrical Surfaces Using Digital Image Correlation , 2018, Sensors.

[19]  Songde Ma,et al.  Conics-based stereo, motion estimation, and pose determination , 1993, International Journal of Computer Vision.

[20]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[21]  Songde Ma,et al.  Reconstruction of quadric surface from occluding contour , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  Zhanyi Hu,et al.  Camera Calibration from the Quasi-affine Invariance of Two Parallel Circles , 2004, ECCV.

[23]  Marie-Odile Berger,et al.  3D Surface Reconstruction Using Occluding Contours , 1995, International Journal of Computer Vision.

[24]  Li Li,et al.  Ellipsoid reconstruction from three perspective views , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[26]  Santanu Chaudhury,et al.  Symmetry based 3D reconstruction of repeated cylinders , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[27]  Zen Chen,et al.  Pose determination of a cylinder using reprojection transformation , 1996, Pattern Recognit. Lett..

[28]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[29]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[30]  C. Chiu,et al.  Image reconstruction of a perfectly conducting cylinder by the genetic algorithm , 1996 .