Planar Motion Bundle Adjustment

In this paper we consider trajectory recovery for two cameras directed towards the floor, and which are mounted rigidly on a mobile platform. Previous work for this specific problem geometry has focused on locally minimising an algebraic error between inter-image homographies to estimate the relative pose. In order to accurately track the platform globally it is necessary to refine the estimation of the camera poses and 3D locations of the feature points, which is commonly done by utilising bundle adjustment; however, existing software packages providing such methods do not take the specific problem geometry into account, and the result is a physically inconsistent solution. We develop a bundle adjustment algorithm which incorporates the planar motion constraint, and devise a scheme that utilises the sparse structure of the problem. Experiments are carried out on real data and the proposed algorithm shows an improvement compared to established generic methods.

[1]  Anders Heyden,et al.  Generalization of Parameter Recovery in Binocular Vision for a Planar Scene , 2019, Int. J. Pattern Recognit. Artif. Intell..

[2]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[3]  Martin Byröd,et al.  Conjugate Gradient Bundle Adjustment , 2010, ECCV.

[4]  Manolis I. A. Lourakis,et al.  Is Levenberg-Marquardt the most efficient optimization algorithm for implementing bundle adjustment? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  Andrew J. Davison,et al.  Extrinsics Autocalibration for Dense Planar Visual Odometry , 2015, J. Field Robotics.

[6]  Hassan Hajjdiab,et al.  Vision-based multi-robot simultaneous localization and mapping , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[7]  Davide Scaramuzza,et al.  1-Point-RANSAC Structure from Motion for Vehicle-Mounted Cameras by Exploiting Non-holonomic Constraints , 2011, International Journal of Computer Vision.

[8]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[9]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Brett Browning,et al.  Photometric Bundle Adjustment for Vision-Based SLAM , 2016, ACCV.

[12]  Jan-Michael Frahm,et al.  Building Rome on a Cloudless Day , 2010, ECCV.

[13]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[14]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Christopher Zach,et al.  Robust Bundle Adjustment Revisited , 2014, ECCV.

[16]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[17]  Nick Pears,et al.  Visual navigation using planar homographies , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[18]  Anders Heyden,et al.  Planar Motion and Hand-eye Calibration using Inter-image Homographies from a Planar Scene , 2013, VISAPP.

[19]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[22]  Anders P. Eriksson,et al.  A Consensus-Based Framework for Distributed Bundle Adjustment , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Anders Heyden,et al.  Relative Pose Estimation in Binocular Vision for a Planar Scene using Inter-Image Homographies , 2018, ICPRAM.

[24]  Kurt Konolige,et al.  Sparse Sparse Bundle Adjustment , 2010, BMVC.

[25]  Anders Heyden,et al.  Ego-motion recovery and robust tilt estimation for planar motion using several homographies , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[26]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[27]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[28]  Davide Scaramuzza,et al.  Performance evaluation of 1‐point‐RANSAC visual odometry , 2011, J. Field Robotics.

[29]  Yunhui Liu,et al.  A Robust Approach for Structure from Planar Motion by Stereo Image Sequences , 2006, Machine Vision and Applications.

[30]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[31]  Long Quan,et al.  Distributed Very Large Scale Bundle Adjustment by Global Camera Consensus , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[32]  J. M. M. Montiel,et al.  Indoor robot motion based on monocular images , 2001, Robotica.