SMARTPIG: Simultaneous mosaicking and resectioning through planar image graphs

This paper describes Smartpig, an algorithm for the iterative mosaicking of images of a planar surface using a unique parameterization which decomposes inter-image projective warps into camera intrinsics, fronto-parallel projections, and inter-image similarities. The constraints resulting from the inter-image alignments within an image set are stored in an undirected graph structure allowing efficient optimization of image projections on the plane. Camera pose is also directly recoverable from the graph, making Smartpig a feasible solution to the problem of simultaneous location and mapping (SLAM). Smartpig is demonstrated on a set of 144 high resolution aerial images and evaluated with a number of metrics against ground control.

[1]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[2]  Paul Ozog,et al.  On the importance of modeling camera calibration uncertainty in visual SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Stephen M. Rock,et al.  A REAL-TIME VISUAL MOSAICKING AND NAVIGATION SYSTEM , 2006 .

[4]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[5]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[6]  Armagan Elibol,et al.  A new global alignment approach for underwater optical mapping , 2011 .

[7]  Ryan M. Eustice,et al.  Multi-view registration for feature-poor underwater imagery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  James Diebel,et al.  Representing Attitude : Euler Angles , Unit Quaternions , and Rotation Vectors , 2006 .

[9]  Hui Zhou,et al.  Graph-Based Global Optimization for the Registration of a Set of Images , 2006, PSIVT.

[10]  Rafael García,et al.  A New Global Alignment Method for Feature Based Image Mosaicing , 2008, ISVC.

[11]  Rafael García,et al.  Augmented state–extended Kalman filter combined framework for topology estimation in large‐area underwater mapping , 2010, J. Field Robotics.

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Serge J. Belongie,et al.  Covariance Propagation for Guided Matching , 2006 .

[14]  Jean-Marie Becker,et al.  Plane-based camera self-calibration by metric rectification of images , 2008, Image Vis. Comput..

[15]  S. Mills,et al.  Speeded-up Bag-of-Words algorithm for robot localisation through scene recognition , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[16]  Armagan Elibol,et al.  Augmented state–extended Kalman filter combined framework for topology estimation in large-area underwater mapping , 2010 .

[17]  P. Wolf,et al.  Elements of Photogrammetry(with Applications in GIS) , 2000 .

[18]  Alonzo Kelly,et al.  A constrained optimization approach to globally consistent mapping , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Michael P. Hayes,et al.  Pose Guided Matching for Aerial Images , 2014, IVCNZ '14.

[20]  Wolfram Burgard,et al.  Visual SLAM for Flying Vehicles , 2008, IEEE Transactions on Robotics.

[21]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Nassir Navab,et al.  Estimation of Location Uncertainty for Scale Invariant Features Points , 2009, BMVC.

[24]  Alexandre Bernardino,et al.  Mosaic-based navigation for autonomous underwater vehicles , 2003 .

[25]  Gérard G. Medioni,et al.  A graph-based global registration for 2D mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.