POSE ESTIMATION OF A MOVING CAMERA WITH LOW-COST, MULTI-GNSS DEVICES

Abstract. Without additional prior information, the pose of a camera estimated with computer vision techniques is expressed in a local coordinate frame attached to the camera’s initial location. Albeit sufficient in many cases, such an arbitrary representation is not convenient for employment in certain applications and has to be transformed to a coordinate system external to the camera before further use. Assuming a camera that is firmly mounted on a moving platform, this paper describes a method for continuously tracking the pose of that camera in a projected coordinate system. By combining exterior orientation from a known target with incremental pose changes inferred from accurate multi-GNSS positioning, the full 6 DoF pose of the camera is updated with low processing overhead and without requiring the continuous visual tracking of ground control points. Experimental results of applying the proposed method to a moving vehicle and a mobile port crane are reported, demonstrating its efficacy and potential.

[1]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  P.L.H. Jende,et al.  FULLY AUTOMATIC FEATURE-BASED REGISTRATION OF MOBILE MAPPING AND AERIAL NADIR IMAGES FOR ENABLING THE ADJUSTMENT OF MOBILE PLATFORM LOCATIONS IN GNSS-DENIED URBAN ENVIRONMENTS , 2017 .

[5]  Steven M. Seitz,et al.  Accurate Geo-Registration by Ground-to-Aerial Image Matching , 2014, 2014 2nd International Conference on 3D Vision.

[6]  S. Nebiker,et al.  FUSION OF AIRBORNE AND TERRESTRIAL IMAGE-BASED 3D MODELLING FOR ROAD INFRASTRUCTURE MANAGEMENT VIS , 2012 .

[7]  Manolis I. A. Lourakis,et al.  Countering drift in Visual Odometry for planetary rovers by registering boulders in ground and orbital images , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Manolis I. A. Lourakis,et al.  Model-Based Pose Estimation for Rigid Objects , 2013, ICVS.

[9]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  P. Grussenmeyer,et al.  SOLUTIONS FOR EXTERIOR ORIENTATION IN PHOTOGRAMMETRY: A REVIEW , 2002 .

[11]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[13]  Gareth Halfacree,et al.  Raspberry Pi User Guide , 2012 .

[14]  M. E. Cannon,et al.  Performance of Network RTK Using Fixed and Float Ambiguities , 2000 .

[15]  N. Haala,et al.  DIRECT GEOREFERENCING USING GPS/INERTIAL EXTERIOR ORIENTATIONS FOR PHOTOGRAMMETRIC APPLICATIONS , 2000 .

[16]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[17]  Wolfgang Förstner,et al.  Photogrammetric Computer Vision: Statistics, Geometry, Orientation and Reconstruction , 2017 .

[18]  Manolis I. A. Lourakis,et al.  Efficient Absolute Orientation Revisited , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Mubarak Shah,et al.  Bridging the Domain Gap for Ground-to-Aerial Image Matching , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[20]  Joel A. Hesch,et al.  A Direct Least-Squares (DLS) method for PnP , 2011, 2011 International Conference on Computer Vision.

[21]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Serge J. Belongie,et al.  Cross-View Image Geolocalization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[25]  Richard P. Wildes,et al.  Video georegistration: algorithm and quantitative evaluation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Yubin Kuang,et al.  Revisiting the PnP Problem: A Fast, General and Optimal Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Luc Van Gool,et al.  Introduction to Large-Scale Visual Geo-localization , 2016, Large-Scale Visual Geo-Localization.

[30]  Du Q. Huynh,et al.  Metrics for 3D Rotations: Comparison and Analysis , 2009, Journal of Mathematical Imaging and Vision.

[31]  Liqiu Meng,et al.  Georeferencing: a review of methods and applications , 2014, Ann. GIS.

[32]  Manolis I. A. Lourakis,et al.  Accurate Scale Factor Estimation in 3D Reconstruction , 2013, CAIP.

[33]  Denise Dettmering,et al.  Networked Transport of RTCM via Internet Protocol (NTRIP) , 2005 .

[34]  Gaku Nakano,et al.  Globally Optimal DLS Method for PnP Problem with Cayley parameterization , 2015, BMVC.

[35]  Petr Gabrlik.  The Use of Direct Georeferencing in Aerial Photogrammetry with Micro UAV , 2015 .

[36]  Pascal Fua,et al.  Worldwide Pose Estimation Using 3D Point Clouds , 2012, ECCV.

[37]  Stephan Nebiker,et al.  ROBUST AND ACCURATE IMAGE-BASED GEOREFERENCING EXPLOITING RELATIVE ORIENTATION CONSTRAINTS , 2018 .

[38]  David L. Mills,et al.  Internet time synchronization: the network time protocol , 1991, IEEE Trans. Commun..

[39]  Dimitrios Rossikopoulos,et al.  The Hermes GNSS NtripCaster of AUTh , 2009 .

[40]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[41]  Gérard Lachapelle,et al.  Network Real-Time Kinematic Performance Analysis Using Rtcm 3.0 and the Southern Alberta Network , 2007 .