Mapping and determining the center of mass of a rotating object using a moving observer

For certain applications, such as on-orbit inspection of orbital debris, defunct satellites, and natural objects, it is necessary to obtain a map of a rotating object from a moving observer, as well to estimate the object’s center of mass. This paper addresses these tasks using an observer that measures its own orientation, angular rate, and acceleration, and is equipped with a dense 3D visual sensor, such as a stereo camera or a light detection and ranging (LiDAR) sensor. The observer’s trajectory is estimated independently of the target object’s rotational motion. Pose-graph mapping is performed using visual odometry to estimate the observer’s trajectory in an arbitrary target-fixed frame. In addition to applying pose constraint factors between successive frames, loop closure is performed between temporally non-adjacent frames. A kinematic constraint on the target-fixed frame, resulting from the rigidity of the target object, is exploited to create a novel rotation kinematic factor. This factor connects a trajectory estimation factor graph with the mapping pose graph, and facilitates estimation of the target’s center of mass. Map creation is performed by transforming detected feature points into the target-fixed frame, centered at the estimated center of mass. Analysis of the algorithm’s computational performance reveals that its computational cost is negligible compared with that of the requisite image processing.

[1]  Chun-Yi Su,et al.  Robust Relative Navigation by Integration of ICP and Adaptive Kalman Filter Using Laser Scanner and IMU , 2016, IEEE/ASME Transactions on Mechatronics.

[2]  Frank Dellaert,et al.  IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation , 2015, Robotics: Science and Systems.

[3]  John J. Leonard,et al.  Experimental evaluation of on-board, visual mapping of an object spinning in micro-gravity aboard the International Space Station , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[5]  Brent E. Tweddle,et al.  Computer vision-based localization and mapping of an unknown, uncooperative and spinning target for spacecraft proximity operations , 2013 .

[6]  John J. Leonard,et al.  Smoothing-based estimation of an inspector satellite trajectory relative to a passive object , 2017, 2017 IEEE Aerospace Conference.

[7]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[8]  John Enright,et al.  The SPHERES Guest Scientist Program , 2003 .

[9]  Alvar Saenz-Otero,et al.  An Open Research Facility for Vision‐Based Navigation Onboard the International Space Station , 2016, J. Field Robotics.

[10]  Christopher I. Moore,et al.  Optical Survey of the Tumble Rates of Retired GEO Satellites , 2014 .

[11]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Timothy P. Setterfield,et al.  On-orbit inspection of a rotating object using a moving observer , 2017 .

[13]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[14]  Larry H. Matthies,et al.  Two years of Visual Odometry on the Mars Exploration Rovers , 2007, J. Field Robotics.

[15]  Steven Dubowsky,et al.  Shape, motion, and inertial parameter estimation of space objects using teams of cooperative vision sensors , 2005 .

[16]  Frank Dellaert,et al.  iSAM: Fast Incremental Smoothing and Mapping with Efficient Data Association , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[19]  Alvar,et al.  Design principles for the development of space technology maturation laboratories aboard the International Space Station , 2005 .

[20]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[21]  Ulrich Hillenbrand,et al.  Motion and Parameter Estimation of a Free-Floating Space Object from Range Data for Motion Prediction , 2005 .

[22]  S. Shafer,et al.  Dynamic stereo vision , 1989 .

[23]  F Aghili,et al.  Fault-Tolerant Position/Attitude Estimation of Free-Floating Space Objects Using a Laser Range Sensor , 2011, IEEE Sensors Journal.

[24]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.