Vision-Based Satellite Recognition and Pose Estimation Using Gaussian Process Regression

In this paper, we address the problem of vision-based satellite recognition and pose estimation, which is to recognize the satellite from multiviews and estimate the relative poses using imaging sensors. We propose a vision-based method to solve these two problems using Gaussian process regression (GPR). Assuming that the regression function mapping from the image (or feature) of the target satellite to its category or pose follows a Gaussian process (GP) properly parameterized by a mean function and a covariance function, the predictive equations can be easily obtained by a maximum-likelihood approach when training data are given. These explicit formulations can not only offer the category or estimated pose by the mean value of the predicted output but also give its uncertainty by the variance which makes the predicted result convincing and applicable in practice. Besides, we also introduce a manifold constraint to the output of the GPR model to improve its performance for satellite pose estimation. Extensive experiments are performed on two simulated image datasets containing satellite images of 1D and 2D pose variations, as well as different noises and lighting conditions. Experimental results validate the effectiveness and robustness of our approach.

[1]  Zhiguo Jiang,et al.  3D Reconstruction of Space Objects from Multi-Views by a Visible Sensor , 2017, Sensors.

[2]  Zhiguo Jiang,et al.  Vision-Based Pose Estimation for Textureless Space Objects by Contour Points Matching , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Huijie Zhao,et al.  An approach for autonomous space object identification based on normalized AMI and illumination invariant MSA , 2013 .

[4]  Galina Okouneva,et al.  Robust vision-based pose estimation of moving objects for Automated Rendezvous & Docking , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[5]  Dario Izzo,et al.  Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments on monocular distance learning , 2017 .

[6]  Bin Liang,et al.  Pose determination of large non-cooperative satellite in close range using coordinated cameras , 2009, 2009 International Conference on Mechatronics and Automation.

[7]  Samuel T. Thurman,et al.  SPIDER: Next Generation Chip Scale Imaging Sensor Update , 2016 .

[8]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[9]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[10]  Xin Zhang,et al.  Pose Estimation of Space Objects Based on Hybrid Feature Matching of Contour Points , 2016, IGTA.

[11]  Heihachiro Kamimura,et al.  Motion Estimation to a Failed Satellite on Orbit using Stereo Vision and 3D Model Matching , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[12]  Jiang Zhiguo,et al.  Spacecraft attitude estimation based on attitude-weighted kernel regression , 2014 .

[13]  Chang Liu,et al.  Relative pose estimation for cylinder-shaped spacecrafts using single image , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Heike Benninghoff,et al.  Autonomous Navigation for On-Orbit Servicing , 2014, KI - Künstliche Intelligenz.

[15]  Zhiguo Jiang,et al.  Vision-based pose estimation for cooperative space objects , 2013 .

[16]  Wei Zhang,et al.  Space object, high-resolution, optical imaging simulation of space-based systems , 2012, Defense + Commercial Sensing.

[17]  Yong Xia,et al.  Space target recognition based on deep learning , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[18]  Xiangzhi Bai,et al.  Satellite Pose Estimation via Single Perspective Circle and Line , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Marcus R. Frean,et al.  Dependent Gaussian Processes , 2004, NIPS.

[20]  Zhiguo Jiang,et al.  Satellite Recognition via Sparse Coding Based Probabilistic Latent Semantic Analysis , 2014, Int. J. Humanoid Robotics.

[21]  Jayant Sharma,et al.  Space-Based Visible Space Surveillance Performance , 2000 .

[22]  Meng Gang Elastic Net Sparse Coding-based Space Object Recognition , 2013 .

[23]  Carl E. Rasmussen,et al.  Assessing Approximations for Gaussian Process Classification , 2005, NIPS.

[24]  C. Rossi,et al.  Experimental simulation of satellite relative navigation using computer vision , 2005, Proceedings of 2nd International Conference on Recent Advances in Space Technologies, 2005. RAST 2005..

[25]  Shai Segal,et al.  Vision-based relative state estimation of non-cooperative spacecraft under modeling uncertainty , 2011, 2011 Aerospace Conference.

[26]  Leslie Greengard,et al.  Fast Direct Methods for Gaussian Processes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Augusto Caramagno,et al.  Design and Performance Assessment of Hazard Avoidance Techniques For Vision Based Landing , 2006 .

[29]  Zhiguo Jiang,et al.  Robust Spacecraft Component Detection in Point Clouds , 2018, Sensors.

[30]  Trevor Darrell,et al.  Gaussian Processes for Object Categorization , 2010, International Journal of Computer Vision.

[31]  Michael J. Duggin,et al.  Multi-spectral image analysis for improved space object characterization , 2009, Optical Engineering + Applications.

[32]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[33]  Zhiguo Jiang,et al.  Vision-based pose estimation for space objects by Gaussian process regression , 2015, 2015 IEEE Aerospace Conference.

[34]  Ahmed M. Elgammal,et al.  Satellite recognition and pose estimation using homeomorphic manifold analysis , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[35]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[36]  Phil Palmer,et al.  Estimating pose of known target satellite , 2000 .

[37]  Zhiguo Jiang,et al.  Multi-view space object recognition and pose estimation based on kernel regression , 2014 .

[38]  Jie Wang,et al.  Vision-Based System for Satellite On-Orbit Self-Servicing , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[39]  John T. McGraw,et al.  Affordable Wide-field Optical Space Surveillance using sCMOS and GPUs , 2016 .

[40]  Éric Marchand,et al.  Vision-based space autonomous rendezvous: A case study , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  S. Seereeram,et al.  Vision-based relative pose estimation for autonomous rendezvous and docking , 2006, 2006 IEEE Aerospace Conference.

[42]  Roberto Opromolla,et al.  Pose Estimation for Spacecraft Relative Navigation Using Model-Based Algorithms , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[43]  Gang Xiao,et al.  Feature-based image fusion scheme for satellite recognition , 2010, 2010 13th International Conference on Information Fusion.

[44]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Meng Gang,et al.  Full-viewpoint 3D Space Object Recognition Based on Kernel Locality Preserving Projections , 2010 .