3D Reconstruction of Space Objects from Multi-Views by a Visible Sensor

In this paper, a novel 3D reconstruction framework is proposed to recover the 3D structural model of a space object from its multi-view images captured by a visible sensor. Given an image sequence, this framework first estimates the relative camera poses and recovers the depths of the surface points by the structure from motion (SFM) method, then the patch-based multi-view stereo (PMVS) algorithm is utilized to generate a dense 3D point cloud. To resolve the wrong matches arising from the symmetric structure and repeated textures of space objects, a new strategy is introduced, in which images are added to SFM in imaging order. Meanwhile, a refining process exploiting the structural prior knowledge that most sub-components of artificial space objects are composed of basic geometric shapes is proposed and applied to the recovered point cloud. The proposed reconstruction framework is tested on both simulated image datasets and real image datasets. Experimental results illustrate that the recovered point cloud models of space objects are accurate and have a complete coverage of the surface. Moreover, outliers and points with severe noise are effectively filtered out by the refinement, resulting in an distinct improvement of the structure and visualization of the recovered points.

[1]  Luc Van Gool,et al.  From images to 3D models , 2002, CACM.

[2]  Huijie Zhao,et al.  An approach for autonomous space object identification based on normalized AMI and illumination invariant MSA , 2013 .

[3]  John G. Watson,et al.  The Missile Defense Agency's space tracking and surveillance system , 2008, Remote Sensing.

[4]  Jayant Sharma,et al.  The Space-Based Visible Program , 2000 .

[5]  Zhiguo Jiang,et al.  Vision-based pose estimation for cooperative space objects , 2013 .

[6]  Zhiguo Jiang,et al.  Multi-view space object recognition and pose estimation based on kernel regression , 2014 .

[7]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Roberto Cipolla,et al.  PhotoBuilder-3D models of architectural scenes from uncalibrated images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[9]  A. T. Stair,et al.  The Midcourse Space Experiment (MSX) , 1997, 1997 IEEE Aerospace Conference.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Paul J. Cefola,et al.  Sixth US/Russian Space Surveillance Workshop , 2006 .

[12]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[13]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[15]  Ahmed M. Elgammal,et al.  Satellite recognition and pose estimation using homeomorphic manifold analysis , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Xin Zhang,et al.  Pose Estimation of Space Objects Based on Hybrid Feature Matching of Contour Points , 2016, IGTA.

[17]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[18]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Meng Gang,et al.  Full-viewpoint 3D Space Object Recognition Based on Kernel Locality Preserving Projections , 2010 .

[21]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[22]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..