A voxel-based approach for imaging voids in three-dimensional point clouds

With recent advances in technologies, reconstructions of three-dimensional (3D) point clouds from multi-view aerial imagery are readily obtainable. However, the fidelity of these point clouds has not been well studied, and voids often exist within the point cloud. Voids in the point cloud are present in texturally flat areas that failed to generate features during the initial stages of reconstruction, as well as areas where multiple views were not obtained during collection or a constant occlusion existed due to collection angles or overlapping scene. A method is presented for identifying the type of void present using a voxel-based approach to partition the 3D space. By using collection geometry and information derived from the point cloud, it is possible to detect unsampled voxels such that voids can be identified. A similar line-of-sight analysis can then be used to pinpoint locations at aircraft altitude at which the voids in the point clouds could theoretically be imaged, such that the new images can be included in the 3D reconstruction, with the goal of reducing the voids in the point cloud that are a result of lack of coverage. This method has been tested on high-frame-rate oblique aerial imagery captured over Rochester, NY.

[1]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[2]  Noah Snavely,et al.  Accurate Georegistration of Point Clouds Using Geographic Data , 2013, 2013 International Conference on 3D Vision.

[3]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[4]  Peter Shirley,et al.  An Efficient and Robust Ray-Box Intersection Algorithm , 2005, J. Graph. Tools.

[5]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[6]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[7]  David Levin,et al.  The approximation power of moving least-squares , 1998, Math. Comput..

[8]  Tao Ju,et al.  Dual contouring of hermite data , 2002, ACM Trans. Graph..

[9]  G. Haas.  Three-Dimensional Change Detection With the Use of an Evidence Grid , 2006 .

[10]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  David E. Knapp,et al.  The relative influence of fire and herbivory on savanna three-dimensional vegetation structure. , 2009 .

[12]  Sorin C. Popescu,et al.  Mapping surface fuel models using lidar and multispectral data fusion for fire behavior , 2008 .

[13]  Hong-Tzong Yau,et al.  Extension of surface reconstruction algorithm to the global stitching and repairing of STL models , 2003, Comput. Aided Des..

[14]  B. P. Hudzietz,et al.  AN EXPERIMENTAL EVALUATION OF 3D TERRAIN MAPPING WITH AN AUTONOMOUS HELICOPTER , 2012 .

[15]  Scott D. Brown,et al.  Advances in wide-area hyperspectral image simulation , 2003, SPIE Defense + Commercial Sensing.

[16]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  C. A. HART,et al.  Manual of Photogrammetry , 1947, Nature.

[20]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Carl Salvaggio,et al.  Evaluation of image collection requirements for 3D reconstruction using phototourism techniques on sparse overhead data , 2012, Defense + Commercial Sensing.

[23]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[24]  育久 満上,et al.  Bundler: Structure from Motion for Unordered Image Collections , 2011 .

[25]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[26]  Charles V. Stewart,et al.  A probabilistic representation of LiDAR range data for efficient 3D object detection , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[27]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[28]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[29]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[30]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR.

[31]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[32]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[33]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[34]  Horst Bischof,et al.  Automatic alignment of 3D reconstructions using a Digital Surface Model , 2011, CVPR 2011 WORKSHOPS.

[35]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[36]  George Pavlidis,et al.  Multi-image 3D reconstruction data evaluation , 2014 .

[37]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[38]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[39]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[40]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[41]  Joseph L. Mundy,et al.  Change Detection in a 3-d World , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[43]  Xiao Cheng,et al.  An improved Poisson Surface Reconstruction algorithm , 2010, 2010 International Conference on Audio, Language and Image Processing.

[44]  Derek J. Walvoord,et al.  Assessing geoaccuracy of structure from motion point clouds from long-range image collections , 2014 .

[45]  F. Neitzel,et al.  Mobile 3d Mapping with a Low-Cost Uav System , 2012 .

[46]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[47]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[48]  David W. Messinger,et al.  Line-of-sight analysis using voxelized discrete lidar , 2011, Defense + Commercial Sensing.

[49]  Manuel Menezes de Oliveira Neto,et al.  Filling holes on locally smooth surfaces reconstructed from point clouds , 2007, Image Vis. Comput..

[50]  Bing Yang,et al.  Applications of structure from motion: a survey , 2013, Journal of Zhejiang University SCIENCE C.

[51]  Ravi Krishna Kolluri,et al.  Provably good moving least squares , 2005, SIGGRAPH Courses.

[52]  Hans P. Moravec.  Rover Visual Obstacle Avoidance , 1981, IJCAI.

[53]  Meenakshisundaram Gopi,et al.  Surface Reconstruction based on Lower Dimensional Localized Delaunay Triangulation , 2000, Comput. Graph. Forum.

[54]  Don Ray Murray,et al.  Using Real-Time Stereo Vision for Mobile Robot Navigation , 2000, Auton. Robots.

[55]  Markus H. Gross,et al.  Algebraic point set surfaces , 2007, ACM Trans. Graph..

[56]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[57]  C. Schmid,et al.  Indexing based on scale invariant interest points , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[58]  Carl Salvaggio,et al.  Automated identification of voids in three-dimensional point clouds , 2013, Optics & Photonics - Optical Engineering + Applications.

[59]  Sarah F. Frisken.  Constrained Elastic Surface Nets: Generating Smooth Surfaces from Binary Segmented Data , 1998, MICCAI.

[60]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[61]  Changchang Wu,et al.  SiftGPU : A GPU Implementation of Scale Invariant Feature Transform (SIFT) , 2007 .

[62]  Derek J. Walvoord,et al.  Geoaccurate three-dimensional reconstruction via image-based geometry , 2013, Defense, Security, and Sensing.

[63]  Randal C. Burns,et al.  Parallel Poisson Surface Reconstruction , 2009, ISVC.

[64]  E Chernyaev,et al.  Marching cubes 33 : construction of topologically correct isosurfaces , 1995 .

[65]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[66]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[67]  S. Popescu,et al.  A voxel-based lidar method for estimating crown base height for deciduous and pine trees , 2008 .

[68]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[69]  Tao Ju,et al.  Robust repair of polygonal models , 2004, ACM Trans. Graph..

[70]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[71]  Scott Sorensen,et al.  Reconstruction of textureless regions using structure from motion and image-based interpolation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[72]  Marc Alexa,et al.  Context-based surface completion , 2004, ACM Trans. Graph..

[73]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[74]  Ulla Pyysalo,et al.  VIEWSHED ANALYSIS AND VISUALIZATION OF LANDSCAPE VOXEL MODELS , 2009 .