Surface reconstruction of ancient water storage systems an approach for sparse 3D sonar scans and fused stereo images

This work presents a process pipeline that addresses the problem of reconstructing surfaces of underwater structures from stereo images and sonar scans collected with a micro-ROV on the islands of Malta and Gozo. Using a limited sensor load, sonar and small GoPro Hero2 cameras, the micro-ROV is able to explore water systems and gather data. As a preprocess to the reconstruction pipeline, a 3D evidence grid is created by mosaicing horizontal and vertical sonar scans. A volumetric representation is then constructed using a level set method. Fine-scale details from the scene are captured in stereo cameras, and are transformed into point clouds and projected into the volume. A raycasting technique is used to trim the volume in accordance with the projected point clouds, thus reintroducing fine details to the rough sonar-generated model. The resulting volume is surfaced, yielding a final mesh which can be viewed and interacted with for archaeological and educational purposes. Initial results from both steps of the reconstruction pipeline are presented and discussed.

[1]  Christopher M. Clark,et al.  Mapping and visualizing ancient water storage systems with an ROV — An approach based on fusing stationary scans within a particle filter , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[2]  Stefan B. Williams,et al.  Reconstructing pavlopetri: Mapping the world's oldest submerged town using stereo-vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Pierre Alliez,et al.  Signing the Unsigned: Robust Surface Reconstruction from Raw Pointsets , 2010, Comput. Graph. Forum.

[4]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[5]  Christopher M. Clark,et al.  Uncertainty Visualization and Hole Filling for Geometric Models of Ancient Water Systems , 2013, GRAPP/IVAPP.

[6]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[7]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[8]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[9]  Tyler Smith,et al.  Surface Reconstruction of Maltese Cisterns Using ROV Sonar Data for Archeological Study , 2011, ISVC.

[10]  M. Hurtós,et al.  Integration of optical and acoustic sensors for D underwater scene reconstruction. , 2009 .

[11]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[12]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Tao Ju,et al.  Dual contouring of hermite data , 2002, ACM Trans. Graph..

[14]  Rafael García,et al.  Surface reconstruction methods for the recovery of 3D models from underwater interest areas , 2011, OCEANS 2011 IEEE - Spain.

[15]  Mario Fernando Montenegro Campos,et al.  Stereo Based Structure Recovery of Underwater Scenes from Automatically Restored Images , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.

[16]  J. Sethian Evolution, implementation, and application of level set and fast marching methods for advancing fronts , 2001 .

[17]  S Negahdaripour,et al.  Underwater stereo using natural flickering illumination , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[18]  Shuangcheng Deng,et al.  Variational Surface Reconstruction from Sparse and Nonparallel Contours for Freehand 3D Ultrasound , 2011 .

[19]  Antonios Gasteratos,et al.  Stereo vision for robotic applications in the presence of non-ideal lighting conditions , 2010, Image Vis. Comput..

[20]  Frank Dellaert,et al.  3D reconstruction of underwater structures , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Christopher M. Clark,et al.  Towards three-dimensional underwater mapping without odometry , 2013 .

[22]  Richard Szeliski,et al.  Stereo Matching with Nonlinear Diffusion , 1998, International Journal of Computer Vision.

[23]  P. Drap,et al.  PHOTOGRAMMETRY FOR VIRTUAL EXPLORATION OF UNDERWATER ARCHEOLOGICAL SITES , 2007 .

[24]  Y. Rzhanov,et al.  Measurement of micro-bathymetry with a GOPRO underwater stereo camera pair , 2012, 2012 Oceans.

[25]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.