View Planning for Multi-View Stereo 3D Reconstruction Using an Autonomous Multicopter

Multi-view stereo algorithms are an attractive technique for the digital reconstruction of outdoor sites. Concerning the data acquisition process a vertical take off and landing UAV carrying a digital camera is a suitable platform in terms of mobility and flexibility in viewpoint placement. We introduce an automated UAV based data acquisition and outdoor site reconstruction system. A special focus is set on the problem of model based view planning using a coarse digital surface model (DSM) with minimal data preprocessing. The developed view planning heuristic considers a coverage, a maximum view angle and an overlapping constraint imposed by multi-view stereo reconstruction techniques. The time complexity of the algorithm is linear with respect to the size of the area of interest. We demonstrate the efficiency of the entire system in two scenarios, a building and a hillside.

[1]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[2]  Glenn H. Tarbox,et al.  IVIS: An Integrated Volumetric Inspection System , 1995, Comput. Vis. Image Underst..

[3]  K. Tarabanis,et al.  Planning viewpoints that simultaneously satisfy several feature detectability constraints for robotic vision , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[4]  Christian Früh,et al.  Constructing 3D city models by merging ground-based and airborne views , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Peter K. Allen,et al.  Data acquisition and view planning for 3-D modeling tasks , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Noah Snavely.  Photo Tourism : Exploring image collections in 3D , 2006 .

[7]  Henri Eisenbeiss,et al.  The Autonomous Mini Helicopter : a Powerful Platform for Mobile Mapping , 2008 .

[8]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Heiko Hirschmüller,et al.  Meshing and Simplification of High Resolution Urban Surface Data for UAV Path Planning , 2011, J. Intell. Robotic Syst..

[10]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[11]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  H. Hirschmüller.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[13]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[14]  Jan-Michael Frahm,et al.  Towards Urban 3D Reconstruction from Video , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[15]  Antonio Vettore,et al.  Effective 3D modeling of heritage sites , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[16]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  W.R. Scott,et al.  View planning with a registration constraint , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[18]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..