Adaptive View Planning for Aerial 3D Reconstruction

With the proliferation of small aerial vehicles, acquiring close up imagery for high quality reconstruction is gaining importance. We present an adaptive view planning method to collect such images in an automated fashion. We first start by sampling a small set of views to build a coarse proxy to the scene. We then present (i) a method that builds a set of adaptive viewing planes for efficient view selection and (ii) an algorithm to plan a trajectory that guarantees high reconstruction quality which does not deviate too much from the optimal one. The vehicle then follows the trajectory to cover the scene, and the procedure is repeated until reconstruction quality converges or a desired level of quality is achieved. The set of viewing planes provides an effective compromise between using the entire 3D free space and using a single view hemisphere to select the views. We compare our algorithm to existing methods in three challenging scenes. Our algorithm generates views which produce the least reconstruction error comparing to three different baseline approaches.

[1]  Luc Van Gool,et al.  An Integer Linear Programming Model for View Selection on Overlapping Camera Clusters , 2014, 2014 2nd International Conference on 3D Vision.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[4]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[5]  Volkan Isler,et al.  Adaptive View Planning for Aerial 3D Reconstruction of Complex Scenes , 2018, ArXiv.

[6]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[7]  Horst Bischof,et al.  Photogrammetric Camera Network Design for Micro Aerial Vehicles , 2012 .

[8]  Nassir Navab,et al.  Spectral camera clustering , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Volkan Isler,et al.  Approximation algorithms for tours of height-varying view cones , 2019, Int. J. Robotics Res..

[10]  Sang Wook Lee,et al.  View Selection Strategies for Multi-View, Wide-Baseline Stereo , 1994 .

[11]  Pratap Tokekar,et al.  Tracking Aquatic Invaders: Autonomous Robots for Monitoring Invasive Fish , 2013, IEEE Robotics & Automation Magazine.

[12]  Jan-Michael Frahm,et al.  Pixelwise View Selection for Unstructured Multi-View Stereo , 2016, ECCV.

[13]  Jan-Michael Frahm,et al.  Next Best View Planning for Active Model Improvement , 2009, BMVC.

[14]  Pat Hanrahan,et al.  Submodular Trajectory Optimization for Aerial 3D Scanning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[16]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, ECCV.

[18]  Shengyong Chen,et al.  Active Sensor Planning for Multiview Vision Tasks , 2008 .

[19]  Luc Van Gool,et al.  Overlapping camera clustering through dominant sets for scalable 3D reconstruction , 2013, BMVC.

[20]  Volkan Isler,et al.  Gathering Bearing Data for Target Localization , 2016, IEEE Robotics and Automation Letters.

[21]  Matthias Nießner,et al.  Plan3D , 2017, ACM Trans. Graph..

[22]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[23]  Jan-Michael Frahm,et al.  PatchMatch Based Joint View Selection and Depthmap Estimation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[25]  Volkan Isler,et al.  View Selection with Geometric Uncertainty Modeling , 2018, Robotics: Science and Systems.

[26]  Joseph S. B. Mitchell,et al.  Approximation algorithms for TSP with neighborhoods in the plane , 2001, SODA '01.

[27]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..

[29]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[30]  Leif Kobbelt,et al.  Image selection for improved Multi-View Stereo , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Volkan Isler,et al.  Optimal Reconstruction with a Small Number of Views , 2017, ArXiv.

[32]  Luis Enrique Sucar,et al.  Next-Best-View Planning for 3D Object Reconstruction under Positioning Error , 2011, MICAI.

[33]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[34]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[35]  Alan L. Yuille,et al.  UnrealCV: Connecting Computer Vision to Unreal Engine , 2016, ECCV Workshops.

[36]  Sanjeev Arora,et al.  Nearly Linear Time Approximation Schemes for Euclidean TSP and Other Geometric Problems , 1997, RANDOM.