Sampling-based view planning for 3D visual coverage task with Unmanned Aerial Vehicle

The view planning problem is the problem that involves finding suitable viewpoints for vision-related tasks such as inspection or reconstruction. In this paper, we propose a novel view planning algorithm for a camera-equipped Unmanned Aerial Vehicle (UAV) acquiring visual geometric information of target objects in its surrounding environment. The proposed model-based approach makes use of iterative random sampling and a probabilistic potential-field method to generate candidate viewpoints in a non-deterministic manner. Combinatorial optimization is then applied to select the most suitable subset of these candidate viewpoints to complete the given visual inspection or shape reconstruction task. The effectiveness of the proposed method is demonstrated through a number of computational tests that compare its overall performance against two previous methods. A field-test is also performed to demonstrate the method's applicability in a real world UAV-based shape reconstruction task of an outdoor statue.

[1]  William R. Scott,et al.  Model-based view planning , 2007, Machine Vision and Applications.

[2]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[3]  Y.F. Li,et al.  Automatic sensor placement for model-based robot vision , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Tomas Akenine-Möller,et al.  Fast, Minimum Storage Ray-Triangle Intersection , 1997, J. Graphics, GPU, & Game Tools.

[5]  Francis C. M. Lau,et al.  Dynamic programming based algorithms for set multicover and multiset multicover problems , 2010, Theor. Comput. Sci..

[6]  Cheng-Yan Kao,et al.  A Genetic Algorithm Approach for Set Covering Problems , 1994, International Conference on Evolutionary Computation.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[9]  Roland Siegwart,et al.  Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics , 2015, ICRA 2015.

[10]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yunfeng Zhang,et al.  Mission planning of autonomous UAVs for urban surveillance with evolutionary algorithms , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[12]  Franz S. Hover,et al.  Three-dimensional coverage planning for an underwater inspection robot , 2013, Int. J. Robotics Res..

[13]  Tomás Pajdla,et al.  Multi-view reconstruction preserving weakly-supported surfaces , 2011, CVPR 2011.

[14]  J.R. Martinez-De Dios,et al.  Automatic Detection of Windows Thermal Heat Losses in Buildings Using UAVs , 2006, 2006 World Automation Congress.

[15]  Konstantinos A. Tarabanis,et al.  The MVP sensor planning system for robotic vision tasks , 1995, IEEE Trans. Robotics Autom..

[16]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[17]  Kenji Shimada,et al.  Bubble mesh: automated triangular meshing of non-manifold geometry by sphere packing , 1995, SMA '95.

[18]  Vasek Chvátal,et al.  A Greedy Heuristic for the Set-Covering Problem , 1979, Math. Oper. Res..

[19]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..