A multi-UAV cooperative route planning methodology for 3D fine-resolution building model reconstruction

Abstract In order to provide a fast multi-UAV cooperative data acquisition approach for 3D building model reconstruction in emergency management domain, a route planning methodology is proposed. A minimum image set including camera shooting positions and attitudes can be firstly obtained, with the given parameters describing the target building, UAVs, cameras, and image overlap requirements. A specific flight route network is then determined, and the optimal solution for multi-UAV data capture route planning is computed on the basis of constraint conditions such as the time frame, UAV battery endurance, and take-off and landing positions. Furthermore, field experiments with manual operating UAV mode, single UAV mode, and multi-UAV mode were conducted to compare the data collection and processing runtimes, as well as the quality of created 3D building models. According to the five defined LoDs of OGC CityGML 2.0 standard, the fine 3D building models conform to the LoD3. Comparison results demonstrate that our method is able to greatly enhance the efficiency of 3D reconstruction by improving the data collection speed while minimizing redundant image datasets, as well as to provide a normalized approach to assign the single or multi-UAV data acquisition tasks. The quality analysis of 3D models shows that the metric difference is less than 20 cm mean error with a standard deviation of 11 cm, which is fairly acceptable in emergency management study field. A 3D GIS-based software demo was also implemented to enable route planning, flight simulation, and data collection visualization.

[1]  Enrico Natalizio,et al.  UAV-assisted disaster management: Applications and open issues , 2016, 2016 International Conference on Computing, Networking and Communications (ICNC).

[2]  Filip Biljecki,et al.  An improved LOD specification for 3D building models , 2016, Comput. Environ. Urban Syst..

[3]  Fabio Remondino,et al.  OBLIQUE PHOTOGRAMMETRY SUPPORTING 3D URBAN RECONSTRUCTION OF COMPLEX SCENARIOS , 2017 .

[4]  Luigi Fregonese,et al.  Planning airborne photogrammetry and remote-sensing missions with modern platforms and sensors , 2018 .

[5]  Antonia Teresa Spano,et al.  UAV PHOTOGRAMMETRY WITH OBLIQUE IMAGES: FIRST ANALYSIS ON DATA ACQUISITION AND PROCESSING , 2016 .

[6]  Luiz Lebensztajn,et al.  Particle Swarm Optimization and strength Pareto to solve multiobjective optimization problems , 2013 .

[7]  M. Shanmugavel,et al.  Cooperative Path Planning of Unmanned Aerial Vehicles , 2010 .

[8]  Sisi Zlatanova,et al.  THREE-DIMENSIONAL MAPS FOR DISASTER MANAGEMENT , 2012 .

[9]  Charles K. Toth,et al.  Remote sensing platforms and sensors: A survey , 2016 .

[10]  Mahdi Hasanlou,et al.  UAV PHOTOGRAMMETRY: A PRACTICAL SOLUTION FOR CHALLENGING MAPPING PROJECTS , 2015 .

[11]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[12]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[13]  Xin Jin,et al.  A Real-Time Gesture-Based Unmanned Aerial Vehicle Control System , 2016, PCM.

[14]  Fei Wang,et al.  A Design of UAV Multi-lens Camera System for 3D Reconstruction During Emergency Response , 2016, GRMSE.

[15]  Nilanjan Dey,et al.  Unmanned aerial system for post disaster identification , 2014, International Conference on Circuits, Communication, Control and Computing.

[16]  H. Arefi,et al.  AN IMAGE-BASED TECHNIQUE FOR 3D BUILDING RECONSTRUCTION USING MULTI-VIEW UAV IMAGES , 2015 .

[17]  Qiang Li,et al.  Multiple UAVs Routes Planning Based on Particle Swarm Optimization Algorithm , 2010, 2010 2nd International Symposium on Information Engineering and Electronic Commerce.

[18]  M. Gerke,et al.  Automatic Structural Seismic Damage Assessment with Airborne Oblique Pictometry© Imagery , 2011 .

[19]  Michele Russo,et al.  CLOSE-RANGE MINI-UAVS PHOTOGRAMMETRY FOR ARCHITECTURE SURVEY , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[20]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[21]  Liang Yang,et al.  UAV-Based Oblique Photogrammetry for Outdoor Data Acquisition and Offsite Visual Inspection of Transmission Line , 2017, Remote. Sens..

[22]  Guilherme A. S. Pereira,et al.  Multi-UAV Routing for Area Coverage and Remote Sensing with Minimum Time , 2015, Sensors.

[23]  Norman Kerle,et al.  UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning , 2014 .

[24]  Ran Wang,et al.  Skeletal camera network embedded structure-from-motion for 3D scene reconstruction from UAV images , 2016 .

[25]  Gunther Heidemann,et al.  Evaluation of Multi-view 3D Reconstruction Software , 2015, CAIP.

[26]  Pierre Grussenmeyer,et al.  Documentation of heritage buildings using close‐range UAV images: dense matching issues, comparison and case studies , 2017 .

[27]  Z. Hanzalek,et al.  Control System for Unmanned Aerial Vehicles , 2007, 2007 5th IEEE International Conference on Industrial Informatics.

[28]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) Experimental Results in Multi-UAV Coordination for Disaster Management and Civil Security Applications , 2022 .

[29]  Tal Shima,et al.  UAV Cooperative Decision and Control: Challenges and Practical Approaches , 2008 .

[30]  Gabriel Hugh Elkaim,et al.  Principles of Guidance, Navigation and Control of UAVs , 2014 .

[31]  Weng Wenguo,et al.  Development of the Public Safety System and a Security-Guaranteed Society , 2017 .

[32]  Fusaomi Nagata,et al.  Development of iOS application handlers for quadrotor UAV remote control and monitoring , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[33]  Fei Su,et al.  Multi-UCAV Cooperative Path Planning Using Improved Coevolutionary Multi-Ant-Colony Algorithm , 2009, ICIC.

[34]  D. Dominici,et al.  UAV photogrammetry in the post-earthquake scenario: case studies in L'Aquila , 2017 .

[35]  Impyeong Lee,et al.  A UAV BASED CLOSE-RANGE RAPID AERIAL MONITORING SYSTEM FOR EMERGENCY RESPONSES , 2012 .

[36]  Michal Król,et al.  Wireless Sensor Networks and Multi-UAV systems for natural disaster management , 2017, Comput. Networks.

[37]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).