The Covering-Assignment Problem for Swarm-Powered Ad Hoc Clouds: A Distributed 3-D Mapping Usecase

The popularity of drones is rapidly increasing across the different sectors of the economy. Aerial capabilities and relatively low costs make drones the perfect solution to improve the efficiency of operations that are typically carried out by humans. Besides automating field operations, drones acting de facto as a swarm can serve as an ad hoc cloud infrastructure built on top of computing and storage resources available across the swarm members and other elements. Even in the absence of Internet connectivity, this cloud can serve the workloads generated by the swarm members and the field agents. By considering the practical example of a swarm-powered 3-D reconstruction application on top of such cloud infrastructure, we present a new optimization problem for the efficient generation and execution of multinode computing workloads subject to data geolocation and clustering constraints. The objective is the minimization of the overall computing times, including both networking delays caused by the interdrone data transmission and computation delays. We prove that the problem is NP-hard and present two combinatorial formulations to model it. Computational results on the solution of the formulations show that one of them can be used to solve, within the configured time-limit, more than 50% of the considered real-world instances involving up to two hundred images and six drones.

[1]  Edoardo Amaldi,et al.  Elastic Traffic Engineering Subject to a Fair Bandwidth Allocation via Bilevel Programming , 2020, IEEE/ACM Transactions on Networking.

[2]  T. Chou,et al.  DISASTER MONITORING AND MANAGEMENT BY THE UNMANNED AERIAL VEHICLE TECHNOLOGY , 2010 .

[3]  Xianglin Wei,et al.  Joint Optimization of Energy Consumption and Delay in Cloud-to-Thing Continuum , 2019, IEEE Internet of Things Journal.

[4]  Mario A. Gomarasca,et al.  Elements of Photogrammetry , 2009 .

[5]  D. Ghose,et al.  Search using multiple UAVs with flight time constraints , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Yong Wang,et al.  Joint Deployment and Task Scheduling Optimization for Large-Scale Mobile Users in Multi-UAV-Enabled Mobile Edge Computing , 2020, IEEE Transactions on Cybernetics.

[7]  Pingyi Fan,et al.  Toward Big Data Processing in IoT: Path Planning and Resource Management of UAV Base Stations in Mobile-Edge Computing System , 2019, IEEE Internet of Things Journal.

[8]  Dusit Niyato,et al.  Hierarchical Game-Theoretic and Reinforcement Learning Framework for Computational Offloading in UAV-Enabled Mobile Edge Computing Networks With Multiple Service Providers , 2019, IEEE Internet of Things Journal.

[9]  Warren W. Gay.  Raspberry Pi Hardware Reference , 2014, Apress.

[10]  Lincheng Shen,et al.  Cooperative Search by Multiple Unmanned Aerial Vehicles in a Nonconvex Environment , 2015 .

[11]  Tor Arne Johansen,et al.  UAVs Trajectory Planning by Distributed MPC under Radio Communication Path Loss Constraints , 2015, J. Intell. Robotic Syst..

[12]  Görres Grenzdörffer,et al.  THE PHOTOGRAMMETRIC POTENTIAL OF LOW-COST UAVs IN FORESTRY AND AGRICULTURE , 2008 .

[13]  Ladan Tahvildari,et al.  Adoop: MapReduce for ad-hoc cloud computing , 2015, CASCON.

[14]  Sghaier Guizani,et al.  Mobile ad hoc cloud: A survey , 2016, Wirel. Commun. Mob. Comput..

[15]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[16]  Kutluyil Dogançay,et al.  Distributed pseudolinear estimation and UAV path optimization for 3D AOA target tracking , 2017, Signal Process..

[17]  Pradipta De,et al.  End-to-End Flow Fairness Over IEEE 802.11-Based Wireless Mesh Networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[18]  Jan Skaloud,et al.  SEARCHING LOST PEOPLE WITH UAVS: THE SYSTEM AND RESULTS OF THE CLOSE-SEARCH PROJECT , 2012 .

[19]  Xianbin Wang,et al.  UAV-Enabled Spatial Data Sampling in Large-Scale IoT Systems Using Denoising Autoencoder Neural Network , 2019, IEEE Internet of Things Journal.

[20]  Laurent Massoulié,et al.  Bandwidth sharing: objectives and algorithms , 2002, TNET.

[21]  H. Eisenbeiss,et al.  Combining photogrammetry and laser scanning for the recording and modelling of the Late Intermediate Period site of Pinchango Alto, Palpa, Peru , 2007 .

[22]  Dritan Nace,et al.  Max-min fairness and its applications to routing and load-balancing in communication networks: a tutorial , 2008, IEEE Communications Surveys & Tutorials.

[23]  Luis Merino,et al.  Experimental results of automatic fire detection and monitoring with UAVs , 2006 .

[24]  Jörg Fliege,et al.  The unmanned aerial vehicle routing and trajectory optimisation problem, a taxonomic review , 2018, Comput. Ind. Eng..

[25]  Ilker Bekmezci,et al.  Flying Ad-Hoc Networks (FANETs): A survey , 2013, Ad Hoc Networks.

[26]  Hyondong Oh,et al.  Coordinated road-network search route planning by a team of UAVs , 2014, Int. J. Syst. Sci..

[27]  Andrea Lodi,et al.  Mixed Integer Programming Computation , 2010, 50 Years of Integer Programming.

[28]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[29]  José Miguel Díaz-Báñez,et al.  The block-information-sharing strategy for task allocation: A case study for structure assembly with aerial robots , 2017, Eur. J. Oper. Res..

[30]  Youdan Kim,et al.  Genetic Algorithm Based Decentralized Task Assignment for Multiple Unmanned Aerial Vehicles in Dynamic Environments , 2011 .

[31]  Emilio Frazzoli,et al.  UAV Routing and Coordination in Stochastic, Dynamic Environments , 2015 .

[32]  Zhongyang Zheng,et al.  Research Advance in Swarm Robotics , 2013 .

[33]  Bruce L. Golden,et al.  Optimization approaches for civil applications of unmanned aerial vehicles (UAVs) or aerial drones: A survey , 2018, Networks.

[34]  Wilfried Linder,et al.  Digital Photogrammetry , 2003 .

[35]  Zhe Yu,et al.  Joint Task Offloading and Resource Allocation in UAV-Enabled Mobile Edge Computing , 2020, IEEE Internet of Things Journal.

[36]  H. Eisenbeiss,et al.  Unmanned aerial vehicle in cadastral applications , 2012 .

[37]  Melvyn Sim,et al.  Robust discrete optimization and network flows , 2003, Math. Program..

[38]  Simon Batzdorfer,et al.  A DISTRIBUTED ONLINE 3D-LIDAR MAPPING SYSTEM , 2017 .

[39]  J. Travelletti,et al.  UAV-BASED REMOTE SENSING OF LANDSLIDES , 2010 .

[40]  Martin Oczipka,et al.  Small drones for geo-archaeology in the steppe: locating and documenting the archaeological heritage of the Orkhon Valley in Mongolia , 2009, Remote Sensing.

[41]  Pablo J. Zarco-Tejada,et al.  High-Resolution Airborne UAV Imagery to Assess Olive Tree Crown Parameters Using 3D Photo Reconstruction: Application in Breeding Trials , 2015, Remote. Sens..

[42]  Hyondong Oh,et al.  Trajectory Planning for Communication Relay Unmanned Aerial Vehicles in Urban Dynamic Environments , 2018, J. Intell. Robotic Syst..

[43]  Simon Bennertz,et al.  Estimating Biomass of Barley Using Crop Surface Models (CSMs) Derived from UAV-Based RGB Imaging , 2014, Remote. Sens..

[44]  Brunilde Sansò,et al.  A Practicable Robust Counterpart Formulation for Decomposable Functions: A Network Congestion Case Study , 2018, Oper. Res..

[45]  N. S. Barnett,et al.  Private communication , 1969 .

[46]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[47]  Eunmi Oh,et al.  An Integral Framework of Task Assignment and Path Planning for Multiple Unmanned Aerial Vehicles in Dynamic Environments , 2013, J. Intell. Robotic Syst..

[48]  W. Coutinho,et al.  The Unmanned Aerial Vehicle Routing and Trajectory Optimisation Problem , 2017 .

[49]  Patrick Doherty,et al.  A Collaborative Framework for 3D Mapping Using Unmanned Aerial Vehicles , 2016, PRIMA.

[50]  Tarik Taleb,et al.  A green strategic activity scheduling for UAV networks: A sub-modular game perspective , 2016, IEEE Communications Magazine.

[51]  G. Verhoeven.  Providing an archaeological bird's‐eye view – an overall picture of ground‐based means to execute low‐altitude aerial photography (LAAP) in Archaeology , 2009 .

[52]  Raj Jain,et al.  The Art of Computer Systems Performance Analysis : Tech-niques for Experimental Design , 1991 .

[53]  Zibin Zheng,et al.  When UAV Swarm Meets Edge-Cloud Computing: The QoS Perspective , 2019, IEEE Network.

[54]  Hua Qu,et al.  UAV-Aided Edge/Fog Computing in Smart IoT Community for Social Augmented Reality , 2020, IEEE Internet of Things Journal.

[55]  F. Nex,et al.  UAV for 3D mapping applications: a review , 2014 .

[56]  Stephen L. Smith,et al.  Heterogeneous Task Allocation and Sequencing via Decentralized Large Neighborhood Search , 2017, Unmanned Syst..

[57]  Gonzalo Pajares,et al.  Multi-UAV target search using decentralized gradient-based negotiation with expected observation , 2014, Inf. Sci..

[58]  Pablo J. Zarco-Tejada,et al.  Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Dimitrios Zorbas,et al.  Optimal drone placement and cost-efficient target coverage , 2016, J. Netw. Comput. Appl..

[60]  Vijay Kumar,et al.  A swarm of flying smartphones , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[61]  Aníbal Ollero,et al.  Distributed Service-Based Cooperation in Aerial/Ground Robot Teams Applied to Fire Detection and Extinguishing Missions , 2010, Adv. Robotics.

[62]  Geoffrey Ye Li,et al.  Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems , 2019, IEEE Internet of Things Journal.

[63]  Luigi Fregonese,et al.  Planning airborne photogrammetry and remote-sensing missions with modern platforms and sensors , 2018 .

[64]  Garth P. McCormick,et al.  Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems , 1976, Math. Program..

[65]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[66]  David Hyunchul Shim,et al.  Cooperative Task Assignment and Path Planning for Multiple UAVs , 2015 .

[67]  Antonio Barrientos,et al.  Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots , 2011, J. Field Robotics.

[68]  Gokhan Inalhan,et al.  Large-scale Task/Target Assignment for UAV Fleets Using a Distributed Branch and Price Optimization Scheme , 2008 .

[69]  Konrad Schindler,et al.  DETERMINATION OF THE UAV POSITION BY AUTOMATIC PROCESSING OF THERMAL IMAGES , 2012 .

[70]  C Zhang,et al.  A UAV-based photogrammetric mapping system for road condition assessment , 2008 .

[71]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[72]  Philip H. S. Torr,et al.  Collaborative Large-Scale Dense 3D Reconstruction with Online Inter-Agent Pose Optimisation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[73]  Filiberto Chiabrando,et al.  UAV and RPV systems for photogrammetric surveys in archaelogical areas : two tests in the Piedmont region (Italy) , 2011 .

[74]  Robert J. Fowler,et al.  Optimal Packing and Covering in the Plane are NP-Complete , 1981, Inf. Process. Lett..

[75]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[76]  Ümit Özgüner,et al.  Motion planning for multitarget surveillance with mobile sensor agents , 2005, IEEE Transactions on Robotics.

[77]  Ahmed M. Elmogy,et al.  Multi-robot Task Allocation: A Review of the State-of-the-Art , 2015, Advances in Social Media Analysis.

[78]  Antonia Teresa Spano,et al.  ARCHAEOLOGICAL SITE MONITORING: UAV PHOTOGRAMMETRY CAN BE AN ANSWER , 2012 .

[79]  Hyondong Oh,et al.  Cooperative Mission and Path Planning for a Team of UAVs , 2015 .

[80]  Li Zhou,et al.  Stochastic Computation Offloading and Trajectory Scheduling for UAV-Assisted Mobile Edge Computing , 2019, IEEE Internet of Things Journal.

[81]  Sanjay Kumar Dhurandher,et al.  Resource allocation in multi-hop Mobile Ad hoc cloud , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[82]  Itaru Kitahara,et al.  Method to generate disaster-damage map using 3D photometry and crowd sourcing , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[83]  Vijay Kumar,et al.  Capt: Concurrent assignment and planning of trajectories for multiple robots , 2014, Int. J. Robotics Res..

[84]  M. Lübbecke.  Column Generation , 2010 .

[85]  Edoardo Amaldi,et al.  Network Optimization Problems Subject to Max-Min Fair Flow Allocation , 2013, IEEE Communications Letters.

[86]  Ieee Staff.  2014 Recent Advances in Engineering and Computational Sciences (RAECS) , 2014 .

[87]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[88]  Sneha A. Dalvi,et al.  Internet of Things for Smart Cities , 2017 .

[89]  Simone Milani,et al.  Impact of drone swarm formations in 3D scene reconstruction , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[90]  Mario Innocenti,et al.  Multiple UAV Task Assignment using Descriptor Functions , 2010 .

[91]  David S. Johnson,et al.  The NP-Completeness Column: An Ongoing Guide , 1982, J. Algorithms.

[92]  Salah Sukkarieh,et al.  Multi-UAV target search using explicit decentralized gradient-based negotiation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[93]  Haibo Mei,et al.  Joint Trajectory-Resource Optimization in UAV-Enabled Edge-Cloud System With Virtualized Mobile Clone , 2020, IEEE Internet of Things Journal.

[94]  Yong Wang,et al.  Differential Evolution With a Variable Population Size for Deployment Optimization in a UAV-Assisted IoT Data Collection System , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.