An Online Replanning Approach for Crop Fields Mapping with Autonomous UAVs

For managing production at the scale of crop fields, maps of plant pests are used to support farmer decisions. Such maps are costly to obtain since they require intensive surveys in the field, most of the time performed by human annotators or with human-controlled Unmanned Aerial Vehicles (UAVs). In this paper, we look at the next challenge from an AI planning point of view: flying fully autonomous UAVs equipped with online sequential decision-making capabilities for pests sampling and mapping in crop fields. Following existing work, we use a Markov Random Field framework to represent knowledge about the uncertain map and its quality, in order to compute an optimised pest-sampling policy. Since this planning problem is PSPACE hard, thus too hard to be exactly solved either offline or online, we propose an approach interleaving planning and execution, inspired by recent works on fault-tolerant planning. From past observations at a given time step, we compute a full plan consisting in a sequence of observed locations and expected observations till the end of the pest-sampling phase. The plan is then applied until the number of actual observations that differ from expected ones exceeds a given threshold, which triggers a new replanning episode. Our planning method favourably compares on the problem of weed map construction against an existing greedy approach - the only one working online - while adding the advantage of being adapted to autonomous UAVs' flying time constraints.

[1]  Richard S. Sutton,et al.  Learning and Sequential Decision Making , 1989 .

[2]  Mathieu Bonneau,et al.  Reinforcement learning-based design of sampling policies under cost constraints in Markov random fields: Application to weed map reconstruction , 2014, Comput. Stat. Data Anal..

[3]  Wheeler Ruml,et al.  Heuristic Search When Time Matters , 2013, J. Artif. Intell. Res..

[4]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[5]  Hector Geffner,et al.  Width and Serialization of Classical Planning Problems , 2012, ECAI.

[6]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[7]  Wheeler Ruml,et al.  Improving Determinization in Hindsight for On-line Probabilistic Planning , 2010, ICAPS.

[8]  Joris M. Mooij,et al.  libDAI: A Free and Open Source C++ Library for Discrete Approximate Inference in Graphical Models , 2010, J. Mach. Learn. Res..

[9]  Charles Lesire,et al.  Multi-Target Detection and Recognition by UAVs Using Online POMDPs , 2013, AAAI.

[10]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[11]  Robert Givan,et al.  FF-Replan: A Baseline for Probabilistic Planning , 2007, ICAPS.

[12]  Fausto Giunchiglia,et al.  NUSMV: a new symbolic model checker , 2000, International Journal on Software Tools for Technology Transfer.

[13]  Patrik Haslum,et al.  Optimal Planning with Global Numerical State Constraints , 2014, ICAPS.

[14]  Maria Fox,et al.  Planning the Behaviour of Low-Cost Quadcopters for Surveillance Missions , 2014, ICAPS.

[15]  Piergiorgio Bertoli,et al.  MBP: a Model Based Planner , 2001 .

[16]  Ugur Kuter,et al.  Incremental plan aggregation for generating policies in MDPs , 2010, AAMAS.

[17]  Dan Roth,et al.  On the Hardness of Approximate Reasoning , 1993, IJCAI.

[18]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[19]  G. Johnson,et al.  Spatial and Temporal Analysis of Weed Seedling Populations Using Geostatistics , 1996, Weed Science.

[20]  Guy Shani,et al.  Replanning in Domains with Partial Information and Sensing Actions , 2011, IJCAI.

[21]  Charles Lesire,et al.  A Robotic Execution Framework for Online Probabilistic (Re)Planning , 2014, ICAPS.

[22]  G. Healey,et al.  Face recognition in hyperspectral images - Pattern Analysis and Machine Intelligence, IEEE Transactions on , 2001 .

[23]  Daniel Spring,et al.  Model-based adaptive spatial sampling for occurrence map construction , 2013, Stat. Comput..

[24]  Gilberto Echeverria,et al.  Modular open robots simulation engine: MORSE , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Carmel Domshlak,et al.  Fault Tolerant Planning: Complexity and Compilation , 2013, ICAPS.

[26]  Mathieu Bonneau,et al.  A Reinforcement-Learning Algorithm for Sampling Design in Markov Random Fields , 2012, ECAI.

[27]  Piergiorgio Bertoli,et al.  Safe LTL Assumption-Based Planning , 2006, ICAPS.