Evolutionary approaches to dynamic earth observation satellites mission planning under uncertainty

Mission planning for Earth Observation Satellite operators typically implies dynamically altering how requests from different customers are prioritised in order to meet expected deadlines. A request corresponds to a given area of interest to capture on Earth. This exercise is challenging for different reasons. First, satellites are limited by maneuvers and power consumption constraints resulting in a limited surface that can be covered at each orbit. Consequently, many requests are in competition with each other and so all of them cannot be treated at each orbit. When a request priority is boosted, it may incidentally penalise surrounding requests. Second, there are several uncertain factors such as weather (in particular cloud cover) and future incoming requests that can impact the completion progress of the requests. With order books of increasing size and the planned operations of a growing number of satellites in a close future, there is a clear need for a decision support method. In this paper, we investigate the potential of Evolutionary Algorithms (EAs) for this problem and propose several approaches to optimise request priorities based on Local Search and Population-Based Incremental Learning (PBIL). Using a certified algorithm to decode request priorities into satellite actions and a satellite simulator developed by Airbus, we are able to realistically evaluate the potential of these methods and benchmark them against operator baselines. Experiments on several scenarios and order books show that EAs can outperform baselines and significantly improve operations both in terms of delay reduction and successful image capture. While black-box approaches yield significant improvements over the baseline when there are many delayed requests in the order books, introducing domain knowledge is required to handle cases with fewer delayed requests.

[1]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[2]  Jirí Kubalík,et al.  A novel evolutionary algorithm with indirect representation and extended nearest neighbor constructive procedure for solving routing problems , 2014, 2014 14th International Conference on Intelligent Systems Design and Applications.

[3]  Xinwei Wang,et al.  Scheduling multiple agile Earth observation satellites with multiple observations , 2018, 1812.00203.

[4]  John A. W. McCall,et al.  An Analysis of Indirect Optimisation Strategies for Scheduling , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[5]  Jonathan Bonnet,et al.  Multi-Criteria and Multi-Objective Dynamic Planning by Self-Adaptive Multi-Agent System, Application to Earth Observation Satellite Constellations. (Planification Dynamique, Multi-Objectif et Multi-Critère, par Système Multi-Agent Auto-Adaptatif, Application aux Constellations de Satellites d'Observ , 2017 .

[6]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[7]  Ulrich Derigs,et al.  Indirect search for the vehicle routing problem with pickup and delivery and time windows , 2008, OR Spectr..

[8]  Witold Pedrycz,et al.  An adaptive Simulated Annealing-based satellite observation scheduling method combined with a dynamic task clustering strategy , 2014, ArXiv.

[9]  Fatos Xhafa,et al.  Genetic algorithms for satellite scheduling problems , 2012, Mob. Inf. Syst..

[10]  Gérard Verfaillie,et al.  Selecting and scheduling observations of agile satellites , 2002 .

[11]  Hae-Dong Kim,et al.  Schedule Optimization of Imaging Missions for Multiple Satellites and Ground Stations Using Genetic Algorithm , 2018 .

[12]  Uwe Aickelin,et al.  An Indirect Genetic Algorithm for a Nurse Scheduling Problem , 2004, Comput. Oper. Res..

[13]  Yingwu Chen,et al.  An improved adaptive large neighborhood search algorithm for multiple agile satellites scheduling , 2018, Comput. Oper. Res..

[14]  Al Globus,et al.  Scheduling Earth Observing Fleets Using Evolutionary Algorithms: Problem Description and Approach , 2002 .

[15]  John A. W. McCall,et al.  A chain-model genetic algorithm for Bayesian network structure learning , 2007, GECCO '07.

[16]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Jing Liu,et al.  A multiagent evolutionary algorithm with direct and indirect combined representation for constraint satisfaction problems , 2017, Soft Comput..

[19]  Heinz Mühlenbein,et al.  The Equation for Response to Selection and Its Use for Prediction , 1997, Evolutionary Computation.

[20]  Fischetti Caprara,et al.  An Indirect Genetic Algorithm for Set Covering Problems , 2002 .

[21]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[22]  Mayowa Ayodele,et al.  Estimation of distribution algorithms for the Multi-Mode Resource Constrained Project scheduling problem , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[23]  Marie-Pierre Gleizes,et al.  Multi-satellite Mission Planning Using a Self-Adaptive Multi-agent System , 2015, 2015 IEEE 9th International Conference on Self-Adaptive and Self-Organizing Systems.

[24]  Jin Liu,et al.  A two-phase scheduling method with the consideration of task clustering for earth observing satellites , 2013, Comput. Oper. Res..

[25]  John N. Tsitsiklis,et al.  An Analysis of Stochastic Shortest Path Problems , 1991, Math. Oper. Res..

[26]  Gilbert Owusu,et al.  Spares parts optimization for legacy telecom networks using a permutation-based evolutionary algorithm , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).