A Survey on Model-Based Mission Planning and Execution for Autonomous Spacecraft

Different drivers are nowadays leading spacecraft toward an increased level of on-board autonomy. In this paper, we survey model-based techniques as a vehicle to implement highly autonomous on-board capabilities for spacecraft mission planning and execution. In this respect, spacecraft reconfiguration approaches based on Markovian Decision Process are explored, and then compared with other model-based alternatives. The integration of planning systems and dynamic reprogramming capabilities into the on-board software is presented. Finally, operational concepts for mission planning and execution in recent European space projects as well as the implementation of in-flight adaptive mission operations via on-board control procedures are also analyzed.

[1]  O. Bokhove.  Autonomous systems , 2006 .

[2]  Ufuk Topcu,et al.  Automata theory meets approximate dynamic programming: Optimal control with temporal logic constraints , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[3]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[4]  Maria Fox,et al.  Developing Autonomous AI Planning and Scheduling Technologies for Remote Planetary Exploration , 2003 .

[5]  Rui Xu,et al.  Realization of multi-agent planning system for autonomous spacecraft , 2005, Adv. Eng. Softw..

[6]  Krishna R. Pattipati,et al.  A Markov Decision Problem Approach to Goal Attainment , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Rob Sherwood,et al.  The EO-1 Autonomous Sciencecraft , 2007 .

[8]  Massimo Ferraguto,et al.  The On-Board Control Procedures Subsystem for the Herschel and Planck Satellites , 2008, 2008 32nd Annual IEEE International Computer Software and Applications Conference.

[9]  B. Biller.  Approximate Dynamic Programming for High-Dimensional Problems , 2008 .

[10]  Julien Marzat,et al.  Model-based fault diagnosis for aerospace systems: a survey , 2012 .

[11]  Rob Sherwood,et al.  Using Iterative Repair to Increase the Responsiveness of Planning and Scheduling for Autonomous Spacecraft , 1999 .

[12]  Jun Zhang,et al.  The Livingstone Model of a Spacecraft Power System , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[13]  Ilya Kolmanovsky,et al.  Science optimal spacecraft attitude maneuvering while accounting for failure mode , 2011 .

[14]  Luigi Glielmo,et al.  Spacecraft autonomy and reliability in MTG satellite via On-board Control Procedures , 2015, 2015 IEEE Metrology for Aerospace (MetroAeroSpace).

[15]  Xavier Olive,et al.  FDI(R) for satellites: How to deal with high availability and robustness in the space domain? , 2012, Int. J. Appl. Math. Comput. Sci..

[16]  Bart De Schutter,et al.  Approximate reinforcement learning: An overview , 2011, 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[17]  Javier Molina Morales,et al.  On-Board Control Procedures for ESA's Deep Space Missions Rosetta and Venus Express , 2005 .

[18]  Mohammad A. Jaradat,et al.  Reinforcement based mobile robot navigation in dynamic environment , 2011 .

[19]  G. Karsai,et al.  A software platform for fractionated spacecraft , 2012, 2012 IEEE Aerospace Conference.

[20]  G. Cancro,et al.  Uploadable Executable Specification Concept for Spacecraft Autonomy Systems , 2007, 2007 IEEE Aerospace Conference.

[21]  Koki Ho,et al.  Multi-Actor Value Modeling for Federated Systems , 2018, IEEE Systems Journal.

[22]  Octavio Camino,et al.  SMART-1 operations experience and lessons learnt , 2006 .

[23]  Afreen Siddiqi,et al.  Reconfigurability in planetary surface vehicles , 2009 .

[24]  Ari K. Jónsson,et al.  Autonomy in Space: Current Capabilities and Future Challenge , 2007, AI Mag..

[25]  Cui Pingyuan,et al.  Realization of multi-agent planning system for autonomous spacecraft , 2005 .

[26]  Luis Enrique Sucar,et al.  Executing concurrent actions with multiple Markov decision processes , 2009, 2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning.

[27]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[28]  Alexandra Wander,et al.  Innovative fault detection, isolation and recovery on-board spacecraft: Study and implementation using cognitive automation , 2013, 2013 Conference on Control and Fault-Tolerant Systems (SysTol).

[29]  Inseok Hwang,et al.  A Survey of Fault Detection, Isolation, and Reconfiguration Methods , 2010, IEEE Transactions on Control Systems Technology.

[30]  Charles D. Edwards,et al.  Operations concept for a Solar System Internetwork , 2011, 2011 Aerospace Conference.

[31]  Karl Iagnemma,et al.  Reconfigurability in planetary surface vehicles : Modelling approaches and case study , 2006 .

[32]  Jozef C. van der Ha.  Trends in cost-effective mission operations , 2003 .

[33]  Frank E. Grubbs,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[34]  Stephen A. Jacklin,et al.  Survey of Verification and Validation Techniques for Small Satellite Software Development , 2015 .

[35]  Marco Pavone,et al.  Spacecraft Autonomy Challenges for Next-Generation Space Missions , 2016 .

[36]  Martin Shaw,et al.  Multi-Mission End-to-End OBCP Configuration Control , 2012 .

[37]  Jens Eickhoff,et al.  The significant role of simulation in satellite development and verification ? ? This article was pr , 2005 .

[38]  Xin Xu,et al.  Reinforcement learning algorithms with function approximation: Recent advances and applications , 2014, Inf. Sci..

[39]  Luigi Glielmo,et al.  State aggregation approximate dynamic programming for model-based spacecraft autonomy , 2016, 2016 European Control Conference (ECC).

[40]  Brian C. Williams,et al.  MODEL-BASED AUTONOMY FOR THE NEXT GENERATION OF ROBOTIC SPACECRAFT , 2002 .

[41]  Xin Xu,et al.  A hierarchical path planning approach based on A⁎ and least-squares policy iteration for mobile robots , 2015, Neurocomputing.

[42]  V.K. Agrawal,et al.  Stratified agent architecture for on-board mission planning and execution for an autonomous spacecraft , 2008, TENCON 2008 - 2008 IEEE Region 10 Conference.

[43]  A. Martelli,et al.  ON-BOARD AUTONOMY VIA SYMBOLIC MODEL-BASED REASONING ∗ , 2008 .

[44]  Michail G. Lagoudakis,et al.  Least-Squares Policy Iteration , 2003, J. Mach. Learn. Res..

[45]  Charles Castel,et al.  FDIR Strategies for Autonomous Satellite Formations - A Preliminary Report , 2006, AAAI Fall Symposium: Spacecraft Autonomy.

[46]  Fabrício de Novaes Kucinskis,et al.  Taking the ECSS Autonomy Concepts One Step Further , 2010 .

[47]  Tara Estlin,et al.  Survey of Command Execution Systems for NASA Spacecraft and Robots , 2005 .

[48]  Michael G. Hinchey,et al.  Towards an ASSL specification model for NASA swarm-based exploration missions , 2008, SAC '08.

[49]  Roy Sterritt,et al.  Next generation system and software architectures: Challenges from future NASA exploration missions , 2006, Sci. Comput. Program..

[50]  Mark E. Campbell,et al.  Multiple agent-based autonomy for satellite constellations , 2000, Artif. Intell..

[51]  P. Pandurang Nayak,et al.  A Model-Based Approach to Reactive Self-Configuring Systems , 1996, AAAI/IAAI, Vol. 2.

[52]  Brian C. Williams,et al.  Model-based programming of intelligent embedded systems and robotic space explorers , 2003, Proc. IEEE.

[53]  B. Harshbarger.  An Introduction to Probability Theory and its Applications, Volume I , 1958 .

[54]  Ella M. Atkins,et al.  A Mission Based Fault Reconfiguration Framework for Spacecraft Applications , 2012, Infotech@Aerospace.

[55]  Seiko Shirasaka,et al.  Multi-stakeholder interactive simulation for federated satellite systems , 2014, 2014 IEEE Aerospace Conference.

[56]  Alessandro Golkar,et al.  The Federated Satellite Systems paradigm: Concept and business case evaluation , 2015 .

[57]  Nicola Muscettola,et al.  Design of the Remote Agent experiment for spacecraft autonomy , 1998, 1998 IEEE Aerospace Conference Proceedings (Cat. No.98TH8339).

[58]  Michael Pennotti,et al.  The Evolution of Software and Its Impact on Complex System Design in Robotic Spacecraft Embedded Systems , 2013, CSER.

[59]  Sheng-Tzong Cheng,et al.  A framework of an agent planning with reinforcement learning for e-pet , 2013, 2013 1st International Conference on Orange Technologies (ICOT).

[60]  Jo Bermyn,et al.  PROBA (Project for On-board Autonomy) , 2000 .

[61]  Lorraine M. Fesq.  Current fault management trends in NASA's planetary spacecraft , 2009, 2009 IEEE Aerospace conference.

[62]  Xavier Olive.  FDIR for satellites , 2012 .

[63]  Ben J. A. Kröse,et al.  Hierarchical dynamic programming for robot path planning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[64]  Joost-Pieter Katoen,et al.  Formal correctness, safety, dependability, and performance analysis of a satellite , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[65]  A. Bos,et al.  Space autonomy as migration of functionality: the Mars case , 2006, 2nd IEEE International Conference on Space Mission Challenges for Information Technology (SMC-IT'06).

[66]  Javier Molina Morales,et al.  OBSM Operations Automation through the Use of On-board Control Procedures , 2004 .

[67]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[68]  Claire Vallat,et al.  Rosetta science operations in support of the Philae mission , 2016 .

[69]  Massimo Tipaldi,et al.  Survey on Fault Detection, Isolation, and Recovery Strategies in the Space Domain , 2015, J. Aerosp. Inf. Syst..

[70]  Eduard Alarcon,et al.  On autonomous software architectures for distributed spacecraft: A Local-Global Policy , 2015, 2015 IEEE Aerospace Conference.

[71]  P. Di Lizia,et al.  Planning and implementation of the on-comet operations of the instrument SD2 onboard the lander Philae of Rosetta mission , 2016 .

[72]  Chad R. Frost.  Challenges and Opportunities for Autonomous Systems in Space , 2011 .

[73]  D. Bertsekas.  Approximate policy iteration: a survey and some new methods , 2011 .

[74]  J. Bresina,et al.  MAPGEN : mixed initiative planning and scheduling for the Mars '03 MER mission , 2003 .