Hybrid Planning Using Learning and Model Checking for Autonomous Systems

Self-adaptive software systems rely on planning to make adaptation decisions autonomously. Planning is required to produce high-quality adaptation plans in a timely manner; however, quality and timeliness of planning are conflicting in nature. This conflict can be reconciled with hybrid planning, which can combine reactive planning (to quickly provide an emergency response) with deliberative planning that take time but determine a higher-quality plan. While often effective, reactive planning sometimes risks making the situation worse. Hence, a challenge in hybrid planning is to decide whether to invoke reactive planning until the deliberative planning is ready with a high-quality plan. To make this decision, this paper proposes a novel learning-based approach. We demonstrate that this learning-based approach outperforms existing techniques that are based on specifying fixed conditions to invoke reactive planning in two domains: enterprise cloud systems and unmanned aerial vehicles.

[1]  Agathoniki Trigoni,et al.  Probabilistic target detection by camera-equipped UAVs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  Bradley R. Schmerl,et al.  Towards a Formal Framework for Hybrid Planning in Self-Adaptation , 2017, 2017 IEEE/ACM 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[3]  Samuel Kounev,et al.  Chameleon: A Hybrid, Proactive Auto-Scaling Mechanism on a Level-Playing Field , 2019, IEEE Transactions on Parallel and Distributed Systems.

[4]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[5]  Michael Veth Advanced Formation Flight Control. , 1994 .

[6]  Bradley R. Schmerl,et al.  SWIM: An Exemplar for Evaluation and Comparison of Self-Adaptation Approaches for Web Applications , 2018, 2018 IEEE/ACM 13th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[7]  Ashutosh Pandey,et al.  Hybrid Planning in Self-Adaptive Systems , 2017, 2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W).

[8]  David Garlan,et al.  Hybrid Planning for Decision Making in Self-Adaptive Systems , 2016, 2016 IEEE 10th International Conference on Self-Adaptive and Self-Organizing Systems (SASO).

[9]  Xin Yao,et al.  A Survey and Taxonomy of Self-Aware and Self-Adaptive Cloud Autoscaling Systems , 2016, ACM Comput. Surv..

[10]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[11]  Bradley R. Schmerl,et al.  Proactive self-adaptation under uncertainty: a probabilistic model checking approach , 2015, ESEC/SIGSOFT FSE.

[12]  Piergiorgio Bertoli,et al.  A Hybridized Planner for Stochastic Domains , 2007, IJCAI.

[13]  David Garlan,et al.  DARTSim: An Exemplar for Evaluation and Comparison of Self-Adaptation Approaches for Smart Cyber-Physical Systems , 2019, 2019 IEEE/ACM 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[14]  Mor Harchol-Balter,et al.  AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers , 2012, TOCS.

[15]  Johan Tordsson,et al.  Efficient provisioning of bursty scientific workloads on the cloud using adaptive elasticity control , 2012, ScienceCloud '12.