ARRoW: automatic runtime reappraisal of weights for self-adaptation

[Context/Motivation] Decision-making for self-adaptive systems (SAS) requires the runtime trade-off of multiple non-functional requirements (NFRs) and the costs-benefits analysis of the alternative solutions. Usually, it is required the specification of the weights (a.k.a. preferences) associated with the NFRs and decision-making strategies. These preferences are traditionally defined at design-time. [Questions/Problems] A big challenge is the need to deal with unsuitable preferences, based on empirical evidence available at runtime, and which may not agree anymore with previous assumptions. Therefore, new techniques are needed to systematically reassess the current preferences according to empirical evidence collected at runtime. [Principal ideas/ results] We present ARRoW (Automatic Runtime Reappraisal of Weights) to support the dynamic update of preferences/weights associated with the NFRs and decision-making strategies in SAS, while taking into account the current levels of satisficement that NFRs can reach during the system's operation. [Contribution] To developed ARRoW, we have extended the Primitive Cognitive Network Process (P-CNP), a version of the Analytical Hierarchy Process (AHP), to enable the handling and update of weights during runtime. Specifically, in this paper, we show a formalization for the specification of the decision-making of a SAS in terms of NFRs, the design decisions and their corresponding weights as a P-CNP problem. We also report on how the P-CNP has been extended to be used at runtime. We show how the propagation of elements of P-CNP matrices is performed in such a way that the weights are updated to therefore, improve the levels of satisficement of the NFRs to better match the current environment during runtime. ARRoW leverages the Bayesian learning process underneath, which on the other hand, provides the mechanism to get access to evidence about the levels of satisficement of the NFRs. The experiments have been applied to a case study of the networking application domain where the decision-making has been improved.

[1]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[2]  Andres J. Ramirez,et al.  A taxonomy of uncertainty for dynamically adaptive systems , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[3]  David Garlan,et al.  User Guidance of Resource-Adaptive Systems , 2008, ICSOFT.

[4]  Earl T. Barr,et al.  Uncertainty, risk, and information value in software requirements and architecture , 2014, ICSE.

[5]  Kevin Kam Fung Yuen,et al.  The Primitive Cognitive Network Process in healthcare and medical decision making: Comparisons with the Analytic Hierarchy Process , 2014, Appl. Soft Comput..

[6]  Dirk Beyer,et al.  Designing for Disasters , 2004, FAST.

[7]  Nelly Bencomo,et al.  QuantUn: Quantification of uncertainty for the reassessment of requirements , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[8]  John Wilkes,et al.  Seneca: remote mirroring done write , 2003, USENIX Annual Technical Conference, General Track.

[9]  David Hsu,et al.  DESPOT: Online POMDP Planning with Regularization , 2013, NIPS.

[10]  Nelly Bencomo,et al.  RE-STORM: Mapping the Decision-Making Problem and Non-functional Requirements Trade-Off to Partially Observable Markov Decision Processes , 2018, 2018 IEEE/ACM 13th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[11]  Valérie Issarny,et al.  Dynamic decision networks for decision-making in self-adaptive systems: A case study , 2013, 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[12]  Hanna Kurniawati,et al.  An Online POMDP Solver for Uncertainty Planning in Dynamic Environment , 2013, ISRR.

[13]  Erik M. Fredericks.  Mitigating uncertainty at design time and run time to address assurance for dynamically adaptive systems , 2015 .

[14]  Andres J. Ramirez,et al.  Automatic derivation of utility functions for monitoring software requirements , 2011, MODELS'11.

[15]  Nelly Bencomo,et al.  A world full of surprises: bayesian theory of surprise to quantify degrees of uncertainty , 2014, ICSE Companion.

[16]  John Mylopoulos,et al.  Representing and reasoning about preferences in requirements engineering , 2011, Requirements Engineering.

[17]  Kevin Kam Fung Yuen,et al.  Cognitive network process with fuzzy soft computing technique in collective decision aiding , 2009 .

[18]  Nelly Bencomo,et al.  Juggling Preferences in a World of Uncertainty , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[19]  Siobhán Clarke,et al.  Self-adaptation with End-User Preferences: Using Run-Time Models and Constraint Solving , 2013, MoDELS.

[20]  Nelly Bencomo,et al.  Runtime Models Based on Dynamic Decision Networks: Enhancing the Decision-making in the Domain of Ambient Assisted Living Applications , 2016, Models@run.time.

[21]  Sebastian VanSyckel,et al.  A survey on engineering approaches for self-adaptive systems , 2015, Pervasive Mob. Comput..

[22]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Kevin Kam Fung Yuen,et al.  Towards a ranking approach for sensor services using primitive cognitive network process , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[24]  Nelly Bencomo,et al.  The Reassessment of Preferences of Non-functional Requirements for Better Informed Decision-Making in Self-Adaptation , 2016, 2016 IEEE 24th International Requirements Engineering Conference Workshops (REW).

[25]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[26]  Eric Horvitz,et al.  Decision theory in expert systems and artificial intelligenc , 1988, Int. J. Approx. Reason..

[27]  Joelle Pineau,et al.  Online Planning Algorithms for POMDPs , 2008, J. Artif. Intell. Res..