Review on Requirements Modeling and Analysis for Self-Adaptive Systems: A Ten-Year Perspective

Context: Over the last decade, software researchers and engineers have developed a vast body of methodologies and technologies in requirements engineering for self-adaptive systems. Although existing studies have explored various aspects of this field, no systematic study has been performed on summarizing modeling methods and corresponding requirements activities. Objective: This study summarizes the state-of-the-art research trends, details the modeling methods and corresponding requirements activities, identifies relevant quality attributes and application domains and assesses the quality of each study. Method: We perform a systematic literature review underpinned by a rigorously established and reviewed protocol. To ensure the quality of the study, we choose 21 highly regarded publication venues and 8 popular digital libraries. In addition, we apply text mining to derive search strings and use Kappa coefficient to mitigate disagreements of researchers. Results: We selected 109 papers during the period of 2003-2013 and presented the research distributions over various kinds of factors. We extracted 29 modeling methods which are classified into 8 categories and identified 14 requirements activities which are classified into 4 requirements timelines. We captured 8 concerned software quality attributes based on the ISO 9126 standard and 12 application domains. Conclusion: The frequency of application of modeling methods varies greatly. Enterprise models were more widely used while behavior models were more rigorously evaluated. Requirements-driven runtime adaptation was the most frequently studied requirements activity. Activities at runtime were conveyed with more details. Finally, we draw other conclusions by discussing how well modeling dimensions were considered in these modeling methods and how well assurance dimensions were conveyed in requirements activities.

[1]  B. Cheng,et al.  Specifying adaptation semantics , 2005, WADS@ICSE.

[2]  Andres J. Ramirez,et al.  Adaptive monitoring of software requirements , 2010, 2010 First International Workshop on Requirements@Run.Time.

[3]  Paola Inverardi,et al.  Requirements models at run-time to support consistent system evolutions , 2011, 2011 2nd International Workshop on Requirements@Run.Time.

[4]  Gordon S. Blair,et al.  Dynamically Adaptive Systems are Product Lines too: Using Model-Driven Techniques to Capture Dynamic Variability of Adaptive Systems , 2008, SPLC.

[5]  Danny Weyns,et al.  Guaranteeing robustness in a mobile learning Application using formally verified MAPE loops , 2013, 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[6]  Heather Goldsby,et al.  Automatically Generating Behavioral Models of Adaptive Systems to Address Uncertainty , 2008, MoDELS.

[7]  Yijun Yu,et al.  Stateful requirements monitoring for self-repairing socio-technical systems , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[8]  Akihiko Ohsuga,et al.  Towards Dynamic Evolution of Self-Adaptive Systems Based on Dynamic Updating of Control Loops , 2012, 2012 IEEE Sixth International Conference on Self-Adaptive and Self-Organizing Systems.

[9]  Yijun Yu,et al.  Are your sites down? Requirements-driven self-tuning for the survivability of Web systems , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[10]  Luciano Baresi,et al.  Live goals for adaptive service compositions , 2010, SEAMS '10.

[11]  Sebastián Uchitel,et al.  Synthesizing nonanomalous event-based controllers for liveness goals , 2013, TSEM.

[12]  Zhi Jin,et al.  A Systematic Literature Review of Requirements Modeling and Analysis for Self-adaptive Systems , 2014, REFSQ.

[13]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[14]  John Mylopoulos,et al.  An Architecture for Requirements-Driven Self-reconfiguration , 2009, CAiSE.

[15]  John Mylopoulos,et al.  Awareness Requirements , 2010, Software Engineering for Self-Adaptive Systems.

[16]  Yijun Yu,et al.  Goal-Directed Modeling of Self-adaptive Software Architecture , 2009, BMMDS/EMMSAD.

[17]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[18]  Fausto Giunchiglia,et al.  Tropos: An Agent-Oriented Software Development Methodology , 2004, Autonomous Agents and Multi-Agent Systems.

[19]  Yijun Yu,et al.  Monitoring and diagnosing software requirements , 2009, Automated Software Engineering.

[20]  Nelly Bencomo,et al.  RELAX: a language to address uncertainty in self-adaptive systems requirement , 2010, Requirements Engineering.

[21]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[22]  N. Bencomo,et al.  A Language for Self-Adaptive System Requirements , 2008, 2008 International Workshop on Service-Oriented Computing: Consequences for Engineering Requirements.

[23]  Jesper Andersson,et al.  Modeling Dimensions of Self-Adaptive Software Systems , 2009, Software Engineering for Self-Adaptive Systems.

[24]  Jin Zhi,et al.  Requirements modeling and system reconfiguration for self-adaptation of Internetware , 2012, Internetware.

[25]  John Mylopoulos,et al.  (Requirement) evolution requirements for adaptive systems , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[26]  M.S. Feather,et al.  Reconciling system requirements and runtime behavior , 1998, Proceedings Ninth International Workshop on Software Specification and Design.

[27]  Alistair Sutcliffe,et al.  Modeling Personalized Adaptive Systems , 2013, CAiSE.

[28]  Luciano Baresi,et al.  Adaptation Goals for Adaptive Service-Oriented Architectures , 2011, Relating Software Requirements and Architectures.

[29]  Massimo Cossentino,et al.  GoalSPEC: A Goal Specification Language Supporting Adaptivity and Evolution , 2013, EMAS@AAMAS.

[30]  John Mylopoulos,et al.  Reasoning with Goal Models , 2002, ER.

[31]  Sam Malek,et al.  FUSION: a framework for engineering self-tuning self-adaptive software systems , 2010, FSE '10.

[32]  Bashar Nuseibeh,et al.  On the role of primary and secondary assets in adaptive security: An application in smart grids , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[33]  Peter Sawyer,et al.  Requirements Tracing to Support Change in Dynamically Adaptive Systems , 2009, REFSQ.

[34]  Alan K. Mackworth,et al.  Artificial Intelligence - Foundations of Computational Agents , 2010 .

[35]  Heather Goldsby,et al.  Goal-Based Modeling of Dynamically Adaptive System Requirements , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[36]  Stephen Fickas,et al.  Goal-Directed Requirements Acquisition , 1993, Sci. Comput. Program..

[37]  David B. Knoester,et al.  Plato: a genetic algorithm approach to run-time reconfiguration in autonomic computing systems , 2011, Cluster Computing.

[38]  Mehdi Jazayeri,et al.  Runtime Adaptability through Automated Model Evolution , 2010, 2010 14th IEEE International Enterprise Distributed Object Computing Conference.

[39]  Thomas A. Corbi,et al.  The dawning of the autonomic computing era , 2003, IBM Syst. J..

[40]  Bashar Nuseibeh,et al.  Requirements engineering: a roadmap , 2000, ICSE '00.

[41]  Carlo Ghezzi,et al.  Run-time efficient probabilistic model checking , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[42]  Ladan Tahvildari,et al.  Self-adaptive software: Landscape and research challenges , 2009, TAAS.

[43]  Yijun Yu,et al.  Analysing monitoring and switching problems for adaptive systems , 2012, J. Syst. Softw..

[44]  Carlo Ghezzi,et al.  Reliability-driven dynamic binding via feedback control , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[45]  William N. Robinson,et al.  Monitoring software requirements using instrumented code , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[46]  Mathieu Acher,et al.  A feature-based approach to system deployment and adaptation , 2012, 2012 4th International Workshop on Modeling in Software Engineering (MISE).

[47]  Paola Inverardi,et al.  Leveraging State-Based User Preferences in Context-Aware Reconfigurations for Self-Adaptive Systems , 2011, SEFM.

[48]  Heather Goldsby,et al.  Modular verification of dynamically adaptive systems , 2009, AOSD '09.

[49]  Carlo Ghezzi,et al.  Self-adaptive software meets control theory: A preliminary approach supporting reliability requirements , 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011).

[50]  Betty H. C. Cheng,et al.  Model-based development of dynamically adaptive software , 2006, ICSE.

[51]  Barbara A. Kitchenham,et al.  Validating Search Processes in Systematic Literature Reviews , 2018, EAST.

[52]  Xin Peng,et al.  Towards Feature-Oriented Variability Reconfiguration in Dynamic Software Product Lines , 2011, ICSR.

[53]  Axel van Lamsweerde,et al.  Reasoning about partial goal satisfaction for requirements and design engineering , 2004, SIGSOFT '04/FSE-12.

[54]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[55]  Sam Malek,et al.  Ieee Transactions on Software Engineering 1 a Learning-based Framework for Engineering Feature-oriented Self-adaptive Software Systems , 2022 .

[56]  Ladan Tahvildari,et al.  Requirements driven software evolution , 2004, Proceedings. 12th IEEE International Workshop on Program Comprehension, 2004..

[57]  Don S. Batory,et al.  Feature Models, Grammars, and Propositional Formulas , 2005, SPLC.

[58]  Roy Sterritt,et al.  Self-managing software , 2006, Computer.

[59]  Raian Ali,et al.  Reasoning with contextual requirements: Detecting inconsistency and conflicts , 2013, Inf. Softw. Technol..

[60]  Marie-Pierre Gleizes,et al.  A Goal-Oriented Approach for Modelling Self-organising MAS , 2009, ESAW.

[61]  Mary Shaw,et al.  Engineering Self-Adaptive Systems through Feedback Loops , 2009, Software Engineering for Self-Adaptive Systems.

[62]  Vicente Pelechano,et al.  Dynamic evolution of context-aware systems with models at runtime , 2012, MODELS'12.

[63]  Akihiko Ohsuga,et al.  Dynamic reconfiguration in self-adaptive systems considering non-functional properties , 2012, SAC '12.

[64]  Gregor Engels,et al.  Adapt cases: extending use cases for adaptive systems , 2011, SEAMS '11.

[65]  Régine Laleau,et al.  Using RELAX, SysML and KAOS for Ambient Systems Requirements Modeling , 2012, ANT/MobiWIS.

[66]  John Mylopoulos,et al.  Requirements-Driven Qualitative Adaptation , 2012, OTM Conferences.

[67]  Mary Shaw,et al.  A Design Space for Self-Adaptive Systems , 2010, Software Engineering for Self-Adaptive Systems.

[68]  Bradley R. Schmerl,et al.  On Patterns for Decentralized Control in Self-Adaptive Systems , 2010, Software Engineering for Self-Adaptive Systems.

[69]  Giordano Tamburrelli,et al.  Probabilistic Verification at Runtime for Self-Adaptive Systems , 2013, Assurances for Self-Adaptive Systems.

[70]  Bashar Nuseibeh,et al.  Engineering adaptive privacy: On the role of privacy awareness requirements , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[71]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[72]  Mordechai Ben-Ari,et al.  The temporal logic of branching time , 1981, POPL '81.

[73]  Franco Zambonelli,et al.  Model Checking Goal-Oriented Requirements for Self-Adaptive Systems , 2012, 2012 IEEE 19th International Conference and Workshops on Engineering of Computer-Based Systems.

[74]  Xin Peng,et al.  Software Product Line Engineering for Developing Self-Adaptive Systems: Towards the Domain Requirements , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[75]  William N. Robinson A requirements monitoring framework for enterprise systems , 2005, Requirements Engineering.

[76]  Heather Goldsby,et al.  Goal-oriented specification of adaptation requirements engineering in adaptive systems , 2006, SEAMS '06.

[77]  Raian Ali,et al.  A goal-based framework for contextual requirements modeling and analysis , 2010, Requirements Engineering.

[78]  Ladan Tahvildari,et al.  Towards a goal‐driven approach to action selection in self‐adaptive software , 2012, Softw. Pract. Exp..

[79]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[80]  Jianmin Wang,et al.  Goal-driven adaptation of internetware , 2010, Internetware.

[81]  João Pimentel,et al.  Deriving software architectural models from requirements models for adaptive systems: the STREAM-A approach , 2011, Requirements Engineering.

[82]  Pattie Maes,et al.  Concepts and experiments in computational reflection , 1987, OOPSLA '87.

[83]  Pericles Loucopoulos,et al.  System Requirements Engineering , 1995, System Requirements Engineering.

[84]  Seyed Masoud Sadjadi,et al.  Composing adaptive software , 2004, Computer.

[85]  Lin Liu,et al.  Goal-oriented requirements modelling for running systems , 2010, 2010 First International Workshop on Requirements@Run.Time.

[86]  Eric S. K. Yu,et al.  Towards modelling and reasoning support for early-phase requirements engineering , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[87]  Christel Baier,et al.  Principles of model checking , 2008 .

[88]  Akihiko Ohsuga,et al.  gocc: a configuration compiler for self-adaptive systems using goal-oriented requirements description , 2011, SEAMS '11.

[89]  Anna Perini,et al.  Towards a Requirements Modeling Language for Self-Adaptive Systems , 2012, REFSQ.

[90]  Hernán Astudillo,et al.  Mitigating the obsolescence of quality specifications models in service-based systems , 2012, 2012 Second IEEE International Workshop on Model-Driven Requirements Engineering (MoDRE).

[91]  Martin S. Feather,et al.  Requirements monitoring in dynamic environments , 1995, Proceedings of 1995 IEEE International Symposium on Requirements Engineering (RE'95).

[92]  Luciano Baresi,et al.  Fuzzy Goals for Requirements-Driven Adaptation , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[93]  Xin Peng,et al.  Quality-Driven Self-Adaptation: Bridging the Gap between Requirements and Runtime Architecture by Design Decision , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[94]  John Mylopoulos,et al.  Adaptive socio-technical systems: a requirements-based approach , 2011, Requirements Engineering.

[95]  John Mylopoulos,et al.  System Identification for Adaptive Software Systems: A Requirements Engineering Perspective , 2011, ER.

[96]  Peter Sawyer,et al.  Understanding the Scope of Uncertainty in Dynamically Adaptive Systems , 2010, REFSQ.

[97]  Carlo Ghezzi,et al.  Model evolution by run-time parameter adaptation , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[98]  Liliana Pasquale,et al.  Monitoring fuzzy temporal requirements for service compositions: Motivations, challenges and experimental results , 2011, 2011 Workshop on Requirements Engineering for Systems, Services and Systems-of-Systems.

[99]  Bradley R. Schmerl,et al.  Software Engineering for Self-Adaptive Systems: A Second Research Roadmap , 2010, Software Engineering for Self-Adaptive Systems.

[100]  Jesper Andersson,et al.  Software Engineering Processes for Self-Adaptive Systems , 2013, Software Engineering for Self-Adaptive Systems.

[101]  Jun Han,et al.  A systematic survey on the design of self-adaptive software systems using control engineering approaches , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[102]  David B. Knoester,et al.  Applying genetic algorithms to decision making in autonomic computing systems , 2009, ICAC '09.

[103]  John Mylopoulos,et al.  Designing an adaptive computer‐aided ambulance dispatch system with Zanshin: an experience report , 2015, Softw. Pract. Exp..

[104]  Stephen Yurkovich,et al.  Fuzzy Control , 1997 .

[105]  Gregor Engels,et al.  High-quality specification of self-adaptive software systems , 2013, 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[106]  Yongwang Zhao,et al.  Development of global specification for dynamically adaptive software , 2013, Computing.

[107]  Zhi Jin,et al.  Modeling and Specifying Parametric Adaptation Mechanism for Self-Adaptive Systems , 2014, APRES.

[108]  Andres J. Ramirez,et al.  Automatically RELAXing a Goal Model to Cope with Uncertainty , 2012, SSBSE.

[109]  Hernán Astudillo,et al.  Addressing the QoS drift in specification models of self-adaptive service-based systems , 2013, 2013 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE).

[110]  Nelly Bencomo,et al.  Self-Explanation in Adaptive Systems , 2012, 2012 IEEE 17th International Conference on Engineering of Complex Computer Systems.

[111]  Anna Perini,et al.  Towards goal-oriented development of self-adaptive systems , 2008, SEAMS '08.

[112]  Carlo Ghezzi,et al.  Managing non-functional uncertainty via model-driven adaptivity , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[113]  Sam Malek,et al.  A Systematic Survey of Self-Protecting Software Systems , 2014, ACM Trans. Auton. Adapt. Syst..

[114]  Sebastián Uchitel,et al.  Synthesis of live behaviour models , 2010, FSE '10.

[115]  John Mylopoulos,et al.  Awareness requirements for adaptive systems , 2011, SEAMS '11.

[116]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[117]  Bashar Nuseibeh,et al.  Requirements-driven adaptive security: Protecting variable assets at runtime , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[118]  Heather Goldsby,et al.  AMOEBA-RT: Run-Time Verification of Adaptive Software , 2008, MoDELS.

[119]  Robert Laddaga,et al.  Self-Adaptive Software , 2001, Lecture Notes in Computer Science.

[120]  Muhammad Ali Babar,et al.  Identifying relevant studies in software engineering , 2011, Inf. Softw. Technol..

[121]  John Mylopoulos,et al.  Adaptive Service Composition Based on Runtime Requirements Monitoring , 2011, 2011 IEEE International Conference on Web Services.

[122]  Andres J. Ramirez,et al.  Automatic derivation of utility functions for monitoring software requirements , 2011, MODELS'11.

[123]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[124]  Raian Ali,et al.  Optimizing Monitoring Requirements in Self-adaptive Systems , 2012, BMMDS/EMMSAD.

[125]  John Mylopoulos,et al.  Self-Repair through Reconfiguration: A Requirements Engineering Approach , 2009, 2009 IEEE/ACM International Conference on Automated Software Engineering.

[126]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[127]  Yongwang Zhao,et al.  Model Checking of Adaptive Programs with Mode-extended Linear Temporal Logic , 2011, 2011 Eighth IEEE International Conference and Workshops on Engineering of Autonomic and Autonomous Systems.

[128]  Marin Litoiu,et al.  Goal-Based Behavioral Customization of Information Systems , 2011, CAiSE.

[129]  Valérie Issarny,et al.  Dynamic decision networks for decision-making in self-adaptive systems: A case study , 2013, 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[130]  Bill N. Schilit,et al.  Disseminating active map information to mobile hosts , 1994, IEEE Network.

[131]  Danny Weyns,et al.  A Case Study on Formal Verification of Self-Adaptive Behaviors in a Decentralized System , 2012, FOCLASA.

[132]  Yijun Yu,et al.  An automated approach to monitoring and diagnosing requirements , 2007, ASE.

[133]  Neil A. Ernst,et al.  Towards a continuous requirements engineering framework for self-adaptive systems , 2010, 2010 First International Workshop on Requirements@Run.Time.

[134]  Anna Perini,et al.  Requirements comprehension: A controlled experiment on conceptual modeling methods , 2011, Workshop on Empirical Requirements Engineering (EmpiRE 2011).

[135]  Luciano Baresi,et al.  Adaptive Goals for Self-Adaptive Service Compositions , 2010, 2010 IEEE International Conference on Web Services.

[136]  Jing Li,et al.  Towards Verifying Global Properties of Adaptive Software Based on Linear Temporal Logic , 2011, 2011 IEEE International Conference on Advanced Information Networking and Applications.

[137]  Carlo Ghezzi,et al.  A formal approach to adaptive software: continuous assurance of non-functional requirements , 2011, Formal Aspects of Computing.

[138]  Lidia Fuentes,et al.  Run-time adaptation of mobile applications using genetic algorithms , 2013, 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[139]  Andres J. Ramirez,et al.  Automatically generating adaptive logic to balance non-functional tradeoffs during reconfiguration , 2010, ICAC '10.

[140]  William N. Robinson,et al.  Monitoring Web service requirements , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[141]  Bashar Nuseibeh,et al.  Specifying Monitoring and Switching Problems in Context , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[142]  Bashar Nuseibeh,et al.  Social Adaptation at Runtime , 2012, ENASE.

[143]  Nelly Bencomo,et al.  A Goal-Based Modeling Approach to Develop Requirements of an Adaptive System with Environmental Uncertainty , 2009, MoDELS.

[144]  Nelly Bencomo,et al.  Supporting Decision-Making for Self-Adaptive Systems: From Goal Models to Dynamic Decision Networks , 2013, REFSQ.

[145]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[146]  P. Sawyer,et al.  Visualizing the Analysis of Dynamically Adaptive Systems Using i* and DSLs , 2007, Second International Workshop on Requirements Engineering Visualization (REV 2007).

[147]  Marin Litoiu,et al.  Behavioral adaptation of information systems through goal models , 2012, Inf. Syst..

[148]  Danny Weyns,et al.  A survey of formal methods in self-adaptive systems , 2012, C3S2E '12.

[149]  Nelly Bencomo,et al.  RELAX: Incorporating Uncertainty into the Specification of Self-Adaptive Systems , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[150]  Mary Shaw,et al.  Software Engineering for Self-Adaptive Systems: A Research Roadmap , 2009, Software Engineering for Self-Adaptive Systems.

[151]  Raian Ali,et al.  A Goal Modeling Framework for Self-contextualizable Software , 2009, BMMDS/EMMSAD.

[152]  Sam Malek,et al.  Taming uncertainty in self-adaptive software , 2011, ESEC/FSE '11.

[153]  Ji Zhang,et al.  Using temporal logic to specify adaptive program semantics , 2006, J. Syst. Softw..

[154]  Yijun Yu,et al.  Self-tuning of software systems through dynamic quality tradeoff and value-based feedback control loop , 2012, J. Syst. Softw..

[155]  Jesper Andersson,et al.  Claims and supporting evidence for self-adaptive systems: A literature study , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[156]  Nelly Bencomo,et al.  Relaxing claims: coping with uncertainty while evaluating assumptions at run time , 2012, MODELS'12.

[157]  Debanjan Ghosh,et al.  Self-healing systems - survey and synthesis , 2007, Decis. Support Syst..

[158]  Gabor Karsai,et al.  Towards Practical Runtime Verification and Validation of Self-Adaptive Software Systems , 2013, Software Engineering for Self-Adaptive Systems.

[159]  Steffen Becker,et al.  Performance analysis of self-adaptive systems for requirements validation at design-time , 2013, QoSA '13.

[160]  Danny Weyns,et al.  Towards an integrated approach for validating qualities of self-adaptive systems , 2012, WODA 2012.

[161]  Helen M. Edwards,et al.  Problem frames: analyzing and structuring software development problems , 2002, Softw. Test. Verification Reliab..

[162]  Carlo Ghezzi,et al.  Dealing with Non-Functional Requirements for Adaptive Systems via Dynamic Software Product-Lines , 2010, Software Engineering for Self-Adaptive Systems.