Predicting Performance Properties for Open Systems with KAMI

Modern software systems are built to operate in an open world setting. By this we mean software that is conceived as a dynamically adaptable and evolvable aggregate of components that may change at run time to respond to continuous changes in the external world. Moreover, the software designer may have different degrees of ownership, control, and visibility of the different parts that compose an application. In this scenario, design-time assumptions may be based on knowledge that may have different degrees of accuracy for the different parts of the application and of the external world that interacts with the system. Furthermore, even if initially accurate, they may later change after the system is deployed and running. In this paper we investigate how these characteristics influence the way engineers can deal with performance attributes, such as response time. Following a model-driven approach, we discuss how to use at design time performance models based on Queuing Networks to drive architectural reasoning. We also discuss the possible use of keeping models alive at run time. This enables automatic re-estimation of model parameters to reflect the real behavior of the running system, re-execution of the model, and detection of possible failure, which may trigger a reaction that generates suitable architectural changes. We illustrate our contribution through a running example and numerical simulations that show the effectiveness of the proposed approach.

[1]  Shui F. Lam,et al.  Computer Capacity Planning: Theory and Practice , 1987 .

[2]  Jeffrey P. Buzen,et al.  Queueing Network Models of Multiprogramming , 1971, Outstanding Dissertations in the Computer Sciences.

[3]  Marin Litoiu.  Migrating to Web services: a performance engineering approach , 2004, J. Softw. Maintenance Res. Pract..

[4]  Paulo Merson,et al.  Model-Driven Performance Analysis , 2008, QoSA.

[5]  Christina Catley,et al.  Software Performance Engineering of a Web service-based Clinical Decision Support infrastructure , 2004, WOSP '04.

[6]  Steffen Becker,et al.  Model-Based performance prediction with the palladio component model , 2007, WOSP '07.

[7]  Günter Haring,et al.  Performance Evaluation: Origins and Directions , 2000, Lecture Notes in Computer Science.

[8]  Daniel A. Menascé,et al.  QoS Issues in Web Services , 2002, IEEE Internet Comput..

[9]  Amit P. Sheth,et al.  Performance Analysis and Simulation of Composite Web Services , 2003, Electron. Mark..

[10]  Luciano Baresi,et al.  Toward Open-World Software: Issue and Challenges , 2006, Computer.

[11]  Mike P. Papazoglou,et al.  Introduction: Service-oriented computing , 2003, CACM.

[12]  Amit P. Sheth,et al.  Modeling Quality of Service for Workflows and Web Service Processes , 2002 .

[13]  Gunter Bolch,et al.  Queueing Networks and Markov Chains - Modeling and Performance Evaluation with Computer Science Applications, Second Edition , 1998 .

[14]  Gregory A. Silver,et al.  Modeling and Simulation of Quality of Service for Composite Web Services , 2003 .

[15]  Paolo Bocciarelli,et al.  A model-driven approach to describe and predict the performance of composite services , 2007, WOSP '07.

[16]  Giuseppe Serazzi,et al.  The JMT Simulator for Performance Evaluation of Non-Product-Form Queueing Networks , 2007, 40th Annual Simulation Symposium (ANSS'07).

[17]  Thomas A. Corbi,et al.  The dawning of the autonomic computing era , 2003, IBM Syst. J..

[18]  Nenad Medvidovic,et al.  Early prediction of software component reliability , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[19]  Simonetta Balsamo,et al.  Product Form Queueing Networks , 2000, Performance Evaluation.

[20]  Swapna S. Gokhale,et al.  Architecture-Based Software Reliability Analysis: Overview and Limitations , 2007, IEEE Transactions on Dependable and Secure Computing.

[21]  Marin Litoiu,et al.  Performance Model Estimation and Tracking Using Optimal Filters , 2008, IEEE Transactions on Software Engineering.

[22]  Pinar Yolum,et al.  Computer and Information Sciences - ISCIS 2005, 20th International Symposium, Istanbul, Turkey, October 26-28, 2005, Proceedings , 2005, ISCIS.

[23]  Carlo Ghezzi,et al.  Quality Prediction of Service Compositions through Probabilistic Model Checking , 2008, QoSA.

[24]  Raffaela Mirandola,et al.  Performance Prediction of Web Service Workflows , 2007, QoSA.

[25]  Thomas O. Meservy,et al.  Transforming software development: an MDA road map , 2005, Computer.

[26]  Gunter Bolch,et al.  Queueing Networks and Markov Chains , 2005 .

[27]  Maria Luisa Villani,et al.  QoS-aware replanning of composite Web services , 2005, IEEE International Conference on Web Services (ICWS'05).

[28]  Mohammad Rob,et al.  The rise and fall of an e-commerce program , 2003, Commun. ACM.

[29]  Luciano Baresi,et al.  Toward open-world software: Issues and challenges , 2006, Computer.

[30]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.

[31]  Carlo Ghezzi,et al.  A journey to highly dynamic, self-adaptive service-based applications , 2008, Automated Software Engineering.

[32]  Heinrich Müller,et al.  Effiziente Methoden der geometrischen Modellierung und der wissenschaftlichen Visualisierung, Dagstuhl Seminar 1997 , 1999, Effiziente Methoden der geometrischen Modellierung und der wissenschaftlichen Visualisierung.

[33]  Yeonseung Ryu,et al.  Metrics, Methodology, and Tool for Performance-Considered Web Service Composition , 2005, ISCIS.

[34]  Carlo Ghezzi,et al.  Model evolution by run-time parameter adaptation , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[35]  Clemens A. Szyperski,et al.  Software Architectures, Components, and Applications, Third International Conference on Quality of Software Architectures, QoSA 2007, Medford, MA, USA, July 11-23, 2007, Revised Selected Papers , 2008, QoSA.

[36]  Connie U. Smith,et al.  New Book - Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software , 2001, Int. CMG Conference.

[37]  Jeffrey P. Buzen,et al.  Computational algorithms for closed queueing networks with exponential servers , 1973, Commun. ACM.

[38]  Mohamed Adel Serhani,et al.  A queuing model for service selection of multi-classes QoS-aware Web services , 2005, Third European Conference on Web Services (ECOWS'05).