Model-based performance risk analysis

Performance is a nonfunctional software attribute that plays a crucial role in wide application domains spreading from safety-critical systems to e-commerce applications. Software risk can be quantified as a combination of the probability that a software system may fail and the severity of the damages caused by the failure. In this paper, we devise a methodology for estimation of performance-based risk factor, which originates from violations, of performance requirements, (namely, performance failures). The methodology elaborates annotated UML diagrams to estimate the performance failure probability and combines it with the failure severity estimate which is obtained using the functional failure analysis. We are thus able to determine risky scenarios as well as risky software components, and the analysis feedback can be used to improve the software design. We illustrate the methodology on an e-commerce case study using step-by step approach, and then provide a brief description of a case study based on large real system.

[1]  Hany H. Ammar,et al.  A Methodology for Architecture-Level Reliability Risk Analysis , 2002, IEEE Trans. Software Eng..

[2]  Rob Pooley,et al.  Using UML to Derive Stochastic Process Algebra Models , 1999 .

[3]  S. Mohan,et al.  Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software [Book Review] , 2003, IEEE Software.

[4]  John A. McDermid,et al.  Hierarchically Performed Hazard Origin and Propagation Studies , 1999, SAFECOMP.

[5]  Hassan Gomaa,et al.  Designing concurrent, distributed, and real-time applications with UML , 2000, ICSE.

[6]  D. Petriu.  Deriving Performance Models from UML Models by Graph Transformations , 2000 .

[7]  Susanna Donatelli,et al.  From UML sequence diagrams and statecharts to analysable petri net models , 2002, WOSP '02.

[8]  Eduardo Mena,et al.  A pattern-based approach to model software performance , 2000, WOSP '00.

[9]  Bruce Powell Douglass,et al.  Real-time UML (2nd ed.): developing efficient objects for embedded systems , 1997 .

[10]  David John Pumfrey,et al.  The principled design of computer system safety analyses , 1999 .

[11]  Eduardo Mena,et al.  Performance Evaluation for the Design of Agent-based Systems: A Petri Net Approach , 2000 .

[12]  Dorina C. Petriu,et al.  Architecture-Based Performance Analysis Applied to a Telecommunication System , 2000, IEEE Trans. Software Eng..

[13]  Pekka Kahkipuro.  UML Based Performance Modeling Framework for Object-Oriented Distributed Systems , 1999, UML.

[14]  Hany H. Ammar,et al.  Architectural-Level Risk Analysis Using UML , 2003, IEEE Trans. Software Eng..

[15]  Javier Campos,et al.  From UML activity diagrams to Stochastic Petri nets: application to software performance engineering , 2004, WOSP '04.

[16]  Peter King Rob Pooley,et al.  Using UML to Derive Stochastic Petri Net Models , 1999 .

[17]  Connie U. Smith,et al.  Performance Engineering of Software Systems , 1990, SIGMETRICS Perform. Evaluation Rev..

[18]  Daniel A. Menascé,et al.  Design and performance modeling of component interconnection patterns for distributed software architectures , 2000, WOSP '00.

[19]  Xin Wang,et al.  Deriving Software Performance Models from Architectural Patterns by Graph Transformations , 1998, TAGT.

[20]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide , 1998, J. Database Manag..

[21]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.

[22]  Jan Torin,et al.  Hazard analysis in object oriented design of dependable systems , 2001, 2001 International Conference on Dependable Systems and Networks.

[23]  Bruce Powel Douglass.  Real-time UML - developing efficient objects for embedded systems , 1997, Addison-Wesley object technology series.

[24]  Vittorio Cortellessa,et al.  PRIMA-UML: a performance validation incremental methodology on early UML diagrams , 2002, Sci. Comput. Program..

[25]  Dorina C. Petriu,et al.  XSLT transformation from UML models to LQN performance models , 2002, WOSP '02.