Model-based Testing for Performance Requirements

Model-Based Testing is a method that supports automated test design by using a model. Although it is adopted in industrial, it is still an open area within performance requirements. We aim to look into MBT for performance requirements and find out a framework that can model the performance requirements. We conducted a systematic mapping study, after that we conducted a sample study on software requirements specifications, then we introduced the Performance Requirements Verification and Validation (PRVV) model and finally, we completed another sample study to see how the model works in practice. We found that there are many models can be used for performance requirement while the maturity is not enough. MBT can be implemented in the context of performance, and it has been gaining momentum in recent years compared to earlier. The PRVV model we developed can verify the performance requirements and help to generate the test case.

[1]  Barry W. Boehm,et al.  Quantitative evaluation of software quality , 1976, ICSE '76.

[2]  Jim A. McCall,et al.  Factors in Software Quality. Volume I. Concepts and Definitions of Software Quality , 1977 .

[3]  Barry W. Boehm,et al.  Verifying and Validating Software Requirements and Design Specifications , 1989, IEEE Software.

[4]  Robert B. Grady,et al.  Software Metrics: Establishing a Company-Wide Program , 1987 .

[5]  Robert B. Grady,et al.  Practical Software Metrics for Project Management and Process Improvement , 1992 .

[6]  R. Geoff Dromey,et al.  A Model for Software Product Quality , 1995, IEEE Trans. Software Eng..

[7]  Amit Paradkar,et al.  Specification‐based testing using cause‐effect graphs , 1997, Ann. Softw. Eng..

[8]  Paul Clements,et al.  Coming attractions in software architecture , 1997, Proceedings of 5th International Workshop on Parallel and Distributed Real-Time Systems and 3rd Workshop on Object-Oriented Real-Time Systems.

[9]  Siddhartha R. Dalal,et al.  Model-based testing in practice , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[10]  Ivar Jacobson,et al.  The Unified Software Development Process , 1999 .

[11]  John Mylopoulos,et al.  Non-Functional Requirements in Software Engineering , 2000, International Series in Software Engineering.

[12]  P. Krutchen,et al.  The Rational Unified Process: An Introduction , 2000 .

[13]  Yann-Gaël Guéhéneuc,et al.  A Quality Model for Design Patterns , 2004 .

[14]  Ian Sommerville,et al.  Software Engineering (7th Edition) , 2004 .

[15]  Bruno Legeard,et al.  A taxonomy of model-based testing , 2006 .

[16]  Rajesh Subramanyan,et al.  A survey on model-based testing approaches: a systematic review , 2007, WEASELTech '07.

[17]  A. Jefferson Offutt,et al.  Introduction to Software Testing , 2008 .

[18]  William C. Osborn.  Performance Testing , 2009, Encyclopedia of Biometrics.

[19]  Guilherme Horta Travassos,et al.  A Picture from the Model-Based Testing Area: Concepts, Techniques, and Challenges , 2010, Adv. Comput..

[20]  Rafa E. Al-Qutaish.  Quality Models in Software Engineering Literature: An Analytical and Comparative Study , 2010 .

[21]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[22]  Ravinder Veer Hooda.  A FUTURE APPROACH FOR MODEL-BASED TESTING: ISSUES AND GUIDELINES , 2013 .

[23]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[24]  Ruth Breu,et al.  Model‐based security testing: a taxonomy and systematic classification , 2016, Softw. Test. Verification Reliab..

[25]  Uwe Fink,et al.  Performance Solutions A Practical Guide To Creating Responsive Scalable Software , 2016 .

[26]  Stefania Gnesi,et al.  Towards a Dataset for Natural Language Requirements Processing , 2017, REFSQ Workshops.

[27]  Brian Fitzgerald,et al.  The ABC of Software Engineering Research , 2018, ACM Trans. Softw. Eng. Methodol..

[28]  Maximilian Junker,et al.  Automated Test-Design from Requirements - The Specmate Tool , 2018, 2018 IEEE/ACM 5th International Workshop on Requirements Engineering and Testing (RET).

[29]  Kristian Wiklund,et al.  The Next Level of Test Automation: What About the Users? , 2018, 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).