Improving Performance Requirements Specifications from Field Failure Reports

Customer-reported field failures provide valuable information for the requirements of the next release. Without a systematic approach, the requirements of the next release may not address the field failures, and the same problems may reoccur. In this paper, we propose a procedure for improving performance requirements based on a retrospective analysis of field failures reports and original requirements. In our procedure, the performance information from field failure reports and original requirements specifications is extracted based on a performance meta-model. The extracted information is used to construct new and revised performance requirements, following the performance refinement and evolution model. We applied this procedure on the requirements specifications and field failure reports for a commercial distributed software system. The results from our case study demonstrate that the resulting requirements integrate the information found in the field failure reports.

[1]  C. Murray Woodside,et al.  A Metamodel for Generating Performance Models from UML Designs , 2004, UML.

[2]  Victor R. Basili,et al.  The Future Engineering of Software: A Management Perspective , 1991, Computer.

[3]  Chih-Wei Ho Deriving Performance Requirements and Test Cases with the Performance Refinement and Evolution Model ( PREM ) , 2006 .

[4]  Laurie A. Williams,et al.  Developing software performance with the performance refinement and evolution model , 2007, WOSP '07.

[5]  Brian A. Nixon,et al.  Managing performance requirements for information systems , 1998, WOSP '98.

[6]  Elaine J. Weyuker,et al.  Software performance testing based on workload characterization , 2002, WOSP '02.

[7]  Robyn R. Lutz,et al.  Resolving requirements discovery in testing and operations , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[8]  Vittorio Cortellessa How far are we from the definition of a common software performance ontology? , 2005, WOSP '05.

[9]  Connie U. Smith,et al.  Performance model interchange format (PMIF 2.0): XML definition and implementation , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[10]  Tiffany Barnes,et al.  An integrated scenario management strategy , 1999, Proceedings IEEE International Symposium on Requirements Engineering (Cat. No.PR00188).

[11]  Inderpal S. Bhandari,et al.  Orthogonal Defect Classification - A Concept for In-Process Measurements , 1992, IEEE Trans. Software Eng..

[12]  Robyn R. Lutz,et al.  Using occurrence properties of defect report data to improve requirements , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).