Detecting and analyzing I/O performance regressions

Regression testing can be performed by reexecuting a test suite on different software versions and comparing the outcome. For functional testing, the outcome of such tests is either pass (correct behavior) or fail (incorrect behavior). For nonfunctional testing, such as performance testing, this is more challenging as correct and incorrect are not clearly defined concepts for these types of testing.

[1]  Alex Potanin,et al.  A study of performance variations in the Mozilla Firefox web browser , 2013 .

[2]  Steven P. Reiss,et al.  Visualizing the Java heap to detect memory problems , 2009, 2009 5th IEEE International Workshop on Visualizing Software for Understanding and Analysis.

[3]  Jun Wang,et al.  TRIBLER: a social‐based peer‐to‐peer system , 2008, IPTPS.

[4]  Julio Cesar Sampaio do Prado Leite,et al.  On Non-Functional Requirements in Software Engineering , 2009, Conceptual Modeling: Foundations and Applications.

[5]  Brad Chen,et al.  Locating System Problems Using Dynamic Instrumentation , 2010 .

[6]  Cor-Paul Bezemer,et al.  Performance optimization of deployed software-as-a-service applications , 2014, J. Syst. Softw..

[7]  Alexandre Bergel,et al.  Execution profiling blueprints , 2012, Softw. Pract. Exp..

[8]  Alexandru Iosup,et al.  TRIBLER: a social-based peer-to-peer system: Research Articles , 2008 .

[9]  Gregg Rothermel,et al.  Analyzing Regression Test Selection Techniques , 1996, IEEE Trans. Software Eng..

[10]  Juan Pablo Sandoval Alcocer.  Tracking down software changes responsible for performance loss , 2012, IWST.

[11]  Serap A. Savari,et al.  Comparing and Combining Profiles , 2000, J. Instr. Level Parallelism.

[12]  Peter Zoeteweij,et al.  An Evaluation of Similarity Coefficients for Software Fault Localization , 2006, 2006 12th Pacific Rim International Symposium on Dependable Computing (PRDC'06).

[13]  Johan Pouwelse,et al.  Dispersy Bundle Synchronization , 2013 .

[14]  A.J.C. van Gemund,et al.  On the Accuracy of Spectrum-based Fault Localization , 2007, Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007).

[15]  Gilbert Hamann,et al.  Automated performance analysis of load tests , 2009, 2009 IEEE International Conference on Software Maintenance.

[16]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[17]  Andy Zaidman,et al.  Identifying cross-cutting concerns using software repository mining , 2010, IWPSE-EVOL '10.

[18]  Dorina C. Petriu,et al.  The Future of Software Performance Engineering , 2007, Future of Software Engineering (FOSE '07).

[19]  Bezemer Cor-paul.  Performance regression reports , 2014 .

[20]  Ahmed E. Hassan,et al.  Automated detection of performance regressions using statistical process control techniques , 2012, ICPE '12.