Performance Issues? Hey DevOps, Mind the Uncertainty

DevOps is a novel trend that aims to bridge the gap between software development and operation teams. This article presents an experience report that better identifies performance uncertainties through a case study and provides a step-by-step guide to practitioners for controlling system uncertainties.

[1]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[2]  Yang Liu,et al.  Be conservative: enhancing failure diagnosis with proactive logging , 2012, OSDI 2012.

[3]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[4]  David Garlan,et al.  Software engineering in an uncertain world , 2010, FoSER '10.

[5]  Lieven Eeckhout,et al.  Statistically rigorous java performance evaluation , 2007, OOPSLA.

[6]  C. Murray Woodside.  Regression techniques for performance parameter estimation , 2010, WOSP/SIPEW '10.

[7]  Andres J. Ramirez,et al.  A taxonomy of uncertainty for dynamically adaptive systems , 2012, 2012 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[8]  Michael Httermann,et al.  DevOps for Developers , 2012 .

[9]  Ralph C. Smith,et al.  Uncertainty Quantification: Theory, Implementation, and Applications , 2013 .

[10]  Heather Goldsby,et al.  Automatically Generating Behavioral Models of Adaptive Systems to Address Uncertainty , 2008, MoDELS.

[11]  Paola Inverardi,et al.  EAGLE: engineering software in the ubiquitous globe by leveraging uncErtainty , 2011, ESEC/FSE '11.

[12]  Raffaela Mirandola,et al.  Dealing with uncertainties in the performance modelling of software systems , 2014, QoSA '14.

[13]  Norbert Siegmund,et al.  Transfer learning for performance modeling of configurable systems: An exploratory analysis , 2017, 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE).

[14]  Tomas Kalibera,et al.  Rigorous benchmarking in reasonable time , 2013, ISMM '13.

[15]  André van Hoorn,et al.  An efficient method for uncertainty propagation in robust software performance estimation , 2018, J. Syst. Softw..