Many Flies in One Swat: Automated Categorization of Performance Problem Diagnosis Results

As the importance of application performance grows in modern enterprise systems, many organizations employ application performance management (APM) tools to help them deal with potential performance problems during production. In addition to monitoring capabilities, these tools provide problem detection and alerting. In large enterprise systems these tools can report a very large number of performance problems. They have to be dealt with individually, in a time-consuming and error-prone manual process, even though many of them have a common root cause. In this vision paper, we propose using automatic categorization for dealing with large numbers of performance problems reported by APM tools. This leads to the aggregation of reported problems, reducing the work required for resolving them. Additionally, our approach opens the possibility of extending the analysis approaches to use this information for a more efficient diagnosis of performance problems.

[1]  Will Cappelli Magic Quadrant for Application Performance Monitoring , 2010 .

[2]  References , 1971 .

[3]  Victor L. Brailovsky,et al.  A probabilistic approach to clustering , 1991, Pattern Recognit. Lett..

[4]  André van Hoorn,et al.  Towards Performance Tooling Interoperability: An Open Format for Representing Execution Traces , 2016, EPEW.

[5]  Shan Lu,et al.  CARAMEL: Detecting and Fixing Performance Problems That Have Non-Intrusive Fixes , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[6]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[7]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[8]  Lior Rokach,et al.  Clustering Methods , 2005, The Data Mining and Knowledge Discovery Handbook.

[9]  André van Hoorn,et al.  Expert-Guided Automatic Diagnosis of Performance Problems in Enterprise Applications , 2016, 2016 12th European Dependable Computing Conference (EDCC).

[10]  Connie U. Smith,et al.  Software performance antipatterns , 2000, WOSP '00.

[11]  Jens Happe,et al.  Supporting swift reaction: Automatically uncovering performance problems by systematic experiments , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[12]  Federico Silva,et al.  Magic Quadrant for Application Performance Monitoring Suites , 2015 .

[13]  King Chun Foo AUTOMATED DISCOVERY OF PERFORMANCE REGRESSIONS IN ENTERPRISE APPLICATIONS , 2011 .

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[15]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[16]  Gilbert Hamann,et al.  Automatic Comparison of Load Tests to Support the Performance Analysis of Large Enterprise Systems , 2010, 2010 14th European Conference on Software Maintenance and Reengineering.

[17]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[18]  Ahmed E. Hassan,et al.  Automatic detection of performance deviations in the load testing of Large Scale Systems , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[19]  Zhen Ming Jiang,et al.  Automated analysis of load testing results , 2010, ISSTA '10.