Capacity Management as a Service for Enterprise Standard Software

Capacity management approaches optimize component utilization from a strong technical perspective. In fact, the quality of involved services is considered implicitly by linking it to resource capacity values. This practice hinders to evaluate design alternatives with respect to given service levels that are expressed in user-centric metrics such as the mean response time for a business transaction. We argue that utilized historical workload traces often contain a variety of performance-related information that allows for the integration of performance prediction techniques through machine learning. Since enterprise applications excessively make use of standard software that is shipped by large software vendors to a wide range of customers, standardized prediction models can be trained and provisioned as part of a capacity management service which we propose in this article. Therefore, we integrate knowledge discovery activities into well-known capacity planning steps, which we adapt to the special characteristics of enterprise applications. Using a real-world example, we demonstrate how prediction models that were trained on a large scale of monitoring data enable cost-efficient measurement-based prediction techniques to be used in early design and redesign phases of planned or running applications. Finally, based on the trained model, we demonstrate how to simulate and analyze future workload scenarios. Using a Pareto approach, we were able to identify cost-effective design alternatives for an enterprise application whose capacity is being managed.

[1]  Martin Bichler,et al.  A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers , 2010, IEEE Transactions on Services Computing.

[2]  Helmut Krcmar,et al.  Generic performance prediction for ERP and SOA applications , 2011, ECIS.

[3]  Kay Wilhelm Capacity Planning for SAP , 2001 .

[4]  T. Gneiting Making and Evaluating Point Forecasts , 2009, 0912.0902.

[5]  Gebhard Kirchgässner,et al.  Introduction to Modern Time Series Analysis , 2007 .

[6]  Rajkumar Buyya,et al.  Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers , 2010, MGC '10.

[7]  Sascha Bosse,et al.  Multidimensional Workload Consolidation for Enterprise Application Service Providers , 2016, AMCIS.

[8]  Matthias Pohl,et al.  Capacity Planning as a Service for Enterprise Standard Software , 2017, 2017 IEEE 19th Conference on Business Informatics (CBI).

[9]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[10]  Andrian Marcus,et al.  Data Cleansing: A Prelude to Knowledge Discovery , 2005, Data Mining and Knowledge Discovery Handbook.

[11]  Jez Humble,et al.  Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation , 2010 .

[12]  Rob Procter,et al.  Fitting Standard Software Packages to Non-standard Organizations: The ‘Biography’ of an Enterprise-wide System , 2003, Technol. Anal. Strateg. Manag..

[13]  Alexander Stage,et al.  Decision support for virtual machine reassignments in enterprise data centers , 2010, 2010 IEEE/IFIP Network Operations and Management Symposium Workshops.

[14]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[15]  Tilmann Rabl,et al.  Solving Big Data Challenges for Enterprise Application Performance Management , 2012, Proc. VLDB Endow..

[16]  Kay Chen Tan,et al.  On solving multiobjective bin packing problems using evolutionary particle swarm optimization , 2008, Eur. J. Oper. Res..

[17]  Jerome A. Rolia,et al.  Automating Enterprise Application Placement in Resource Utilities , 2003, DSOM.

[18]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[19]  Martin Bichler,et al.  Capacity Planning for Virtualized Servers , 2007 .

[20]  Sascha Bosse,et al.  Predicting an IT Service's Availability with Respect to Operator Errors , 2013, AMCIS.

[21]  Bratislav Milic,et al.  Automatic Generation of Service Availability Models , 2011, IEEE Transactions on Services Computing.

[22]  Steffen Becker,et al.  The Palladio component model for model-driven performance prediction , 2009, J. Syst. Softw..

[23]  Eila Niemelä,et al.  Survey of reliability and availability prediction methods from the viewpoint of software architecture , 2007, Software & Systems Modeling.

[24]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[25]  Toni M. Somers,et al.  The impact of critical success factors across the stages of enterprise resource planning implementations , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[26]  Laurent Lefèvre,et al.  A survey on techniques for improving the energy efficiency of large-scale distributed systems , 2014, ACM Comput. Surv..

[27]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[28]  Helmut Krcmar,et al.  Continuous performance evaluation and capacity planning using resource profiles for enterprise applications , 2017, J. Syst. Softw..

[29]  Yvonne Dittrich,et al.  ERP Customization as Software Engineering: Knowledge Sharing and Cooperation , 2009, IEEE Software.

[30]  Virgílio A. F. Almeida,et al.  Capacity Planning: an Essential Tool for Managing Web Services , 2002 .

[31]  David Filani Dynamic Data Center Power Management Trends, Issues, and Solutions , 2008 .

[32]  Liang Liu,et al.  A multi-objective ant colony system algorithm for virtual machine placement in cloud computing , 2013, J. Comput. Syst. Sci..

[33]  Connie U. Smith,et al.  Increasing Information Systems Productivity by Software Performance Engineering , 1981, Int. CMG Conference.

[34]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[35]  Sascha Bosse,et al.  Optimizing Server Consolidation for Enterprise Application Service Providers , 2016, PACIS.

[36]  H. Simon,et al.  Administrative Behavior: A Study of Decision-Making Processes in Administrative Organization. , 1959 .

[37]  Jing Xu,et al.  Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[38]  Leonid Grinshpan Solving Enterprise Applications Performance Puzzles: Queuing Models to the Rescue , 2012 .

[39]  Hui Li,et al.  SLA-driven planning and optimization of enterprise applications , 2010, WOSP/SIPEW '10.

[40]  Sascha Bosse,et al.  Collaborative Software Performance Engineering for Enterprise Applications , 2017, HICSS.

[41]  Daniel A. Menascé,et al.  Understanding Cloud Computing: Experimentation and Capacity Planning , 2009, Int. CMG Conference.

[42]  Jens Happe,et al.  The Performance Cockpit Approach: A Framework For Systematic Performance Evaluations , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[43]  Wilhelm Hasselbring,et al.  Performance-oriented DevOps: A Research Agenda , 2015, ArXiv.

[44]  Michael J. Sydor APM Best Practices: Realizing Application Performance Management , 2010 .

[45]  Paola Inverardi,et al.  Model-based performance prediction in software development: a survey , 2004, IEEE Transactions on Software Engineering.

[46]  Samuel Kounev,et al.  Architecture-level software performance abstractions for online performance prediction , 2014, Sci. Comput. Program..

[47]  Henri Casanova,et al.  Resource allocation algorithms for virtualized service hosting platforms , 2010, J. Parallel Distributed Comput..

[48]  Jerome A. Rolia,et al.  A capacity management service for resource pools , 2005, WOSP '05.

[49]  Daniel A. Menascé,et al.  Composing Web Services: A QoS View , 2004, IEEE Internet Comput..

[50]  Sascha Bosse,et al.  Multi-objective optimization of IT service availability and costs , 2016, Reliab. Eng. Syst. Saf..

[51]  Jerome A. Rolia,et al.  R-Opus: A Composite Framework for Application Performability and QoS in Shared Resource Pools , 2006, International Conference on Dependable Systems and Networks (DSN'06).

[52]  Qi Zhang,et al.  A regression-based analytic model for capacity planning of multi-tier applications , 2008, Cluster Computing.

[53]  Frank Klawonn,et al.  Guide to Intelligent Data Analysis - How to Intelligently Make Sense of Real Data , 2010, Texts in Computer Science.

[54]  John Bell,et al.  A review of methods for the assessment of prediction errors in conservation presence/absence models , 1997, Environmental Conservation.

[55]  Virgílio A. F. Almeida Capacity Planning for Web Services , 2002, Performance.

[56]  Federico Silva,et al.  Magic Quadrant for Application Performance Monitoring Suites , 2015 .

[57]  Richard E. Brown,et al.  United States Data Center Energy Usage Report , 2016 .

[58]  D.Lynn Shaeffer,et al.  A model evaluation methodology applicable to environmental assessment models , 1980 .