Architecture-Level Software Performance Models for Online Performance Prediction

Proactive performance and resource management of modern IT infrastructures requires the ability to predict at run-time, how the performance of running services would be affected if the workload or the system changes. In this thesis, modeling and prediction facilities that enable online performance prediction during system operation are presented. Analyses about the impact of reconfigurations and workload trends can be conducted on the model level, without executing expensive performance tests.

[1]  Fabian Brosig.  Online Performance Prediction with Architecture-Level Performance Models , 2011, Software Engineering.

[2]  Steffen Becker,et al.  Performance analysis of self-adaptive systems for requirements validation at design-time , 2013, QoSA '13.

[3]  Richard Mortier,et al.  Using Magpie for Request Extraction and Workload Modelling , 2004, OSDI.

[4]  Rouven Krebs,et al.  Metrics and techniques for quantifying performance isolation in cloud environments , 2014, Sci. Comput. Program..

[5]  Falko Bause,et al.  Queueing Petri Nets-A formalism for the combined qualitative and quantitative analysis of systems , 1993, Proceedings of 5th International Workshop on Petri Nets and Performance Models.

[6]  Jerome A. Rolia,et al.  Measurement Tools and Modeling Techniques for Evaluating Web Server Performance , 1997, Computer Performance Evaluation.

[7]  Samuel Kounev,et al.  Performance queries for architecture-level performance models , 2014, ICPE.

[8]  Stephen Dawson,et al.  Resource demand modeling for multi-tier services , 2010, WOSP/SIPEW '10.

[9]  Clemens A. Szyperski,et al.  Component software - beyond object-oriented programming, 2nd Edition , 2002, Addison-Wesley component software series.

[10]  Fabian Gorsler.  Online Performance Queries for Architecture-Level Performance Models , 2013 .

[11]  C. Murray Woodside,et al.  Interaction tree algorithms to extract effective architecture and layered performance models from traces , 2007, J. Syst. Softw..

[12]  Samuel Kounev,et al.  Evaluating and Modeling Virtualization Performance Overhead for Cloud Environments , 2011, CLOSER.

[13]  E. Burton Swanson,et al.  The dimensions of maintenance , 1976, ICSE '76.

[14]  Samuel Kounev,et al.  Modeling dynamic virtualized resource landscapes , 2012, QoSA '12.

[15]  Daniel A. Menascé,et al.  On the Use of Performance Models to Design Self-Managing Computer Systems , 2003, Int. CMG Conference.

[16]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[17]  Samuel Kounev,et al.  S/T/A: Meta-Modeling Run-Time Adaptation in Component-Based System Architectures , 2012, 2012 IEEE Ninth International Conference on e-Business Engineering.

[18]  Ludmila Cherkasova,et al.  XenMon: QoS Monitoring and Performance Profiling Tool , 2005 .

[19]  Mark S. Squillante,et al.  Workload service requirements analysis: a queueing network optimization approach , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[20]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[21]  Barton P. Miller,et al.  The Paradyn Parallel Performance Measurement Tool , 1995, Computer.

[22]  Henry H. Liu,et al.  Software Performance and Scalability - A Quantitative Approach , 2009, Wiley series on quantitative software engineering.

[23]  Marin Litoiu,et al.  Performance model driven QoS guarantees and optimization in clouds , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[24]  Jerome A. Rolia,et al.  The Method of Layers , 1995, IEEE Trans. Software Eng..

[25]  Asser N. Tantawi,et al.  Enhanced inferencing: estimation of a workload dependent performance model , 2009, VALUETOOLS.

[26]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[27]  Steffen Becker,et al.  Performance Prediction of Component-Based Systems - A Survey from an Engineering Perspective , 2004, Architecting Systems with Trustworthy Components.

[28]  Vom Fachbereich Informatik.  Performance Engineering of Distributed Component-Based Systems - Benchmarking, Modeling and Performance Prediction , 2005 .

[29]  C. Murray Woodside,et al.  Performance modeling from software components , 2004, WOSP '04.

[30]  Marco Torchiano,et al.  Empirical studies in reverse engineering: state of the art and future trends , 2007, Empirical Software Engineering.

[31]  Marin Litoiu,et al.  Service System Resource Management Based on a Tracked Layered Performance Model , 2006, 2006 IEEE International Conference on Autonomic Computing.

[32]  Virgílio A. F. Almeida,et al.  Capacity Planning and Performance Modeling: From Mainframes to Client-Server Systems , 1994 .

[33]  Lionel C. Briand,et al.  Toward the Reverse Engineering of UML Sequence Diagrams for Distributed Java Software , 2006, IEEE Transactions on Software Engineering.

[34]  Daniel A. Menascé,et al.  Assessing the robustness of self-managing computer systems under highly variable workloads , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[35]  Martin Fowler,et al.  Patterns of Enterprise Application Architecture , 2002 .

[36]  Steffen Becker,et al.  Putting Components into Context Supporting QoS-Predictions with an explicit Context Model , 2006 .

[37]  Stephen Dawson,et al.  BAP: a benchmark-driven algebraic method for the performance engineering of customized services , 2010, WOSP/SIPEW '10.

[38]  Samuel Kounev,et al.  Stochastic Modeling and Analysis Using QPME: Queueing Petri Net Modeling Environment v2.0 , 2012, Petri Nets.

[39]  Bruce W. Schmeiser,et al.  Batch Size Effects in the Analysis of Simulation Output , 1982, Oper. Res..

[40]  Claus Pahl,et al.  Autonomic resource provisioning for cloud-based software , 2014, SEAMS 2014.

[41]  Asser N. Tantawi,et al.  CPU demand for web serving: Measurement analysis and dynamic estimation , 2008, Perform. Evaluation.

[42]  Asser N. Tantawi,et al.  Performance management for cluster-based web services , 2005, IEEE Journal on Selected Areas in Communications.

[43]  Daniel A. Menascé,et al.  QoS management in service-oriented architectures , 2007, Perform. Evaluation.

[44]  Daniel A. Menascé,et al.  On the Use of Online Analytic Performance Models, in Self-Managing and Self-Organizing Computer Systems , 2005, Self-star Properties in Complex Information Systems.

[45]  Gabriel A. Moreno,et al.  Packaging Predictable Assembly with Prediction-Enabled Component Technology , 2001 .

[46]  Ralf Reussner,et al.  ByCounter: Portable Runtime Counting of Bytecode Instructions and Method Invocations , 2008 .

[47]  Wilhelm Hasselbring,et al.  Self-Adaptive Software Performance Monitoring , 2011, Software Engineering.

[48]  J. Murphy,et al.  Understanding Performance Issues in Component-Oriented Distributed Applications : The COMPAS Framework , 2002 .

[49]  Jerome A. Rolia,et al.  Correlating resource demand information with ARM data for application services , 1998, WOSP '98.

[50]  Ralf H. Reussner,et al.  Towards a generic quality optimisation framework for component-based system models , 2011, CBSE '11.

[51]  Jerome A. Rolia,et al.  Trace-Based Load Characterization for Gernerating Performance Software Models , 1999, IEEE Trans. Software Eng..

[52]  Jerome A. Rolia,et al.  MODE: Mix Driven On-line Resource Demand Estimation , 2011, 2011 7th International Conference on Network and Service Management.

[53]  Samuel Kounev,et al.  Model-based self-adaptive resource allocation in virtualized environments , 2011, SEAMS '11.

[54]  Allen D. Malony,et al.  The Tau Parallel Performance System , 2006, Int. J. High Perform. Comput. Appl..

[55]  J. Little.  A Proof for the Queuing Formula: L = λW , 1961 .

[56]  Rajarshi Das,et al.  A Hybrid Reinforcement Learning Approach to Autonomic Resource Allocation , 2006, 2006 IEEE International Conference on Autonomic Computing.

[57]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[58]  Herbert A. Sturges,et al.  The Choice of a Class Interval , 1926 .

[59]  Samuel Kounev,et al.  Self-adaptive workload classification and forecasting for proactive resource provisioning , 2013, ICPE '13.

[60]  Nikolaus Huber,et al.  Autonomic Performance-Aware Resource Management in Dynamic IT Service Infrastructures , 2014 .

[61]  Frances E. Allen,et al.  Control-flow analysis , 2022 .

[62]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[63]  Gregory R. Ganger,et al.  Towards Self-Predicting Systems: What If You Could Ask "What-If"? , 2005, 16th International Workshop on Database and Expert Systems Applications (DEXA'05).

[64]  Samuel Kounev,et al.  Analysis of the Performance-Influencing Factors of Virtualization Platforms , 2010, OTM Conferences.

[65]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[66]  Marin Litoiu,et al.  Performance Model Estimation and Tracking Using Optimal Filters , 2008, IEEE Transactions on Software Engineering.

[67]  Asser N. Tantawi,et al.  Real-time performance modeling for adaptive software systems , 2009, VALUETOOLS.

[68]  Myron Hlynka,et al.  Queueing Networks and Markov Chains (Modeling and Performance Evaluation With Computer Science Applications) , 2007, Technometrics.

[69]  Samuel Kounev,et al.  Automated extraction of palladio component models from running enterprise Java applications , 2009, VALUETOOLS.

[70]  Matthias Hauswirth,et al.  Understanding Measurement Perturbation in Trace-based Data , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[71]  Benjamin Klatt,et al.  Reverse Engineering Software-Models of Component-Based Systems , 2008, 2008 12th European Conference on Software Maintenance and Reengineering.

[72]  Jordi Torres,et al.  Complete instrumentation requirements for performance analysis of Web based technologies , 2003, 2003 IEEE International Symposium on Performance Analysis of Systems and Software. ISPASS 2003..

[73]  Rouven Krebs,et al.  Architectural Concerns in Multi-tenant SaaS Applications , 2012, CLOSER.

[74]  Samuel Kounev,et al.  Modeling run-time adaptation at the system architecture level in dynamic service-oriented environments , 2013, Service Oriented Computing and Applications.

[75]  Raffaela Mirandola,et al.  Deriving a queueing network based performance model from UML diagrams , 2000, WOSP '00.

[76]  Connie U. Smith,et al.  Performance Engineering Evaluation of Object Oriented Systems With SPE-ED , 1997, Int. CMG Conference.

[77]  Bruce Weide,et al.  Component-based software using RESOLVE , 1994, SOEN.

[78]  C. Petri.  Kommunikation mit Automaten , 1962 .

[79]  D. W. Scott.  On optimal and data based histograms , 1979 .

[80]  Gregory Kulczycki,et al.  Performance specification of software components , 2001, SSR '01.

[81]  John Murphy,et al.  A framework for performance monitoring, modelling and prediction of component oriented distributed systems , 2002, WOSP '02.

[82]  Dorina C. Petriu,et al.  The Future of Software Performance Engineering , 2007, Future of Software Engineering (FOSE '07).

[83]  Ralf Reussner,et al.  Reverse Engineering of Parametric Behavioural Service Performance Models from Black-Box Components , 2008 .

[84]  Steffen Becker,et al.  Parameter Dependent Performance Specifications of Software Components , 2006, QoSA.

[85]  Jeffrey S. Chase,et al.  Learning Application Models for Utility Resource Planning , 2006, 2006 IEEE International Conference on Autonomic Computing.

[86]  Mike Cohn,et al.  User Stories Applied: For Agile Software Development , 2004 .

[87]  Liam Murphy,et al.  Performance modeling and prediction of enterprise JavaBeans with layered queuing network templates , 2005, SAVCBS '05.

[88]  Giuliano Casale,et al.  An Offline Demand Estimation Method for Multi-threaded Applications , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[89]  Daniel A. Menascé,et al.  Scaling for E-Business: Technologies, Models, Performance, and Capacity Planning , 2000 .

[90]  Javier Campos,et al.  From UML activity diagrams to Stochastic Petri nets: application to software performance engineering , 2004, WOSP '04.

[91]  C. Murray Woodside,et al.  Using regression splines for software performance analysis , 2000, WOSP '00.

[92]  Heiko Koziolek,et al.  Towards Automatic Construction of Reusable Prediction Models for Component-Based Performance Engineering , 2008, Software Engineering.

[93]  Xiaozhou Li,et al.  Efficient tracing and performance analysis for large distributed systems , 2009, 2009 IEEE International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems.

[94]  D. Kendall.  Stochastic Processes Occurring in the Theory of Queues and their Analysis by the Method of the Imbedded Markov Chain , 1953 .

[95]  Wilhelm Hasselbring,et al.  Performance Simulation of Runtime Reconfigurable Component-Based Software Architectures , 2011, ECSA.

[96]  Dimitrios Gunopulos,et al.  Approximating multi-dimensional aggregate range queries over real attributes , 2000, SIGMOD '00.

[97]  Virgílio A. F. Almeida,et al.  Performance by Design - Computer Capacity Planning By Example , 2004 .

[98]  Philipp Meier,et al.  Automated Transformation of Palladio Component Models to Queueing Petri Nets , 2010 .

[99]  Stephen Dawson,et al.  Estimating service resource consumption from response time measurements , 2009, VALUETOOLS.

[100]  Cesare Pautasso,et al.  Kriging Controllers for Cloud Applications , 2013, IEEE Internet Computing.

[101]  Stephen Gilmore,et al.  Choreographing Security and Performance Analysis for Web Services , 2005, EPEW/WS-FM.

[102]  Dick Hamlet.  Tools and experiments supporting a testing-based theory of component composition , 2009, TSEM.

[103]  Gang Yin,et al.  Online Self-Reconfiguration with Performance Guarantee for Energy-Efficient Large-Scale Cloud Computing Data Centers , 2010, 2010 IEEE International Conference on Services Computing.

[104]  Paolo Cremonesi,et al.  How to Select Significant Workloads in Performance Models , 2007, Int. CMG Conference.

[105]  Wilhelm Hasselbring,et al.  Trace-Context Sensitive Performance Profiling for Enterprise Software Applications , 2008, SIPEW.

[106]  Prashant J. Shenoy,et al.  Profiling and Modeling Resource Usage of Virtualized Applications , 2008, Middleware.

[107]  Christopher Stewart,et al.  Exploiting nonstationarity for performance prediction , 2007, EuroSys '07.

[108]  Christoph Rathfelder,et al.  Modelling Event-Based Interactions in Component-Based Architectures for Quantitative System Evaluation , 2013 .

[109]  Jun Wei,et al.  Application-Level CPU Consumption Estimation: Towards Performance Isolation of Multi-tenancy Web Applications , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[110]  Ralf H. Reussner,et al.  Performance Prediction for Black-Box Components Using Reengineered Parametric Behaviour Models , 2008, CBSE.

[111]  Allen D. Malony,et al.  Compensation of Measurement Overhead in Parallel Performance Profiling , 2007, Int. J. High Perform. Comput. Appl..

[112]  Sam Malek,et al.  FUSION: a framework for engineering self-tuning self-adaptive software systems , 2010, FSE '10.

[113]  Johan J. Lukkien,et al.  Predicting real-time properties of component assemblies: a scenario-simulation approach , 2004, Proceedings. 30th Euromicro Conference, 2004..

[114]  Samuel Kounev,et al.  Towards Self-Aware Performance and Resource Management in Modern Service-Oriented Systems , 2010, 2010 IEEE International Conference on Services Computing.

[115]  Daniel A. Menascé.  Computing Missing Service Demand Parameters for Performance Models , 2008, Int. CMG Conference.

[116]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[117]  Samuel Kounev,et al.  Architecture-level software performance abstractions for online performance prediction , 2014, Sci. Comput. Program..

[118]  Robert J. Hall,et al.  Call path profiling , 1992, International Conference on Software Engineering.

[119]  Falko Bause,et al.  Stochastic Petri Nets: An Introduction to the Theory , 2012, PERV.

[120]  Wilhelm Hasselbring,et al.  Generating Probabilistic and Intensity-Varying Workload for Web-Based Software Systems , 2008, SIPEW.

[121]  Samuel Kounev,et al.  Controlling the Palladio Bench using the Descartes Query Language , 2013, KPDAYS.

[122]  Simonetta Balsamo,et al.  A simulation-based approach to software performance modeling , 2003, ESEC/FSE-11.

[123]  Steffen Becker,et al.  SimuLizar: Design-Time Modeling and Performance Analysis of Self-Adaptive Systems , 2013, Software Engineering.

[124]  Samuel Kounev.  Engineering of Self-aware IT Systems and Services: State-of-the-Art and Research Challenges , 2011, EPEW.

[125]  C. Murray Woodside,et al.  Enhanced Modeling and Solution of Layered Queueing Networks , 2009, IEEE Transactions on Software Engineering.

[126]  Piotr Rygielski,et al.  Data Center Network Throughput Analysis Using Queueing Petri Nets , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[127]  Jordi Torres,et al.  Autonomic QoS control in enterprise Grid environments using online simulation , 2009, J. Syst. Softw..

[128]  Roberto Turrin,et al.  Robust Workload Estimation in Queueing Network Performance Models , 2008, 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008).

[129]  Daniel A. Menascé,et al.  A framework for QoS-aware software components , 2004, WOSP '04.

[130]  Carlos Juiz,et al.  Analysis of burstiness monitoring and detection in an adaptive Web system , 2009, Comput. Networks.

[131]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.

[132]  Samuel Kounev,et al.  Evaluating Approaches for Performance Prediction in Virtualized Environments , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[133]  Yossi Matias,et al.  Fast incremental maintenance of approximate histograms , 1997, TODS.

[134]  Raffaela Mirandola,et al.  Efficient Performance Models in Component-Based Software Engineering , 2006, 32nd EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO'06).

[135]  Rajarshi Das,et al.  Coordinating Multiple Autonomic Managers to Achieve Specified Power-Performance Tradeoffs , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[136]  Darl Kuhn,et al.  Expert Oracle Database Architecture , 2014, Apress.

[137]  Samuel Kounev,et al.  SimQPN - A tool and methodology for analyzing queueing Petri net models by means of simulation , 2006, Perform. Evaluation.

[138]  Samuel Kounev,et al.  Automated simulation-based capacity planning for enterprise data fabrics , 2011, SimuTools.

[139]  Heiko Koziolek,et al.  Architecture-Based Reliability Prediction with the Palladio Component Model , 2012, IEEE Transactions on Software Engineering.

[140]  Daniel A. Menascé,et al.  Resource Allocation for Autonomic Data Centers using Analytic Performance Models , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[141]  Heiko Koziolek,et al.  Parameter dependencies for reusable performance specifications of software components , 2010 .

[142]  Zhiliang Zhu,et al.  Personalized Quality Prediction for Dynamic Service Management Based on Invocation Patterns , 2013, ICSOC.

[143]  Ítalo S. Cunha,et al.  Joint admission control and resource allocation in virtualized servers , 2010, J. Parallel Distributed Comput..

[144]  Samuel Kounev,et al.  Performance Modeling and Evaluation of Distributed Component-Based Systems Using Queueing Petri Nets , 2006, IEEE Transactions on Software Engineering.

[145]  Dieter K. Hammer,et al.  Performance Prediction for Component Compositions , 2004, CBSE.

[146]  Ralf H. Reussner,et al.  Using Genetic Search for Reverse Engineering of Parametric Behavior Models for Performance Prediction , 2010, IEEE Transactions on Software Engineering.

[147]  Radu Prodan,et al.  Soft Benchmarks-Based Application Performance Prediction Using a Minimum Training Set , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[148]  James Ivers,et al.  Snapshot of CCL: A Language for Predictable Assembly , 2003 .

[149]  Kishor S. Trivedi.  Probability and Statistics with Reliability, Queuing, and Computer Science Applications , 1984 .

[150]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[151]  Charlie Hunt,et al.  Java Performance , 2011 .

[152]  Steffen Becker,et al.  The palladio component model , 2010, WOSP/SIPEW '10.

[153]  Steffen Becker,et al.  Quantitative Evaluation of Model-Driven Performance Analysis and Simulation of Component-Based Architectures , 2015, IEEE Transactions on Software Engineering.

[154]  Peter J. Haas,et al.  Improved histograms for selectivity estimation of range predicates , 1996, SIGMOD '96.

[155]  Calton Pu,et al.  Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[156]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[157]  André van Hoorn.  Model-driven online capacity management for component-based software systems , 2014 .

[158]  Alan Fekete,et al.  Design-level performance prediction of component-based applications , 2005, IEEE Transactions on Software Engineering.

[159]  Anand Sivasubramaniam,et al.  Managing server energy and operational costs in hosting centers , 2005, SIGMETRICS '05.

[160]  Paola Inverardi,et al.  Model-based performance prediction in software development: a survey , 2004, IEEE Transactions on Software Engineering.

[161]  Nikolaus Huber,et al.  escartes The Descartes Modeling Language , 2014 .

[162]  Allan Clark,et al.  Stochastic Process Algebras , 2007, SFM.

[163]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[164]  Gabriel A. Moreno,et al.  Packaging Predictable Assembly , 2002, Component Deployment.

[165]  Ralf Steinmetz,et al.  Heuristics for QoS-aware Web Service Composition , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[166]  Samuel Kounev,et al.  Enriching software architecture models with statistical models for performance prediction in modern storage environments , 2014, CBSE '14.

[167]  C. Murray Woodside,et al.  Layered analytic performance modelling of a distributed database system , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[168]  Asser N. Tantawi,et al.  Analytic modeling of multitier Internet applications , 2007, TWEB.

[169]  Adam Wierman,et al.  Open Versus Closed: A Cautionary Tale , 2006, NSDI.

[170]  E. Burton Swanson,et al.  Problems in application software maintenance , 1981, CACM.

[171]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[172]  Steffen Becker,et al.  Model-Based performance prediction with the palladio component model , 2007, WOSP '07.

[173]  Shikharesh Majumdar,et al.  The Stochastic Rendezvous Network Model for Performance of Synchronous Client-Server-like Distributed Software , 1995, IEEE Trans. Computers.

[174]  Nelly Bencomo,et al.  RELAX: Incorporating Uncertainty into the Specification of Self-Adaptive Systems , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[175]  Karim Djemame,et al.  Adaptive grid resource brokering , 2003, 2003 Proceedings IEEE International Conference on Cluster Computing.

[176]  C. Davis,et al.  Harnessing Green IT: Principles and Practices , 2012 .

[177]  Dennis Westermann,et al.  Deriving Goal-oriented Performance Models by Systematic Experimentation , 2013 .

[178]  Calton Pu,et al.  Generating Adaptation Policies for Multi-tier Applications in Consolidated Server Environments , 2008, 2008 International Conference on Autonomic Computing.

[179]  Raffaela Mirandola,et al.  CB-SPE Tool: Putting Component-Based Performance Engineering into Practice , 2004, CBSE.

[180]  Constantin Adam,et al.  A middleware design for large-scale clusters offering multiple services , 2006, IEEE Transactions on Network and Service Management.

[181]  Dorina C. Petriu,et al.  Applying performance modelling to a telecommunication system , 1998, WOSP '98.

[182]  Vincenzo Grassi,et al.  Filling the gap between design and performance/reliability models of component-based systems: A model-driven approach , 2007, J. Syst. Softw..

[183]  Jens Happe,et al.  A Prediction Model for Software Performance in Symmetric Multiprocessing Environments , 2010, 2010 Seventh International Conference on the Quantitative Evaluation of Systems.

[184]  Paolo Traverso,et al.  Service-Oriented Computing: State of the Art and Research Challenges , 2007, Computer.

[185]  Samuel Kounev,et al.  A Methodology for Performance Modeling of Distributed Event-Based Systems , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[186]  Qi Zhang,et al.  A Regression-Based Analytic Model for Dynamic Resource Provisioning of Multi-Tier Applications , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[187]  Brian Tierney,et al.  NetLogger: A Toolkit for Distributed System Performance Tuning and Debugging , 2003, Integrated Network Management.

[188]  D. Freedman,et al.  On the histogram as a density estimator:L2 theory , 1981 .

[189]  Ada Diaconescu,et al.  Automating the performance management of component-based enterprise systems through the use of redundancy , 2005, ASE '05.

[190]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[191]  Raffaela Mirandola,et al.  Hybrid multi-attribute QoS optimization in component based software systems , 2013, J. Syst. Softw..

[192]  Haifeng Chen,et al.  Untangling mixed information to calibrate resource utilization in virtual machines , 2011, ICAC '11.

[193]  Luis Gravano,et al.  STHoles: a multidimensional workload-aware histogram , 2001, SIGMOD '01.

[194]  Dirk Beyer,et al.  Self-Adaptive SLA-Driven Capacity Management for Internet Services , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[195]  Samuel Kounev,et al.  Automated extraction of architecture-level performance models of distributed component-based systems , 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011).

[196]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[197]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[198]  John H. Maindonald,et al.  Modern Multivariate Statistical Techniques: Regression, Classification and Manifold Learning , 2009 .

[199]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[200]  Wilhelm Hasselbring,et al.  An adaptation framework enabling resource-efficient operation of software systems , 2009 .

[201]  T. Kelly,et al.  Predicting Performance in Distributed Enterprise Applications , 2006 .

[202]  C. Murray Woodside,et al.  Performance analysis of distributed server systems , 2000 .

[203]  Ulrich Herzog,et al.  Formal Description, Time and Performance Analysis. A Framework , 1990, Entwurf und Betrieb verteilter Systeme.

[204]  Rouven Krebs,et al.  Automated inference of goal-oriented performance prediction functions , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[205]  Jane Hillston,et al.  A compositional approach to performance modelling , 1996 .

[206]  Ralf Reussner,et al.  The Use of Parameterised Contracts for Architecting Systems with Software Components , 2001 .

[207]  Heiko Koziolek,et al.  Performance evaluation of component-based software systems: A survey , 2010, Perform. Evaluation.

[208]  Samuel Kounev,et al.  Performance modelling of distributed e-business applications using Queuing Petri Nets , 2003, 2003 IEEE International Symposium on Performance Analysis of Systems and Software. ISPASS 2003..

[209]  Jordi Torres,et al.  Autonomic QoS-Aware resource management in grid computing using online performance models , 2007, Valuetools 2007.

[210]  Steffen Becker,et al.  The Palladio component model for model-driven performance prediction , 2009, J. Syst. Softw..

[211]  Giuseppe Serazzi,et al.  JMT: performance engineering tools for system modeling , 2009, PERV.

[212]  Yeonseung Ryu,et al.  Metrics, Methodology, and Tool for Performance-Considered Web Service Composition , 2005, ISCIS.

[213]  Samuel Kounev,et al.  Modeling parameter and context dependencies in online architecture-level performance models , 2012, CBSE '12.

[214]  Jerome A. Rolia,et al.  Parameter estimation for performance models of distributed application systems , 1995, CASCON.

[215]  Samuel Kounev,et al.  Evaluating approaches to resource demand estimation , 2015, Perform. Evaluation.

[216]  Marin Litoiu,et al.  Tracking time-varying parameters in software systems with extended Kalman filters , 2015, CASCON.

[217]  Uwe Fink,et al.  Performance Solutions A Practical Guide To Creating Responsive Scalable Software , 2016 .

[218]  Barton P. Miller,et al.  An Adaptive Cost System for Parallel Program Instrumentation , 1996, Euro-Par, Vol. I.

[219]  Kaizar Amin,et al.  Analysis and Provision of QoS for Distributed Grid Applications , 2004, Journal of Grid Computing.

[220]  Adrian Mos.  A Framework for Adaptive Monitoring and Performance Management of Component-Based Enterprise Applications , 2004 .

[221]  Fan Zhang,et al.  Parameter inference of queueing models for IT systems using end-to-end measurements , 2004, SIGMETRICS '04/Performance '04.