Platform-independent modeling and prediction of application resource usage characteristics

Application resource usage models can be used in the decision making process for ensuring quality-of-service as well as for capacity planning, apart from their general use in performance modeling, optimization, and systems management. Current solutions for modeling application resource usage tend to address parts of the problem by either focusing on a specific application, or a specific platform, or on a small subset of system resources. We propose a simple and flexible approach for modeling application resource usage in a platform-independent manner that enables the prediction of application resource usage on unseen platforms. The technique proposed is application agnostic, requiring no modification to the application (binary or source) and no knowledge of application-semantics. We implement a Linux-based prototype and evaluate it using four different workloads including real-world applications and benchmarks. Our experiments reveal prediction errors that are bound within 6-24% of the observed for these workloads when using the proposed approach.

[1]  Richard Wolski,et al.  Predicting the CPU availability of time‐shared Unix systems on the computational grid , 2004, Cluster Computing.

[2]  John M. Mellor-Crummey,et al.  Cross-architecture performance predictions for scientific applications using parameterized models , 2004, SIGMETRICS '04/Performance '04.

[3]  Peter A. Dinda Online Prediction of the Running Time of Tasks , 2004, Cluster Computing.

[4]  Matthias S. Müller,et al.  Performance Prediction in a Grid Environment , 2003, European Across Grids Conference.

[5]  Wei Sun,et al.  Predicting Running Time of Grid Tasks based on CPU Load Predictions , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[6]  J. Goodnight A Tutorial on the SWEEP Operator , 1979 .

[7]  Peter A. Dinda,et al.  A prediction-based real-time scheduling advisor , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[8]  Peter A. Dinda,et al.  Host load prediction using linear models , 2000, Cluster Computing.

[9]  Richard Wolski,et al.  Multivariate Resource Performance Forecasting in the Network Weather Service , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[10]  Mrv Michel Chaudron,et al.  Scenario-based prediction of run-time resource consumption in component-based software systems , 2003 .

[11]  Warren Smith,et al.  Predicting Application Run Times Using Historical Information , 1998, JSSPP.

[12]  Ivan Rodero,et al.  The Grid Backfilling: a Multi-Site Scheduling Architecture with Data Mining Prediction Techniques , 2008 .

[13]  Frank Mueller,et al.  Cross-Platform Performance Prediction of Parallel Applications Using Partial Execution , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[14]  Subhash Saini,et al.  Performance prediction and its use in parallel and distributed computing systems , 2006, Future Gener. Comput. Syst..

[15]  Christopher Stewart,et al.  A Dollar from 15 Cents: Cross-Platform Management for Internet Services , 2008, USENIX Annual Technical Conference.

[16]  Steve J. Chapin,et al.  A Cost/Benefit Estimating Service for Mapping Parallel Applications on Heterogeneous Clusters , 2005, 2005 IEEE International Conference on Cluster Computing.

[17]  Wei Jin,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[18]  Thierry Delaitre,et al.  Improving Grid computing performance prediction usingweighted templates , 2007 .

[19]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[20]  Hari Kalva,et al.  Resource estimation methodology for multimedia applications , 2007, Electronic Imaging.

[21]  Seyed Masoud Sadjadi,et al.  A modeling approach for estimating execution time of long-running scientific applications , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[22]  Ravishankar K. Iyer,et al.  Predictability of Process Resource Usage: A Measurement-Based Study on UNIX , 1989, IEEE Trans. Software Eng..

[23]  Christopher Stewart,et al.  Performance modeling and system management for multi-component online services , 2005, NSDI.

[24]  David M. Brooks,et al.  Accurate and efficient regression modeling for microarchitectural performance and power prediction , 2006, ASPLOS XII.

[25]  David M. Brooks,et al.  Illustrative Design Space Studies with Microarchitectural Regression Models , 2007, 2007 IEEE 13th International Symposium on High Performance Computer Architecture.

[26]  Gargi Dasgupta,et al.  Transparent grid enablement of weather research and forecasting , 2008, Mardi Gras Conference.

[27]  Richard Gibbons,et al.  A Historical Application Profiler for Use by Parallel Schedulers , 1997, JSSPP.

[28]  Sally A. McKee,et al.  Efficiently exploring architectural design spaces via predictive modeling , 2006, ASPLOS XII.

[29]  Jeffrey Katcher,et al.  PostMark: A New File System Benchmark , 1997 .