TOEP: Threshold Oriented Energy Prediction Mechanism for MPI-OpenMP Hybrid Applications*

Evaluating the execution time and energy consumption of parallel programs is a primary research topic for many HPC environments. Whereas much work has been done to evaluate the non-functional behavior for single parallel programming models such as MPI or OpenMP, little work exists for hybrid programming models such as MPI/OpenMP. This paper proposes the Threshold Oriented Energy Prediction (TOEP) approach which uses the Random Forest Modeling (RFM) to train models for execution time and energy consumption of hybrid MPI/OpenMP programs. Training data (performance measurements) are reduced by ignoring code regions that have little impact on the overall energy consumption and runtime of a program and also based on the variable importance parameter of RFM. A selection parameter is introduced that selects a trade-off solution between the number of modeling points (measurement or training data) required and prediction accuracy. An exploratory study on the proposed prediction approach was employed for a few candidate hybrid applications namely HOMB, CoMD, and AMG2006-Laplace. The experimental results manifested the energy prediction accuracy of over 86.17% for large performance datasets of the candidate applications at a reduced computational effort of less than 17 seconds.

[1]  Xi Chen,et al.  Cache contention and application performance prediction for multi-core systems , 2010, 2010 IEEE International Symposium on Performance Analysis of Systems & Software (ISPASS).

[2]  Thomas Fahringer,et al.  Energy Prediction of OpenMP Applications Using Random Forest Modeling Approach , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium Workshop.

[3]  Shajulin Benedict,et al.  Energy-aware performance analysis methodologies for HPC architectures - An exploratory study , 2012, J. Netw. Comput. Appl..

[4]  Rizos Sakellariou,et al.  A Survey of Power and Energy Predictive Models in HPC Systems and Applications , 2017, ACM Comput. Surv..

[5]  Xiaofeng Gao,et al.  A Performance Prediction Framework for Scientific Applications , 2003, International Conference on Computational Science.

[6]  B. S. Bindhumadhava,et al.  An intelligent energy optimization approach for MPI based applications in HPC systems , 2013, CSI Transactions on ICT.

[7]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  Ian Foster,et al.  Predicting application run times with historical information , 2004, J. Parallel Distributed Comput..

[10]  Arnaud Legrand,et al.  Predicting the Performance and the Power Consumption of MPI Applications With SimGrid , 2017 .

[11]  Enrique S. Quintana-Ortí,et al.  Saving Energy in the LU Factorization with Partial Pivoting on Multi-core Processors , 2012, 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[12]  MengChu Zhou,et al.  Performance modeling and analysis of workflow , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Dong Li,et al.  Hybrid MPI/OpenMP power-aware computing , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).