Machine Learning-Based Quality-Aware Power and Thermal Management of Multistream HEVC Encoding on Multicore Servers

The emergence of video streaming applications, together with the users’ demand for high-resolution contents, has led to the development of new video coding standards, such as High Efficiency Video Coding (HEVC). HEVC provides high efficiency at the cost of increased complexity. This higher computational burden results in increased power consumption in current multicore servers. To tackle this challenge, algorithmic optimizations need to be accompanied by content-aware application-level strategies, able to reduce power while meeting compression and quality requirements. In this paper, we propose a machine learning-based power and thermal management approach that dynamically learns and selects the best encoding configuration and operating frequency for each of the videos running on multicore servers, by using information from frame compression, quality, encoding time, power, and temperature. In addition, we present a resolution-aware video assignment and migration strategy that reduces the peak and average temperature of the chip while maintaining the desirable encoding time. We implemented our approach in an enterprise multicore server and evaluated it under several common scenarios for video providers. On average, compared to a state-of-the-art technique, for the most realistic scenario, our approach improves BD-PSNR and BD-rate by 0.54 dB, and 8 percent, respectively, and reduces the encoding time, power consumption, and average temperature by 15.3, 13, and 10 percent, respectively. Moreover, our proposed approach enhances BD-PSNR and BD-rate compared to the HEVC Test Model (HM), by 1.19 dB and 24 percent, respectively, without any encoding time degradation, when power and temperature constraints are relaxed.

[1]  David Atienza,et al.  3D-ICE: Fast compact transient thermal modeling for 3D ICs with inter-tier liquid cooling , 2010, 2010 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[2]  Satoshi Goto,et al.  Reducing power consumption of HEVC codec with lossless reference frame recompression , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Guilherme Corrêa,et al.  Dynamic tree-depth adjustment for low power HEVC encoders , 2012, 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012).

[4]  David Atienza,et al.  Work-in-progress: a machine learning-based approach for power and thermal management of next-generation video coding on MPSoCs , 2017, 2017 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[5]  Vijay Bansal,et al.  Fast intra mode decision for HEVC video encoder , 2012, SoftCOM 2012, 20th International Conference on Software, Telecommunications and Computer Networks.

[6]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[7]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[8]  Saeid Nooshabadi,et al.  Parallel Multiview Video Coding Exploiting Group of Pictures Level Parallelism , 2016, IEEE Transactions on Parallel and Distributed Systems.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Ann Nowé,et al.  Hypervolume-Based Multi-Objective Reinforcement Learning , 2013, EMO.

[11]  Luca Benini,et al.  Thermal and Energy Management of High-Performance Multicores: Distributed and Self-Calibrating Model-Predictive Controller , 2013, IEEE Transactions on Parallel and Distributed Systems.

[12]  Muhammad Shafique,et al.  Thermal optimization using adaptive approximate computing for video coding , 2016, 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[13]  Fang Hao,et al.  Measurement Study of Netflix, Hulu, and a Tale of Three CDNs , 2015, IEEE/ACM Transactions on Networking.

[14]  Yücel Altunbasak,et al.  Low-complexity macroblock mode selection for H.264-AVC encoders , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  S. Welstead Fractal and Wavelet Image Compression Techniques , 1999 .

[16]  Muhammad Usman Karim Khan,et al.  Software architecture of High Efficiency Video Coding for many-core systems with power-efficient workload balancing , 2014, 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[17]  Muhammad Shafique,et al.  An HVS-based Adaptive Computational Complexity Reduction Scheme for H.264/AVC video encoder using Prognostic Early Mode Exclusion , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[18]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[19]  Erwan Nogues,et al.  Low power HEVC software decoder for mobile devices , 2015, Journal of Real-Time Image Processing.

[20]  Chen-Hsiu Huang Video Transcoding Architectures and Techniques : An Overview , 2003 .

[21]  Jörg Henkel,et al.  Economic learning for thermal-aware power budgeting in many-core architectures , 2011, 2011 Proceedings of the Ninth IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[22]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[23]  Guifen Tian,et al.  Content adaptive prediction unit size decision algorithm for HEVC intra coding , 2012, 2012 Picture Coding Symposium.

[25]  Muhammad Usman Karim Khan,et al.  Power-Efficient Workload Balancing for Video Applications , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[26]  W. Marsden I and J , 2012 .

[27]  Muhammad Shafique,et al.  hevcDTM: Application-driven Dynamic Thermal Management for High Efficiency Video Coding , 2014, 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[28]  David Flynn,et al.  HEVC Complexity and Implementation Analysis , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[30]  Mihaela van der Schaar,et al.  Complexity scalable motion compensated wavelet video encoding , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Gary J. Sullivan,et al.  Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Mehdi Kamal,et al.  A heuristic machine learning-based algorithm for power and thermal management of heterogeneous MPSoCs , 2015, 2015 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[33]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[34]  Guilherme Corrêa,et al.  Complexity scalability for real-time HEVC encoders , 2013, Journal of Real-Time Image Processing.

[35]  Jörg Henkel,et al.  TAPE: thermal-aware agent-based power economy for multi/many-core architectures , 2009, ICCAD '09.

[36]  José Manuel Moya,et al.  Unsupervised power modeling of co-allocated workloads for energy efficiency in data centers , 2016, 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[37]  Muhammad Shafique,et al.  Low power design of the next-generation High Efficiency Video Coding , 2014, 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC).

[38]  Francesca De Simone,et al.  Performance analysis of VP8 image and video compression based on subjective evaluations , 2011, Optical Engineering + Applications.

[39]  John Yearwood,et al.  On the Limitations of Scalarisation for Multi-objective Reinforcement Learning of Pareto Fronts , 2008, Australasian Conference on Artificial Intelligence.

[40]  Guilherme Corrêa,et al.  Complexity control of high efficiency video encoders for power-constrained devices , 2011, IEEE Transactions on Consumer Electronics.

[41]  Muhammad Shafique,et al.  TONE: Adaptive temperature optimization for the next generation video encoders , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[42]  Rajkumar Buyya,et al.  Cost-Efficient and Robust On-Demand Video Transcoding Using Heterogeneous Cloud Services , 2018, IEEE Transactions on Parallel and Distributed Systems.

[43]  Yan Ye,et al.  Power aware HEVC streaming for mobile , 2013, 2013 Visual Communications and Image Processing (VCIP).

[44]  Joseph A. Paradiso,et al.  The gesture recognition toolkit , 2014, J. Mach. Learn. Res..

[45]  Zhan Ma,et al.  Frame buffer compression for low-power video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[46]  Ann Nowé,et al.  Multi-objective reinforcement learning using sets of pareto dominating policies , 2014, J. Mach. Learn. Res..

[47]  Muhammad Usman Karim Khan,et al.  Power efficient and workload balanced tiling for parallelized high efficiency video coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).