Machine Learning-Based Self-Compensating Approximate Computing

Dedicated hardware accelerators are suitable for parallel computational tasks. Moreover, they have the tendency to accept inexact results. These hardware accelerators are extensively used in image processing and computer vision applications, e.g., to process the dense 3-D maps required for self-driving cars. Such error-tolerant hardware accelerators can be designed approximately for reduced power consumption and/or processing time. However, since for some inputs the output errors may reach unacceptable levels, the main challenge is to enhance the accuracy of the results of approximate accelerators and keep the error magnitude within an allowed range. Towards this goal, in this paper, we propose a novel machine learning-based self-compensating approximate accelerators for energy efficient systems. The proposed error compensation module, which is integrated within the architecture of approximate hardware accelerators, efficiently reduces the accumulated error at its output. It utilizes lightweight supervised machine learning techniques, i.e., decision tree, to capture input dependency of the error. We consider image blending application in multiplication mode to demonstrate a practical application of self-compensating approximate computing. Simulation results show that the proposed design of self-compensating approximate accelerator can achieve about 9% accuracy enhancement, with negligible overhead in other performance measures, i.e., power, area, delay and energy.

[1]  Sofiène Tahar,et al.  Input-Conscious Approximate Multiply-Accumulate (MAC) Unit for Energy-Efficiency , 2019, IEEE Access.

[2]  Sofiène Tahar,et al.  Comparative Study of Approximate Multipliers , 2018, ACM Great Lakes Symposium on VLSI.

[3]  Osman Hasan,et al.  Self-compensating accelerators for efficient approximate computing , 2019, Microelectron. J..

[4]  Scott A. Mahlke,et al.  SAGE: Self-tuning approximation for graphics engines , 2013, 2013 46th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[5]  C. Pipper,et al.  [''R"--project for statistical computing]. , 2008, Ugeskrift for laeger.

[6]  Sparsh Mittal,et al.  A Survey of Techniques for Approximate Computing , 2016, ACM Comput. Surv..

[7]  Kaushik Roy,et al.  Low-Power Digital Signal Processing Using Approximate Adders , 2013, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[8]  Fabrizio Lombardi,et al.  Approximate XOR/XNOR-based adders for inexact computing , 2013, 2013 13th IEEE International Conference on Nanotechnology (IEEE-NANO 2013).

[9]  Mehdi Kamal,et al.  TruncApp: A truncation-based approximate divider for energy efficient DSP applications , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[10]  Jie Han,et al.  Approximate computing: An emerging paradigm for energy-efficient design , 2013, 2013 18th IEEE European Test Symposium (ETS).

[11]  Osman Hasan,et al.  Using Machine Learning for Quality Configurable Approximate Computing , 2019, 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[12]  Cesare Alippi,et al.  Security: The Dark Side of Approximate Computing? , 2018, 2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[13]  Scott A. Mahlke,et al.  Scaling Performance via Self-Tuning Approximation for Graphics Engines , 2014, TOCS.

[14]  Osman Hasan,et al.  Error Analysis of Approximate Array Multipliers , 2019, ArXiv.

[15]  Osman Hasan,et al.  Approximation-Conscious IC Testing , 2018, 2018 30th International Conference on Microelectronics (ICM).

[16]  Luigi Carro,et al.  Approximate On-The-Fly Coarse-Grained Reconfigurable Acceleration for General-Purpose Applications , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[17]  Woongki Baek,et al.  Green: a framework for supporting energy-conscious programming using controlled approximation , 2010, PLDI '10.

[18]  Kaushik Roy,et al.  Approximate computing and the quest for computing efficiency , 2015, 2015 52nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[19]  Farah Naz Taher,et al.  A Machine Learning based Hard Fault Recuperation Model for Approximate Hardware Accelerators , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[20]  Benjamin Carrión Schäfer,et al.  Approximate Reconfigurable Hardware Accelerator: Adapting the Micro-Architecture to Dynamic Workloads , 2017, 2017 IEEE International Conference on Computer Design (ICCD).