ADEPOS: A Novel Approximate Computing Framework for Anomaly Detection Systems and its Implementation in 65-nm CMOS

To overcome the energy and bandwidth limitations of traditional IoT systems, “edge computing” or information extraction at the sensor node has become popular. However, now it is important to create very low energy information extraction or pattern recognition systems. In this paper, we present an approximate computing method to reduce the computation energy of a specific type of IoT system used for anomaly detection (e.g. in predictive maintenance, epileptic seizure detection, etc). Termed as Anomaly Detection Based Power Savings (ADEPOS), our proposed method uses low precision computing and low complexity neural networks at the beginning when it is easy to distinguish healthy data. However, on the detection of anomalies, the complexity of the network and computing precision are adaptively increased for accurate predictions. We show that ensemble approaches are well suited for adaptively changing network size. To validate our proposed scheme, a chip has been fabricated in UMC 65nm process that includes an MSP430 microprocessor along with an on-chip switching mode DC-DC converter for dynamic voltage and frequency scaling. Using NASA bearing dataset for machine health monitoring, we show that using ADEPOS we can achieve 8.95X saving of energy along the lifetime without losing any detection accuracy. The energy savings are obtained by reducing the execution time of the neural network on the microprocessor.

[1]  Vijay Manikandan Janakiraman,et al.  Anomaly detection in aviation data using extreme learning machines , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[2]  Arindam Basu,et al.  Improving energy gains of inexact DSP hardware through reciprocative error compensation , 2013, 2013 50th ACM/EDAC/IEEE Design Automation Conference (DAC).

[3]  J. Sanz,et al.  Fault diagnosis of rotating machinery based on auto-associative neural networks and wavelet transforms , 2007 .

[4]  Puneet Gupta,et al.  Trading Accuracy for Power with an Underdesigned Multiplier Architecture , 2011, 2011 24th Internatioal Conference on VLSI Design.

[5]  Arnab Raha,et al.  Hypnos: An ultra-low power sleep mode with SRAM data retention for embedded microcontrollers! , 2014, 2014 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[6]  Arnab Raha,et al.  Approximating Beyond the Processor: Exploring Full-System Energy-Accuracy Tradeoffs in a Smart Camera System , 2018, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[7]  Kaushik Roy,et al.  Design of voltage-scalable meta-functions for approximate computing , 2011, 2011 Design, Automation & Test in Europe.

[8]  C. Scheffer,et al.  Predictive maintenance techniques: Part 1 predictive maintenance basics , 2004 .

[9]  Shehroz S. Khan,et al.  One-class classification: taxonomy of study and review of techniques , 2013, The Knowledge Engineering Review.

[10]  AI Koan,et al.  Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning , 2008, NIPS.

[11]  David Blaauw,et al.  A Portable 2-Transistor Picowatt Temperature-Compensated Voltage Reference Operating at 0.5 V , 2012, IEEE Journal of Solid-State Circuits.

[12]  Shih-Lien Lu Speeding Up Processing with Approximation Circuits , 2004, Computer.

[13]  Xinyu Yang,et al.  A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications , 2017, IEEE Internet of Things Journal.

[14]  Arindam Basu,et al.  A 2.86-TOPS/W Current Mirror Cross-Bar-Based Machine-Learning and Physical Unclonable Function Engine For Internet-of-Things Applications , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  Massimo Alioto,et al.  EQSCALE: Energy-quality scalable feature extraction engine for Sub-mW real-time video processing with 0.55 mm2 area in 40nm CMOS , 2017, 2017 IEEE Asian Solid-State Circuits Conference (A-SSCC).

[16]  Jianbo Yu,et al.  Local and Nonlocal Preserving Projection for Bearing Defect Classification and Performance Assessment , 2012, IEEE Transactions on Industrial Electronics.

[17]  Amparo Alonso-Betanzos,et al.  Power wind mill fault detection via one-class ν-SVM vibration signal analysis , 2011, The 2011 International Joint Conference on Neural Networks.

[18]  Mohamed El-Nozahi,et al.  Low-ripple PFM Buck Converter Employing Background Calibration , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[19]  Jaydeep Kulkarni,et al.  A 0.45–1 V Fully-Integrated Distributed Switched Capacitor DC-DC Converter With High Density MIM Capacitor in 22 nm Tri-Gate CMOS , 2014, IEEE Journal of Solid-State Circuits.

[20]  Hai Qiu,et al.  Wavelet filter-based weak signature detection method and its application on rolling element bearing prognostics , 2006 .

[21]  Y. Takane,et al.  Generalized Inverse Matrices , 2011 .

[22]  Bapi Kar,et al.  A Stacked Autoencoder Neural Network based Automated Feature Extraction Method for Anomaly detection in On-line Condition Monitoring , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[23]  Youngkook Ahn,et al.  A buck converter with adaptive on-time PFM control and adjustable output voltage , 2012 .

[24]  Incremental-Precision Based Feature Computation and Multi-Level Classification for Low-Energy Internet-of-Things , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[25]  Arindam Basu,et al.  Low Power Probabilistic Floating Point Multiplier Design , 2011, 2011 IEEE Computer Society Annual Symposium on VLSI.

[26]  Xu Hong,et al.  An Optimum Inexact Design for an Energy Efficient Hearing Aid , 2019, J. Low Power Electron..

[27]  Kongari Srikanth Input-Based Dynamic Reconfiguration of Approximate Arithmetic Units for Video Encoding , 2017 .

[28]  Philip S. Yu,et al.  An unsupervised parameter learning model for RVFL neural network , 2019, Neural Networks.

[29]  Bill N. Schilit,et al.  Enabling the Internet of Things , 2015, Computer.

[30]  Noureddine Zerhouni,et al.  A Data-Driven Failure Prognostics Method Based on Mixture of Gaussians Hidden Markov Models , 2012, IEEE Transactions on Reliability.

[31]  Keshab K. Parhi,et al.  Seizure detection using regression tree based feature selection and polynomial SVM classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Arun Paidimarri,et al.  A Wide Dynamic Range Buck Converter With Sub-nW Quiescent Power , 2017, IEEE Journal of Solid-State Circuits.

[33]  H. R. Martin,et al.  Application of statistical moments to bearing failure detection , 1995 .

[34]  Biranchinath Sahu,et al.  An Accurate, Low-Voltage, CMOS Switching Power Supply With Adaptive On-Time Pulse-Frequency Modulation (PFM) Control , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[35]  Kaushik Roy,et al.  Approximate computing: An integrated hardware approach , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[36]  Zigmund Bluvband,et al.  Remaining useful life estimation for systems with non-trendability behaviour , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[37]  Wei Fu,et al.  A DCM-Only Buck Regulator With Hysteretic-Assisted Adaptive Minimum-On-Time Control for Low-Power Microcontrollers , 2016, IEEE Transactions on Power Electronics.

[38]  An-Yeu Wu,et al.  Error-Resilient Reconfigurable Boosting Extreme Learning Machine for ECG Telemonitoring Systems , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[39]  S. Yacout Logical analysis of maintenance and performance data of physical assets, ID34 , 2012, 2012 Proceedings Annual Reliability and Maintainability Symposium.

[40]  Mohamed El Hachemi Benbouzid A review of induction motors signature analysis as a medium for faults detection , 2000, IEEE Trans. Ind. Electron..

[41]  Arnab Raha,et al.  Input-Based Dynamic Reconfiguration of Approximate Arithmetic Units for Video Encoding , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[42]  Marian Verhelst,et al.  An Energy-Efficient Precision-Scalable ConvNet Processor in 40-nm CMOS , 2017, IEEE Journal of Solid-State Circuits.

[43]  Arnab Raha,et al.  Towards full-system energy-accuracy tradeoffs: A case study of an approximate smart camera system? , 2017, 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC).

[44]  Hugo Larochelle,et al.  An Autoencoder Approach to Learning Bilingual Word Representations , 2014, NIPS.

[45]  André van Schaik,et al.  Learning the pseudoinverse solution to network weights , 2012, Neural Networks.

[46]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[47]  Arindam Basu,et al.  Low-Power, Adaptive Neuromorphic Systems: Recent Progress and Future Directions , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[48]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[49]  Fulei Chu,et al.  Application of the wavelet transform in machine condition monitoring and fault diagnostics: a review with bibliography , 2004 .

[50]  André van Schaik,et al.  Online and adaptive pseudoinverse solutions for ELM weights , 2015, Neurocomputing.

[51]  Bapi Kar,et al.  ADEPOS: anomaly detection based power saving for predictive maintenance using edge computing , 2018, ASP-DAC.

[52]  Olivier Sigaud,et al.  Gated Autoencoders with Tied Input Weights , 2013, ICML.

[53]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[54]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[55]  Gernot A. Fink,et al.  Neuron Pruning for Compressing Deep Networks Using Maxout Architectures , 2017, GCPR.