Energy and Area Efficiency in Neuromorphic Computing for Resource Constrained Devices

Resource constrained devices are the building blocks of the internet of things (IoT) era. Since the idea behind IoT is to develop an interconnected environment where the devices are tiny enough to operate with limited resources, several control systems have been built to maintain low energy and area consumption while operating as IoT edge devices. Several researchers have begun work on implementing control systems built from resource constrained devices using machine learning. However, there are many ways such devices can achieve lower power consumption and area utilization while maximizing application efficiency. Spiky neuromorphic computing (SNC) is an emerging paradigm that can be leveraged in resource constrained devices for several emerging applications. While delivering the benefits of machine learning, SNC also helps minimize power consumption. For example, low energy memory devices (memristors) are often used to achieve low power operation and also help in reducing system area. In total, we anticipate SNC will provide computational efficiency approaching that of deep learning while using low power, resource constrained devices.

[1]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[2]  Catherine D. Schuman,et al.  Dynamic Artificial Neural Networks with Affective Systems , 2013, PloS one.

[3]  L. Chua Memristor-The missing circuit element , 1971 .

[4]  Jianping Wu,et al.  BGP with BGPsec: Attacks and Countermeasures , 2019, IEEE Network.

[5]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[6]  Catherine D. Schuman Neuroscience-Inspired Dynamic Architectures , 2015 .

[7]  Jie Tang,et al.  Enabling Deep Learning on IoT Devices , 2017, Computer.

[8]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[9]  Yiran Chen,et al.  Memristor Crossbar-Based Neuromorphic Computing System: A Case Study , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Steven Bohez,et al.  Resource-constrained classification using a cascade of neural network layers , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[11]  J. Yang,et al.  High switching endurance in TaOx memristive devices , 2010 .

[12]  Karsten Beckmann,et al.  A practical hafnium-oxide memristor model suitable for circuit design and simulation , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[14]  A. James 2010 , 2011, Philo of Alexandria: an Annotated Bibliography 2007-2016.

[15]  Soheil Ghiasi,et al.  Machine Intelligence on Resource-Constrained IoT Devices , 2017, ACM Trans. Embed. Comput. Syst..

[16]  Garrett S. Rose,et al.  A mixed-signal approach to memristive neuromorphic system design , 2017, 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS).

[17]  M. Pickett,et al.  Lognormal switching times for titanium dioxide bipolar memristors: origin and resolution , 2011, Nanotechnology.

[18]  Catherine D. Schuman,et al.  Memristive Mixed-Signal Neuromorphic Systems: Energy-Efficient Learning at the Circuit-Level , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[19]  N. Cady,et al.  Nanoscale Hafnium Oxide RRAM Devices Exhibit Pulse Dependent Behavior and Multi-level Resistance Capability , 2016 .

[20]  Catherine D. Schuman,et al.  NeoN: Neuromorphic control for autonomous robotic navigation , 2017, 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS).

[21]  Frederick T. Chen,et al.  Low-Power and Nanosecond Switching in Robust Hafnium Oxide Resistive Memory With a Thin Ti Cap , 2010, IEEE Electron Device Letters.