A Feasible FPGA Weightless Neural Accelerator

AI applications have recently driven the computer architecture industry towards novel and more efficient dedicated hardware accelerators and tools. Weightless Neural Networks (WNNs) is a class of Artificial Neural Networks (ANNs) often applied to pattern recognition problems. It uses a set of Random Access Memories (RAMs) as the main mechanism for training and classifying information regarding a given input pattern. Due to its memory-based architecture, it can be easily mapped onto hardware and also greatly accelerated by means of a dedicated Register Transfer-Level (RTL) architecture designed to enable multiple memory accesses in parallel. On the other hand, a straightforward WNN hardware implementation requires too much memory resources for both ASIC and FPGA variants. This work aims at designing and evaluating a Weightless Neural accelerator designed in High-Level Synthesis (HLS). Our WNN accelerator implements Hash Tables, instead of regular RAMs, to substantially reduce its memory requirements, so that it can be implemented in a fairly small-sized Xilinx FPGA. Performance, circuit-area and power consumption results show that our accelerator can efficiently learn and classify the MNIST dataset in about 8 times faster than the system's embedded ARM processor.

[1]  Felipe Maia Galvão França,et al.  A Smart Disk for In-Situ Face Recognition , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[2]  Eduardo Costa,et al.  A new intelligent systems approach to 3D animation in television , 2007, CIVR '07.

[3]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[4]  Giancarlo Mauri,et al.  Resource-Efficient Hardware Implementation of a Neural-based Node for Automatic Fingerprint Classification , 2017, J. Wirel. Mob. Networks Ubiquitous Comput. Dependable Appl..

[5]  Damodar Reddy Edla,et al.  Automatic disease diagnosis using optimised weightless neural networks for low-power wearable devices , 2017, Healthcare technology letters.

[6]  Massimo De Gregorio,et al.  An Intelligent Active Video Surveillance System Based on the Integration of Virtual Neural Sensors and BDI Agents , 2008, IEICE Trans. Inf. Syst..

[7]  Claudine Badue,et al.  VG-RAM Weightless Neural Networks for Face Recognition , 2010 .

[8]  Dan E. Willard New Trie Data Structures Which Support Very Fast Search Operations , 1984, J. Comput. Syst. Sci..

[9]  Vincenzo Conti,et al.  Efficient MLP digital implementation on FPGA , 2005, 8th Euromicro Conference on Digital System Design (DSD'05).

[10]  Paolo Coraggio,et al.  WiSARD and NSP for Robot Global Localization , 2007, IWINAC.

[11]  Larry Carter,et al.  Universal Classes of Hash Functions , 1979, J. Comput. Syst. Sci..

[12]  Felipe Maia Galvão França,et al.  Online tracking of multiple objects using WiSARD , 2014, ESANN.

[13]  Jonice Oliveira,et al.  Evaluating Binary Encoding Techniques for WiSARD , 2016, 2016 5th Brazilian Conference on Intelligent Systems (BRACIS).