Neuromorphic visual saliency implementation using stochastic computation

Visual saliency models are difficult to implement in hardware for real time applications due to their computational complexity. The conventional digital implementation is not optimal because of the requirement of a large number of convolution operations for filtering on several feature channels across multiple image pyramids [1], [2]. Here, we propose an alternative approach to implement a neuromorphic visual saliency algorithm [3] in digital hardware using stochastic computation, which can achieve very low power and small area. We show the real time implementation of important building blocks of the system and compare the overall system with its software implementation. Our implementation will be useful for facilitating high-fidelity selective rendering in computer graphics applications using the output of the saliency model, and for communications, where the non-salient parts of an image can be compressed more heavily than the salient parts. Our implementation will find several applications as a frontend co-processor for information triaging, compression and analysis in computer vision tasks. Our proposed SC-based convolution circuit could be a potential building block for implanting deep convolutional neural networks (CNN) on hardware.

[1]  John P. Hayes,et al.  Stochastic circuits for real-time image-processing applications , 2013, 2013 50th ACM/EDAC/IEEE Design Automation Conference (DAC).

[2]  Xilinx Family Efficient Shift Registers, LFSR Counters, and Long Pseudo- Random Sequence Generators , 1996 .

[3]  Kia Bazargan,et al.  Computation on Stochastic Bit Streams Digital Image Processing Case Studies , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[4]  Eduardo Ros,et al.  Real-Time Visual Saliency Architecture for FPGA With Top-Down Attention Modulation , 2014, IEEE Transactions on Industrial Informatics.

[5]  P. Sterling,et al.  Efficiency of Information Transmission by Retinal Ganglion Cells , 2004, Current Biology.

[6]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[7]  Stefan Mihalas,et al.  A model of proto-object based saliency , 2014, Vision Research.

[8]  Brian R. Gaines,et al.  Stochastic Computing Systems , 1969 .

[9]  Peter Alfke,et al.  Efficient Shift Registers, LFSR Counters, and Long Pseudo Random Sequence Generators , 1995 .

[10]  M. Harrison,et al.  Advances in Information Systems Science , 1981, Springer US.

[11]  André van Schaik,et al.  A neuromorphic hardware framework based on population coding , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[12]  John P. Hayes,et al.  Exploiting correlation in stochastic circuit design , 2013, 2013 IEEE 31st International Conference on Computer Design (ICCD).

[13]  T. Matsushima,et al.  Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks , 2016, Front. Neurosci..

[14]  André van Schaik,et al.  FPGA implementation of the CAR Model of the cochlea , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[15]  Sanjay Singh,et al.  An FPGA implementation of image signature based visual-saliency detection , 2014, 18th International Symposium on VLSI Design and Test.

[16]  L. Devroye Non-Uniform Random Variate Generation , 1986 .

[17]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[18]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.