Neuromorphic Vision Hybrid RRAM-CMOS Architecture

The development of a bioinspired image sensor, which can match the functionality of the vertebrate retina, has provided new opportunities for vision systems and processing through the realization of new architectures. Research in both retinal cellular systems and nanodriven memristive technology has made a challenging arena more accessible to emulate features of the retina that are closer to biological systems. This paper synthesizes the signal flow path of photocurrent throughout a retina in a scalable 180-nm CMOS technology, which initiates at a <inline-formula> <tex-math notation="LaTeX">$128\times 128$ </tex-math></inline-formula> active pixel image sensor, and converges to a <inline-formula> <tex-math notation="LaTeX">$16\times 16$ </tex-math></inline-formula> array, where each node emits a spike train synonymous to the function of the retinal ganglionic output cell. This signal can be sent to the visual cortex for image interpretation as part of an artificial vision system. Layers of memristive networks are used to emulate the functions of horizontal and amacrine cells in the retina, which average and converge signals. The resulting image matches biologically verified results within an error margin of 6% and exhibits the following features of the retina: lateral inhibition, asynchronous adaptation, and a low-dynamic-range integration active pixel sensor to perceive a high-dynamic-range scene.

[1]  Amitava Mukherjee,et al.  Pervasive Computing: A Paradigm for the 21st Century , 2003, Computer.

[2]  D. Ritter,et al.  Resistive Switching in $\hbox{HfO}_{2}$ Probed by a Metal–Insulator–Semiconductor Bipolar Transistor , 2012, IEEE Electron Device Letters.

[3]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[4]  R. Masland The fundamental plan of the retina , 2001, Nature Neuroscience.

[5]  Antonio C. Roque,et al.  A Computational Study on the Role of Gap Junctions and Rod Ih Conductance in the Enhancement of the Dynamic Range of the Retina , 2009, PloS one.

[6]  Le Zheng,et al.  Unified modeling for memristive devices based on charge-flux constitutive relationships , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[7]  S. Usui,et al.  Ionic current model of bipolar cells in the lower vertebrate retina , 1996, Vision Research.

[8]  S. Usui,et al.  Ionic current model of the vertebrate rod photoreceptor , 1996, Vision Research.

[9]  Seung-Pyo Chae,et al.  A moving detectable retina model considering the mechanism of an amacrine cell for vision , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[10]  Leon O. Chua,et al.  Dynamic Behavior of Coupled Memristor Circuits , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  Chung-Yu Wu,et al.  An improved BJT-based silicon retina with tunable image smoothing capability , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[12]  Dave Regan,et al.  Human perception of objects: early visual processing of spatial form defined by luminance , 2000 .

[13]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[14]  Kwabena Boahen,et al.  A silicon retina that reproduces signals in the optic nerve , 2006, Journal of neural engineering.

[15]  Sangho Shin,et al.  Compact Circuit Model and Hardware Emulation for Floating Memristor Devices , 2013, IEEE Circuits and Systems Magazine.

[16]  T. S. Axelrod,et al.  A retina-like model for motion detection , 1989, International 1989 Joint Conference on Neural Networks.

[17]  Alex Pappachen James,et al.  Logic Family Power Dissipation (μw) , 2022 .

[18]  Alfred Stett,et al.  Subretinal electronic chips allow blind patients to read letters and combine them to words , 2010, Proceedings of the Royal Society B: Biological Sciences.

[19]  J. Fohlmeister,et al.  Modeling the repetitive firing of retinal ganglion cells , 1990, Brain Research.

[20]  Jin Luo,et al.  Computing motion using analog and binary resistive networks , 1988, Computer.

[21]  J. Rabin The Retina: An Approachable Part of the Brain , 2013 .

[22]  Tyrone Fernando,et al.  Modelling and analysis of signal flow platform implementation into retinal cell pathway , 2016, 2016 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).

[23]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[24]  Shiro Usui,et al.  Simulation analysis of bandpass filtering properties of a rod photoreceptor network , 2009, Vision Research.

[25]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[26]  L. Chua Memristor-The missing circuit element , 1971 .

[27]  Kyoung-Rok Cho,et al.  Formulation and Implementation of Nonlinear Integral Equations to Model Neural Dynamics Within the Vertebrate Retina , 2018, Int. J. Neural Syst..

[28]  James Barnes Essential Biological Psychology , 2013 .

[29]  James J. Chambers,et al.  A Positive Feedback Synapse from Retinal Horizontal Cells to Cone Photoreceptors , 2011, PLoS biology.

[30]  Stephen J. Wolf,et al.  The elusive memristor: properties of basic electrical circuits , 2008, 0807.3994.

[31]  Eby G. Friedman,et al.  VTEAM – A General Model for Voltage Controlled Memristors , 2014 .

[32]  Nicolangelo Iannella,et al.  Signal Flow Platform for Mapping and Simulation of Vertebrate Retina for Sensor Systems , 2016, IEEE Sensors Journal.

[33]  Leon O. Chua,et al.  If it’s pinched it’s a memristor , 2014 .

[34]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[35]  K. Yau,et al.  Role of visual pigment properties in rod and cone phototransduction , 2003, Nature.

[36]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[37]  Seyed Nima Mozaffari,et al.  More Efficient Testing of Metal-Oxide Memristor–Based Memory , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[38]  M Tessier-Lavigne,et al.  The effect of photoreceptor coupling and synapse nonlinearity on signal : noise ratio in early visual processing , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[39]  C W Tyler,et al.  Phototransduction: Modeling the primate cone flash response , 1995, Visual Neuroscience.

[40]  A. Hodgkin,et al.  The electrical response of turtle cones to flashes and steps of light , 1974, The Journal of physiology.

[41]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[42]  J. I. Korenbrot,et al.  Speed, adaptation, and stability of the response to light in cone photoreceptors: The functional role of Ca-dependent modulation of ligand sensitivity in cGMP-gated ion channels , 2012, The Journal of general physiology.

[43]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[44]  Tamás Roska,et al.  A Biomimetic Model of the Outer Plexiform Layer by Incorporating Memristive Devices , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Tyrone Fernando,et al.  Modelling and characterization of dynamic behavior of coupled memristor circuits , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[46]  R H Masland,et al.  Light-evoked responses of bipolar cells in a mammalian retina. , 2000, Journal of neurophysiology.

[47]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[48]  Sohmyung Ha,et al.  An Ultra Low Power Silicon Retina with Spatial and Temporal Filtering , 2010 .

[49]  Sung-Mo Kang,et al.  Compact Models for Memristors Based on Charge-Flux Constitutive Relationships , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[50]  David Holcman,et al.  The Limit of Photoreceptor Sensitivity , 2005, The Journal of general physiology.

[51]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.