Stochastic bitstream-based CNN and its implementation on FPGA

Starting from the biological background on the olfactory architecture of both insects and mammalians, different nonlinear systems able to respond to spatial-distributed external stimuli with spatial–temporal dynamics have been investigated in the last decade. Among these, there is a class of neural networks that produces quasi-periodic trajectories that pass near heteroclinic contours and prove to be global attractors for the system. For this reason, these networks are called winnerless competition (WLC) networks. The sequence of saddle points crossed by each trajectory depends on the spatial input presented to the network and can be used as a ‘code’ representing a specific class of stimuli. Thanks to the intrinsic discrimination, WLC networks are often used for classification. In this paper, this capability is exploited within a framework for action-oriented perception. WLC networks are here used as bio-inspired architectures for the association between stimuli and ‘percepts’. After presenting the theoretical basis of the WLC network in the classic Lotka–Volterra system, we investigate how WLC networks can be formalized in terms of cellular nonlinear networks (CNNs) hosting different kinds of cells: the FitzHugh–Nagumo neuron, the Izhikevich neuron and the single layer CNN standard cell. In order to find efficient ways to code environmental stimuli for action generation, we analyze and compare these WLC-based CNNs in terms of number of generated classes and robustness against the initial conditions. Based on the simulation results, we apply the best-performing system to solve a perceptual task involving navigation and obstacle avoidance. We demonstrate how the large memory capacity shown by the WLC–CNN is able to contribute to the new perceptual framework for autonomous artificial agents, where the association between stimuli and sequences is learned through the experience. Copyright © 2008 John Wiley & Sons, Ltd.

[1]  Jan Wessnitzer,et al.  Multimodal sensory integration in insects—towards insect brain control architectures , 2006, Bioinspiration & biomimetics.

[2]  Ángel Rodríguez-Vázquez,et al.  Bio-inspired analog VLSI design realizes programmable complex spatio-temporal dynamics on a single chip , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[3]  L. Fortuna,et al.  Neuronal dynamics on FPGA: Izhikevich's model , 2005, SPIE Microtechnologies.

[4]  M. Meredith,et al.  Patterned response to odor in mammalian olfactory bulb: the influence of intensity. , 1986, Journal of neurophysiology.

[5]  Pablo Varona,et al.  Heteroclinic Contours in Neural Ensembles and the Winnerless Competition Principle , 2004, Int. J. Bifurc. Chaos.

[6]  Tamás Roska,et al.  Digital implementation of cellular sensor-computers , 2006, Int. J. Circuit Theory Appl..

[7]  Luigi Fortuna,et al.  Turing Patterns in RD-CNNS for the Emergence of Perceptual States in Roving Robots , 2007, Int. J. Bifurc. Chaos.

[8]  P. Arena,et al.  Spatio-temporal patterns in CNNs for classification: the winnerless competition principle , 2006, 2006 10th International Workshop on Cellular Neural Networks and Their Applications.

[9]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[10]  John G. Hildebrand,et al.  Male-specific, sex pheromone-selective projection neurons in the antennal lobes of the mothManduca sexta , 1987, Journal of Comparative Physiology A.

[11]  G. Laurent,et al.  Temporal Representations of Odors in an Olfactory Network , 1996, The Journal of Neuroscience.

[12]  Luigi Fortuna,et al.  An adaptive, self-organizing dynamical system for hierarchical control of bio-inspired locomotion , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[14]  Barbara Webb,et al.  A simple latency-dependent spiking-neuron model of cricket phonotaxis , 2000, Biological Cybernetics.

[15]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[16]  R Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001, Physical review letters.

[17]  István Petrás,et al.  Complex dynamics in one‐dimensional CNNs , 2006, Int. J. Circuit Theory Appl..

[18]  Pauline van den Driessche,et al.  Three-Dimensional Competitive Lotka-Volterra Systems with no Periodic Orbits , 1998, SIAM J. Appl. Math..

[19]  Luigi Fortuna,et al.  The WLC principle for action-oriented perception , 2007, SPIE Microtechnologies.

[20]  Ronald Tetzlaff,et al.  Automated detection of a preseizure state: non‐linear EEG analysis in epilepsy by Cellular Nonlinear Networks and Volterra systems , 2006, Int. J. Circuit Theory Appl..

[21]  Philipp Fischer,et al.  Automated detection of a preseizure state: non-linear EEG analysis in epilepsy by Cellular Nonlinear Networks and Volterra systems: Research Articles , 2006 .

[22]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[23]  Joseph E. Paullet,et al.  A Lotka-Volterra Three-species Food Chain , 2002 .

[24]  Ramón Huerta,et al.  Dynamical encoding by networks of competing neuron groups: winnerless competition. , 2001 .

[25]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[26]  Johan A. K. Suykens,et al.  Learning of spatiotemporal behaviour in cellular neural networks , 2006, Int. J. Circuit Theory Appl..