A decision-making model based on a spiking neural circuit and synaptic plasticity

To adapt to the environment and survive, most animals can control their behaviors by making decisions. The process of decision-making and responding according to cues in the environment is stable, sustainable, and learnable. Understanding how behaviors are regulated by neural circuits and the encoding and decoding mechanisms from stimuli to responses are important goals in neuroscience. From results observed in Drosophila experiments, the underlying decision-making process is discussed, and a neural circuit that implements a two-choice decision-making model is proposed to explain and reproduce the observations. Compared with previous two-choice decision making models, our model uses synaptic plasticity to explain changes in decision output given the same environment. Moreover, biological meanings of parameters of our decision-making model are discussed. In this paper, we explain at the micro-level (i.e., neurons and synapses) how observable decision-making behavior at the macro-level is acquired and achieved.

[1]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[2]  M. Mitchell Waldrop,et al.  Computer modelling: Brain in a box , 2012, Nature.

[3]  H. Markram The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[4]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[5]  T Natschläger,et al.  Spatial and temporal pattern analysis via spiking neurons. , 1998, Network.

[6]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[7]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[8]  Bin Deng,et al.  Weak electric fields detectability in a noisy neural network , 2017, Cognitive Neurodynamics.

[9]  Yueqing Peng,et al.  Dopamine-Mushroom Body Circuit Regulates Saliency-Based Decision-Making in Drosophila , 2007, Science.

[10]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[11]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[12]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[13]  Ying Du,et al.  Oscillations and synchrony in a cortical neural network , 2013, Cognitive Neurodynamics.

[14]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[15]  Qing Chen,et al.  Bursting dynamics remarkably improve the performance of neural networks on liquid computing , 2016, Cognitive Neurodynamics.

[16]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[17]  Yuji Ikegaya,et al.  A neural network model of reliably optimized spike transmission , 2015, Cognitive Neurodynamics.

[18]  A Guo,et al.  Choice Behavior of Drosophila Facing Contradictory Visual Cues , 2001, Science.

[19]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[20]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[21]  M. Carandini From circuits to behavior: a bridge too far? , 2012, Nature Neuroscience.

[22]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[23]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[24]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[25]  Silvia Ferrari,et al.  Indirect training of a spiking neural network for flight control via spike-timing-dependent synaptic plasticity , 2010, 49th IEEE Conference on Decision and Control (CDC).

[26]  Dharmendra S. Modha,et al.  Anatomy of a cortical simulator , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[27]  Xu Zhang,et al.  Spike-based indirect training of a spiking neural network-controlled virtual insect , 2013, 52nd IEEE Conference on Decision and Control.

[28]  M. Poo,et al.  Calcium stores regulate the polarity and input specificity of synaptic modification , 2000, Nature.

[29]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.