Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task.

Analyzing neural dynamics underlying complex behavior is a major challenge in systems neurobiology. To meet this challenge through computational neuroscience, we have constructed a brain-based device (Darwin X) that interacts with a real environment, and whose behavior is guided by a simulated nervous system incorporating detailed aspects of the anatomy and physiology of the hippocampus and its surrounding regions. Darwin X integrates cues from its environment to solve a spatial memory task. Place-specific units, similar to place cells in the rodent, emerged by integrating visual and self-movement cues during exploration without prior assumptions in the model about environmental inputs. Because synthetic neural modeling using brain-based devices allows recording from all elements of the simulated nervous system during behavior, we were able to identify different functional hippocampal pathways. We did this by tracing back from reference neuronal units in the CA1 region of the simulated hippocampus to all of the synaptically connected units that were coactive during a particular exploratory behavior. Our analysis identified a number of different functional pathways within the simulated hippocampus that incorporate either the perforant path or the trisynaptic loop. Place fields, which were activated by the trisynaptic circuit, tended to be more selective and informative. However, place units that were activated by the perforant path were prevalent in the model and were crucial for generating appropriate exploratory behavior. Thus, in the model, different functional pathways influence place field activity and, hence, behavior during navigation.

[1]  G. Edelman,et al.  Degeneracy and complexity in biological systems , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[2]  G. Edelman,et al.  Behavioral constraints in the development of neuronal properties: a cortical model embedded in a real-world device. , 1998, Cerebral cortex.

[3]  G Tononi,et al.  Measures of degeneracy and redundancy in biological networks. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[4]  D. Cliff From animals to animats , 1994, Nature.

[5]  G. Edelman,et al.  Synthetic neural modeling applied to a real-world artifact. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Menno P. Witter,et al.  Place Cells and Place Recognition Maintained by Direct Entorhinal-Hippocampal Circuitry , 2002, Science.

[7]  David S. Touretzky,et al.  Neural Representation of Space Using Sinusoidal Arrays , 1993, Neural Computation.

[8]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  M. Gabriel,et al.  Learning and Computational Neuroscience: Foundations of Adaptive Networks , 1990 .

[10]  Philippe Gaussier,et al.  From view cells and place cells to cognitive map learning: processing stages of the hippocampal system , 2002, Biological Cybernetics.

[11]  Sven Koenig 'From Animals to Animats 5': Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior , 2000, Artificial Life.

[12]  Dario Floreano,et al.  From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior , 2000, Journal of Cognitive Neuroscience.

[13]  J. Taube Head direction cells and the neurophysiological basis for a sense of direction , 1998, Progress in Neurobiology.

[14]  Allen M. Waxman,et al.  A view-based neurocomputational system for relational map-making and navigation in visual environments , 1995, Robotics Auton. Syst..

[15]  M. Recce,et al.  Memory for places: A navigational model in support of Marr's theory of hippocampal function , 1996, Hippocampus.

[16]  G. Edelman,et al.  Visual binding through reentrant connectivity and dynamic synchronization in a brain-based device. , 2004, Cerebral cortex.

[17]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[18]  D. Amaral,et al.  Neurons, numbers and the hippocampal network. , 1990, Progress in brain research.

[19]  G. Mogenson,et al.  Neuropharmacological evidence to suggest that the nucleus accumbens and subpallidal region contribute to exploratory locomotion. , 1984, Behavioral and neural biology.

[20]  P. Grobstein Analysis of Visual Behavior, David J. Ingle, Melvyn A. Goodale, Richard J.W. Mansfield (Eds.). MIT press, Cambridge, MA and London (1982), 834 , 1983 .

[21]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[22]  Stewart W. Wilson,et al.  From Animals to Animats 5. Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior , 1997 .

[23]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[24]  J. Glowinski,et al.  Hippocampo‐prefrontal cortex pathway: Anatomical and electrophysiological characteristics , 2000, Hippocampus.

[25]  Aude Billard,et al.  From Animals to Animats , 2004 .

[26]  G. Edelman,et al.  A model of color vision based on cortical reentry. , 1996, Cerebral cortex.

[27]  R. Morris Developments of a water-maze procedure for studying spatial learning in the rat , 1984, Journal of Neuroscience Methods.

[28]  K M Gothard,et al.  Dynamics of Mismatch Correction in the Hippocampal Ensemble Code for Space: Interaction between Path Integration and Environmental Cues , 1996, The Journal of Neuroscience.

[29]  S. Grossberg The Link between Brain Learning, Attention, and Consciousness , 1999, Consciousness and Cognition.

[30]  L. F. Abbott,et al.  A Model of Spatial Map Formation in the Hippocampus of the Rat , 1999, Neural Computation.

[31]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  M. Shapiro,et al.  A simple network model simulates hippocampal place fields: parametric analyses and physiological predictions. , 1993 .

[33]  W. M. Keck,et al.  Machine Psychology : Autonomous Behavior , Perceptual Categorization and Conditioning in a Brain-based Device , 2002 .

[34]  M. Fyhn,et al.  Spatial Representation in the Entorhinal Cortex , 2004, Science.

[35]  Robert U Muller,et al.  Head direction cells: properties and functional significance , 1996, Current Opinion in Neurobiology.

[36]  Proceedings of the 2004 IEEE International Conference on Robotics and Automation, ICRA 2004, April 26 - May 1, 2004, New Orleans, LA, USA , 2004, ICRA.

[37]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[38]  B. McNaughton,et al.  Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences , 1996, Hippocampus.

[39]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[40]  David J. Foster,et al.  A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[41]  C. Bernard,et al.  Model of local connectivity patterns in CA3 and CA1 areas of the hippocampus , 1994, Hippocampus.

[42]  E. Rolls,et al.  Computational analysis of the role of the hippocampus in memory , 1994, Hippocampus.

[43]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[44]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .