Estimating Memory Deterioration Rates Following Neurodegeneration and Traumatic Brain Injuries in a Hopfield Network Model

Neurodegenerative diseases and traumatic brain injuries (TBI) are among the main causes of cognitive dysfunction in humans. At a neuronal network level, they both extensively exhibit focal axonal swellings (FAS), which in turn, compromise the information encoded in spike trains and lead to potentially severe functional deficits. There are currently no satisfactory quantitative predictors of decline in memory-encoding neuronal networks based on the impact and statistics of FAS. Some of the challenges of this translational approach include our inability to access small scale injuries with non-invasive methods, the overall complexity of neuronal pathologies, and our limited knowledge of how networks process biological signals. The purpose of this computational study is three-fold: (i) to extend Hopfield's model for associative memory to account for the effects of FAS, (ii) to calibrate FAS parameters from biophysical observations of their statistical distribution and size, and (iii) to systematically evaluate deterioration rates for different memory-recall tasks as a function of FAS injury. We calculate deterioration rates for a face-recognition task to account for highly correlated memories and also for a discrimination task of random, uncorrelated memories with a size at the capacity limit of the Hopfield network. While it is expected that the performance of any injured network should decrease with injury, our results link, for the first time, the memory recall ability to observed FAS statistics. This allows for plausible estimates of cognitive decline for different stages of brain disorders within neuronal networks, bridging experimental observations following neurodegeneration and TBI with compromised memory recall. The work lends new insights to help close the gap between theory and experiment on how biological signals are processed in damaged, high-dimensional functional networks, and towards positing new diagnostic tools to measure cognitive deficits.

[1]  P. Bayly,et al.  Mild traumatic brain injury to the infant mouse causes robust white matter axonal degeneration which precedes apoptotic death of cortical and thalamic neurons , 2008, Experimental Neurology.

[2]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[3]  Michael Chopp,et al.  Animal models of traumatic brain injury , 2013, Nature Reviews Neuroscience.

[4]  Pedro D. Maia,et al.  Reaction time impairments in decision-making networks as a diagnostic marker for traumatic brain injuries and neurodegenerative diseases , 2016, 1608.05778.

[5]  Tim Shallice,et al.  The Involvement of the Frontal Lobes in Cognitive Estimation , 1978, Cortex.

[6]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[7]  J. Nathan Kutz,et al.  Reaction time impairments in decision-making networks as a diagnostic marker for traumatic brain injuries and neurological diseases , 2017, Journal of Computational Neuroscience.

[8]  M. A. Omar,et al.  The composite Milstein methods for the numerical solution of Stratonovich stochastic differential equations , 2009, Appl. Math. Comput..

[9]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[10]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[11]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[12]  J. Villablanca,et al.  Moderate and Severe Traumatic Brain Injury: Epidemiologic, Imaging and Neuropathologic Perspectives , 2004, Brain pathology.

[13]  S. Hauser,et al.  The Neurobiology of Multiple Sclerosis: Genes, Inflammation, and Neurodegeneration , 2006, Neuron.

[14]  G. Clifton,et al.  Prolonged memory impairment in the absence of hippocampal cell death following traumatic brain injury in the rat , 1990, Brain Research.

[15]  Ramona O Hopkins,et al.  Visual discrimination performance, memory, and medial temporal lobe function , 2012, Proceedings of the National Academy of Sciences.

[16]  Karl Steinbuch,et al.  Learning Matrices and Their Applications , 1963, IEEE Trans. Electron. Comput..

[17]  J Q Trojanowski,et al.  Axon pathology in Parkinson's disease and Lewy body dementia hippocampus contains alpha-, beta-, and gamma-synuclein. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[18]  J. Povlishock,et al.  Traumatic axonal injury in the optic nerve: evidence for axonal swelling, disconnection, dieback, and reorganization. , 2011, Journal of neurotrauma.

[19]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  E. Adrian,et al.  The impulses produced by sensory nerve‐endings , 1926 .

[21]  A. Saykin,et al.  Working memory deficits after traumatic brain injury: catecholaminergic mechanisms and prospects for treatment — a review , 2004, Brain injury.

[22]  W. Little.  The existence of persistent states in the brain , 1974 .

[23]  Douglas H. Smith,et al.  Mechanical breaking of microtubules in axons during dynamic stretch injury underlies delayed elasticity, microtubule disassembly, and axon degeneration , 2010, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[24]  P. Bayly,et al.  Spatiotemporal evolution of apoptotic neurodegeneration following traumatic injury to the developing rat brain , 2006, Brain Research.

[25]  D. Schacter.  Memory, amnesia, and frontal lobe dysfunction , 1987, Psychobiology.

[26]  M. Petrides.  Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man , 1985, Neuropsychologia.

[27]  Victoria E. Johnson,et al.  Partial interruption of axonal transport due to microtubule breakage accounts for the formation of periodic varicosities after traumatic axonal injury , 2012, Experimental Neurology.

[28]  M. Coleman.  Axon degeneration mechanisms: commonality amid diversity , 2005, Nature Reviews Neuroscience.

[29]  Pedro D. Maia,et al.  Diagnostic tools for evaluating the impact of Focal Axonal Swellings arising in neurodegenerative diseases and/or traumatic brain injury , 2015, Journal of Neuroscience Methods.

[30]  I. Knuesel,et al.  Deciphering the mechanism underlying late-onset Alzheimer disease , 2013, Nature Reviews Neurology.

[31]  Desmond J. Higham,et al.  An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations , 2001, SIAM Rev..

[32]  Eytan Ruppin,et al.  Patterns of Functional Damage in Neural Network Models of Associative Memory , 1995, Neural Computation.

[33]  Stefano Fusi,et al.  Computational principles of biological memory , 2015, 1507.07580.

[34]  Mark D'Esposito,et al.  Working memory impairments in traumatic brain injury: evidence from a dual-task paradigm , 1997, Neuropsychologia.

[35]  J. Trojanowski,et al.  Axon pathology in Parkinson ’ s disease and Lewy body dementia hippocampus contains a-, b-, and g-synuclein , 1999 .

[36]  J. Nathan Kutz,et al.  Compromised axonal functionality after neurodegeneration, concussion and/or traumatic brain injury , 2014, Journal of Computational Neuroscience.

[37]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[38]  H. Spitzer,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics. , 1987, Journal of neurophysiology.

[39]  G. N. Mil’shtejn.  Approximate Integration of Stochastic Differential Equations , 1975 .

[40]  V. Magnotta,et al.  White matter abnormalities in veterans with mild traumatic brain injury. , 2012, The American journal of psychiatry.

[41]  J. Nathan Kutz,et al.  Identifying critical regions for spike propagation in axon segments , 2013, Journal of Computational Neuroscience.

[42]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.