On the role of theory and modeling in neuroscience.

In recent years, the field of neuroscience has gone through rapid experimental advances and extensive use of quantitative and computational methods. This accelerating growth has created a need for methodological analysis of the role of theory and the modeling approaches currently used in this field. Toward that end, we start from the general view that the primary role of science is to solve empirical problems, and that it does so by developing theories that can account for phenomena within their domain of application. We propose a commonly-used set of terms - descriptive, mechanistic, and normative - as methodological designations that refer to the kind of problem a theory is intended to solve. Further, we find that models of each kind play distinct roles in defining and bridging the multiple levels of abstraction necessary to account for any neuroscientific phenomenon. We then discuss how models play an important role to connect theory and experiment, and note the importance of well-defined translation functions between them. Furthermore, we describe how models themselves can be used as a form of experiment to test and develop theories. This report is the summary of a discussion initiated at the conference Present and Future Theoretical Frameworks in Neuroscience, which we hope will contribute to a much-needed discussion in the neuroscientific community.

[1]  A. Redish,et al.  Taking an engineer's view: Implications of network analysis for computational psychiatry , 2019, Behavioral and Brain Sciences.

[2]  J. Feldman,et al.  Sodium and Calcium Current-Mediated Pacemaker Neurons and Respiratory Rhythm Generation , 2005, The Journal of Neuroscience.

[3]  Karl J. Friston,et al.  Nonlinear Dynamic Causal Models for Fmri Nonlinear Dynamic Causal Models for Fmri Nonlinear Dynamic Causal Models for Fmri , 2022 .

[4]  R. Phillips Theory in Biology: Figure 1 or Figure 7? , 2015, Trends in cell biology.

[5]  Terrence J. Sejnowski,et al.  The Computational Brain , 1996, Artif. Intell..

[6]  A. Redish,et al.  Addiction as a Computational Process Gone Awry , 2004, Science.

[7]  Kim Plunkett,et al.  Connectionist Models of Behaviour and Cognition II: Proceedings of the 11th Neural Computation and Psychology Workshop , 2009 .

[8]  M. Morad,et al.  Ionic membrane conductance during the time course of the cardiac action potential. , 1977, The Journal of physiology.

[9]  On the Role of Abstraction , 1996 .

[10]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[11]  John D. Potter,et al.  The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century , 2001, Nature Medicine.

[12]  T. Insel,et al.  Brain disorders? Precisely , 2015, Science.

[13]  Eve Marder Models identify hidden assumptions , 2000, Nature Neuroscience.

[14]  D H Hubel,et al.  Brain mechanisms of vision. , 1979, Scientific American.

[15]  Constantin F. Aliferis,et al.  An Evaluation of Active Learning Causal Discovery Methods for Reverse-Engineering Local Causal Pathways of Gene Regulation , 2016, Scientific reports.

[16]  Larry Laudan,et al.  Progress and its problems: Toward a theory of scientific growth , 1978 .

[17]  Heather Douglas Pure science and the problem of progress. , 2014, Studies in history and philosophy of science.

[18]  L. Valiant Probably Approximately Correct: Nature's Algorithms for Learning and Prospering in a Complex World , 2013 .

[19]  William Bechtel,et al.  Dynamical Models: An Alternative or Complement to Mechanistic Explanations? , 2011, Top. Cogn. Sci..

[20]  W. Grill,et al.  Deep brain stimulation of the subthalamic nucleus reestablishes neuronal information transmission in the 6-OHDA rat model of parkinsonism. , 2014, Journal of neurophysiology.

[21]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[22]  Constantin F. Aliferis,et al.  Learning Causal and Predictive Clinical Practice Guidelines from Data , 2007, MedInfo.

[23]  Nancy Cartwright Models: The Blueprints for Laws , 1997, Philosophy of Science.

[24]  P. Machamer,et al.  Thinking about Mechanisms , 2000, Philosophy of Science.

[25]  A. Fenton,et al.  Coordinating different representations in the hippocampus , 2016, Neurobiology of Learning and Memory.

[26]  Lily Elefteriadou An Introduction to Traffic Flow Theory , 2013 .

[27]  Eve Marder,et al.  Computational models in the age of large datasets , 2015, Current Opinion in Neurobiology.

[28]  Michael M Merzenich,et al.  Lifelong plasticity in the rat auditory cortex: basic mechanisms and role of sensory experience. , 2011, Progress in brain research.

[29]  William Bialek,et al.  Perspectives on theory at the interface of physics and biology , 2015, Reports on progress in physics. Physical Society.

[30]  William Bechtel,et al.  Integrating sciences by creating new disciplines: The case of cell biology , 1993 .

[31]  James A. Evans,et al.  Large teams develop and small teams disrupt science and technology , 2019, Nature.

[32]  O. Wolkenhauer Why model? , 2013, Front. Physiol..

[33]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[34]  An Introduction to the Philosophy of Science , 2015 .

[35]  J. Sethna,et al.  Parameter Space Compression Underlies Emergent Theories and Predictive Models , 2013, Science.

[36]  A. Ghazanfar,et al.  The Life of Behavior , 2019, Neuron.

[37]  J. Feldman,et al.  Breathing matters , 2018, Nature Reviews Neuroscience.

[38]  S. Cajal,et al.  Histology of the Nervous System , 1911 .

[39]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[40]  T. Kuhn,et al.  The Structure of Scientific Revolutions: 50th Anniversary Edition , 2012 .

[41]  Hasok Chang,et al.  Inventing Temperature: Measurement and Scientific Progress , 2004 .

[42]  Jonathan W. Pillow,et al.  Inferring synaptic inputs from spikes with a conductance-based neural encoding model , 2018, bioRxiv.

[43]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[44]  J. Ramirez,et al.  Defining the Rhythmogenic Elements of Mammalian Breathing. , 2018, Physiology.

[45]  Horacio G. Rotstein,et al.  A reduced model for medial entorhinal cortex stellate cell : subthreshold oscillations , spiking and synchronization , 2005 .

[46]  L. Squire Memory and Brain , 1987 .

[47]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[48]  E. Fehr,et al.  Social Preferences and the Brain , 2014 .

[49]  Brian M. Sweis,et al.  Mice learn to avoid regret , 2018, PLoS biology.

[50]  F. Crick,et al.  Molecular Structure of Nucleic Acids: A Structure for Deoxyribose Nucleic Acid , 1974, Nature.

[51]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[52]  M. Strevens Scientific Explanation , 2005 .

[53]  Lynn Nadel,et al.  Multiple Memory Systems: What and Why , 1992, Journal of Cognitive Neuroscience.

[54]  W. Bialek Biophysics: Searching for Principles , 2012 .

[55]  W. Wimsatt Reductionism, Levels of Organization, and the Mind-Body Problem , 1976 .

[56]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[57]  G. Ermentrout,et al.  Frequency Plateaus in a Chain of Weakly Coupled Oscillators, I. , 1984 .

[58]  M. Jeng A selected history of expectation bias in physics , 2005, physics/0508199.

[59]  Patrick Grim,et al.  SCIENTIFIC NETWORKS ON DATA LANDSCAPES: QUESTION DIFFICULTY, EPISTEMIC SUCCESS, AND CONVERGENCE , 2013, Episteme.

[60]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[61]  N. David Mermin,et al.  What's Wrong with this Pillow? , 1989 .

[62]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[63]  Jan-Marino Ramirez,et al.  Differential Contribution of Pacemaker Properties to the Generation of Respiratory Rhythms during Normoxia and Hypoxia , 2004, Neuron.

[64]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[65]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[66]  Richard C Gerkin,et al.  Towards systematic, data-driven validation of a collaborative, multi-scale model of Caenorhabditis elegans , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[67]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[68]  C. Hempel,et al.  Studies in the Logic of Explanation , 1948, Philosophy of Science.

[69]  Andrew M. Wikenheiser,et al.  Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task , 2013, Proceedings of the National Academy of Sciences.

[70]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[71]  D. Rubin,et al.  Causal Inference for Statistics, Social, and Biomedical Sciences: A General Method for Estimating Sampling Variances for Standard Estimators for Average Causal Effects , 2015 .

[72]  Adam Johnson,et al.  Computing motivation: Incentive salience boosts of drug or appetite states , 2008, Behavioral and Brain Sciences.

[73]  L. T. Robertson Memory and the brain. , 2002, Journal of dental education.

[74]  Luca Berdondini,et al.  Sloppiness in Spontaneously Active Neuronal Networks , 2015, The Journal of Neuroscience.

[75]  Tom Stafford,et al.  What use are computational models of cognitive processes , 2009 .

[76]  Cailin O'Connor,et al.  Simulation and Similarity: Using Models to Understand the World , 2016 .

[77]  Daniele Fanelli,et al.  Opinion: Is science really facing a reproducibility crisis, and do we need it to? , 2018, Proceedings of the National Academy of Sciences.

[78]  Jeremy Gunawardena,et al.  Models in biology: ‘accurate descriptions of our pathetic thinking’ , 2014, BMC Biology.

[79]  Andrea E. Martin,et al.  How Computational Modeling Can Force Theory Building in Psychological Science , 2020, Perspectives on psychological science : a journal of the Association for Psychological Science.

[80]  William Bechtel,et al.  Mechanisms in Cognitive Psychology: What Are the Operations? , 2008, Philosophy of Science.

[81]  Konrad Paul Kording,et al.  The dynamics of memory as a consequence of optimal adaptation to a changing body , 2007, Nature Neuroscience.

[82]  Chris Arney Probably Approximately Correct: Nature's Algorithms for Learning and Prospering in a Complex World , 2014 .

[83]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[84]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[85]  A. Pestronk Histology of the Nervous System of Man and Vertebrates , 1997, Neurology.

[86]  E. Marder,et al.  Similar network activity from disparate circuit parameters , 2004, Nature Neuroscience.

[87]  Adeel Razi,et al.  A DCM for resting state fMRI , 2014, NeuroImage.

[88]  Yadin Dudai,et al.  To Simulate or Not to Simulate: What Are the Questions? , 2014, Neuron.

[89]  Terrence J. Sejnowski,et al.  The Wilson–Cowan model, 36 years later , 2009, Biological Cybernetics.

[90]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[91]  John P. A. Ioannidis,et al.  What does research reproducibility mean? , 2016, Science Translational Medicine.

[92]  R. Goldstein Are theoretical results ‘Results’? , 2018, eLife.

[93]  J. Ruppersberg Ion Channels in Excitable Membranes , 1996 .

[94]  N. Swindale,et al.  Application of Kohonen's self–organizing feature map algorithm to cortical maps of orientation and direction preference , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[95]  M. Merzenich,et al.  Principles of neuroplasticity-based rehabilitation. , 2013, Progress in brain research.

[96]  Asohan Amarasingham,et al.  Ambiguity and nonidentifiability in the statistical analysis of neural codes , 2015, Proceedings of the National Academy of Sciences.

[97]  A. Redish,et al.  The Mind within the Brain: How We Make Decisions and How those Decisions Go Wrong , 2013 .

[98]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[99]  J. M. Smith,et al.  Optimality theory in evolutionary biology , 1990, Nature.

[100]  A. Redish,et al.  Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task , 2014, Nature Neuroscience.

[101]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[102]  Wulfram Gerstner,et al.  Theory and Simulation in Neuroscience , 2012, Science.

[103]  Giosuè Baggio,et al.  Theory Before the Test: How to Build High-Verisimilitude Explanatory Theories in Psychological Science , 2021, Perspectives on psychological science : a journal of the Association for Psychological Science.

[104]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[105]  David Kaiser,et al.  History: Shut up and calculate! , 2014, Nature.

[106]  Mark E. Anderson,et al.  Cardiac ion channels. , 2002, Annual review of physiology.

[107]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[108]  W. Bialek,et al.  Cooperativity, sensitivity, and noise in biochemical signaling. , 2005, Physical review letters.

[109]  Hasok Chang,et al.  The Persistence of Epistemic Objects Through Scientific Change , 2011 .

[110]  Bryan C. Daniels,et al.  Perspective: Sloppiness and emergent theories in physics, biology, and beyond. , 2015, The Journal of chemical physics.

[111]  N. Swindale,et al.  How different feature spaces may be represented in cortical maps , 2004, Network.

[112]  P. Smaldino Better methods can’t make up for mediocre theory , 2019, Nature.

[113]  William Bechtel,et al.  Discovering Complexity: Decomposition and Localization as Strategies in Scientific Research , 2010 .

[114]  David M. Kaplan,et al.  Explanation and description in computational neuroscience , 2011, Synthese.

[115]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[116]  A. Redish,et al.  Disrupting the medial prefrontal cortex alters hippocampal sequences during deliberative decision making. , 2019, Journal of neurophysiology.

[117]  Michael Gilead,et al.  Above and beyond the concrete: The diverse representational substrates of the predictive brain , 2019, Behavioral and Brain Sciences.

[118]  Stuart Firestein,et al.  Ignorance: How it drives science , 2012 .

[119]  J Anthony Movshon,et al.  Putting big data to good use in neuroscience , 2014, Nature Neuroscience.

[120]  Sean R. Bittner,et al.  Interrogating theoretical models of neural computation with deep inference , 2019, bioRxiv.

[121]  David E J Linden,et al.  Who's in charge? Free will and the science of the brain , 2014, Cognitive neuropsychiatry.

[122]  Surya Ganguli,et al.  A deep learning framework for neuroscience , 2019, Nature Neuroscience.

[123]  Asohan Amarasingham,et al.  Statistical Identification of Synchronous Spiking , 2013 .

[124]  John Creasey,et al.  The Blind Spot , 1940, Nature.

[125]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[126]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[127]  L. Colgin Five Decades of Hippocampal Place Cells and EEG Rhythms in Behaving Rats , 2019, The Journal of Neuroscience.

[128]  C. Craver Explaining the Brain: Mechanisms and the Mosaic Unity of Neuroscience , 2007 .

[129]  W. Rall Cable theory for dendritic neurons , 1989 .

[130]  Bruce L McNaughton,et al.  Attractor-map versus autoassociation based attractor dynamics in the hippocampal network. , 2010, Journal of neurophysiology.

[131]  A. Love,et al.  Characterizing scientific failure , 2019, EMBO reports.

[132]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[133]  Steven J. Cox,et al.  Mathematics for Neuroscientists , 2010 .

[134]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[135]  Romain Brette,et al.  Is coding a relevant metaphor for the brain? , 2017, bioRxiv.

[136]  Scott D. Brown,et al.  Different Ways of Linking Behavioral and Neural Data via Computational Cognitive Models. , 2016, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[137]  Sonja Grün,et al.  Computational Neuroscience: Mathematical and Statistical Perspectives. , 2018, Annual review of statistics and its application.

[138]  Brian M. Sweis,et al.  Sensitivity to “sunk costs” in mice, rats, and humans , 2018, Science.

[139]  P. Cummings,et al.  The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century , 2001 .

[140]  T. Insel,et al.  Toward the future of psychiatric diagnosis: the seven pillars of RDoC , 2013, BMC Medicine.

[141]  Michael S. Lewicki,et al.  Optimal retinal population coding predicts inhomogeneous light adaptation and contrast sensitivity across the visual field , 2014 .

[142]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[143]  B. Hille Ionic channels of excitable membranes , 2001 .

[144]  N. Lytkin,et al.  Causal graph-based analysis of genome-wide association data in rheumatoid arthritis , 2011, Biology Direct.

[145]  W Schultz,et al.  Deficits in reaction times and movement times as correlates of hypokinesia in monkeys with MPTP-induced striatal dopamine depletion. , 1989, Journal of neurophysiology.

[146]  K. Obermayer,et al.  Statistical-mechanical analysis of self-organization and pattern formation during the development of visual maps. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[147]  Daniele Fanelli,et al.  Is science really facing a reproducibility crisis, and do we need it to? , 2018 .

[148]  P. Mahadevan,et al.  An overview , 2007, Journal of Biosciences.

[149]  Michael Weisberg,et al.  Biology and Philosophy symposium on Simulation and Similarity: Using Models to Understand the World , 2013 .

[150]  Mark J. Stefik,et al.  Computation and cognition: Toward a foundation of cognitive science: Z.W. Pylyshyn, (MIT Press, Cambridge, MA, 1986); 292 pages, $33.75 (hardcover), $9.95 (paperback) , 1989 .

[151]  F. Rieke,et al.  Nonlinear Signal Transfer from Mouse Rods to Bipolar Cells and Implications for Visual Sensitivity , 2002, Neuron.

[152]  U. Alon An introduction to systems biology : design principles of biological circuits , 2019 .

[153]  S. Morrison,et al.  Central neural pathways for thermoregulation. , 2011, Frontiers in bioscience.

[154]  J. Fermaglich,et al.  The Case of the Frozen Addicts , 1996 .

[155]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[156]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[157]  P. Cisek Resynthesizing behavior through phylogenetic refinement , 2019, Attention, Perception, & Psychophysics.

[158]  A. Treves,et al.  Theta-paced flickering between place-cell maps in the hippocampus , 2011, Nature.

[159]  Stephen Jay Gould,et al.  Hen's Teeth and Horse's Toes , 1983 .

[160]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[161]  S. Ellner,et al.  Dynamic Models in Biology , 2006 .

[162]  K. Popper,et al.  The Logic of Scientific Discovery , 1960 .

[163]  Joshua C. Brumberg,et al.  A quantitative population model of whisker barrels: Re-examining the Wilson-Cowan equations , 1996, Journal of Computational Neuroscience.

[164]  W. Bechtel Philosophy of Science : An Overview for Cognitive Science , 1988 .

[165]  Ronald N. Giere,et al.  Progress and its problems: Toward a theory of scientific growth , 1978 .

[166]  Martin Mahner Science and Pseudoscience , 2013 .

[167]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[168]  J. Rinzel,et al.  NREM sleep in the rodent neocortex and hippocampus reflects excitable dynamics , 2019, Nature Communications.

[169]  David S. Greenberg,et al.  Training deep neural density estimators to identify mechanistic models of neural dynamics , 2019, bioRxiv.

[170]  A. Franklin Forging, cooking, trimming, and riding on the bandwagon , 1984 .

[171]  Z. Knight,et al.  Regulation of Body Temperature by the Nervous System , 2018, Neuron.

[172]  Erkan Ozge Buzbas,et al.  Scientific discovery in a model-centric framework: Reproducibility, innovation, and epistemic diversity , 2018, PloS one.

[173]  A. David Redish,et al.  Opinion: Reproducibility failures are essential to scientific inquiry , 2018, Proceedings of the National Academy of Sciences.

[174]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[175]  J. Pearl Causal inference in statistics: An overview , 2009 .

[176]  Erik Ostermann,et al.  The Structure Of Scientific Theories , 2016 .

[177]  Hasok Chang Scientific Progress: Beyond Foundationalism and Coherentism1 , 2007, Royal Institute of Philosophy Supplement.

[178]  N. Liberman,et al.  Construing counterfactual worlds: The role of abstraction , 2012 .

[179]  N. Wiener,et al.  The Role of Models in Science , 1945, Philosophy of Science.

[180]  Richard C. Gerkin,et al.  Collaborative infrastructure for test-driven scientific model validation , 2014, ICSE Companion.

[181]  Tomaso Poggio,et al.  From the Retina to the Neocortex: Selected Papers of David Marr , 2012 .