Selectionist and Evolutionary Approaches to Brain Function: A Critical Appraisal

We consider approaches to brain dynamics and function that have been claimed to be Darwinian. These include Edelman’s theory of neuronal group selection, Changeux’s theory of synaptic selection and selective stabilization of pre-representations, Seung’s Darwinian synapse, Loewenstein’s synaptic melioration, Adam’s selfish synapse, and Calvin’s replicating activity patterns. Except for the last two, the proposed mechanisms are selectionist but not truly Darwinian, because no replicators with information transfer to copies and hereditary variation can be identified in them. All of them fit, however, a generalized selectionist framework conforming to the picture of Price’s covariance formulation, which deliberately was not specific even to selection in biology, and therefore does not imply an algorithmic picture of biological evolution. Bayesian models and reinforcement learning are formally in agreement with selection dynamics. A classification of search algorithms is shown to include Darwinian replicators (evolutionary units with multiplication, heredity, and variability) as the most powerful mechanism for search in a sparsely occupied search space. Examples are given of cases where parallel competitive search with information transfer among the units is more efficient than search without information transfer between units. Finally, we review our recent attempts to construct and analyze simple models of true Darwinian evolutionary units in the brain in terms of connectivity and activity copying of neuronal groups. Although none of the proposed neuronal replicators include miraculous mechanisms, their identification remains a challenge but also a great promise.

[1]  D. Spalding The Principles of Psychology , 1873, Nature.

[2]  E. Conklin PROBLEMS OF BIOLOGY. , 1898, Science.

[3]  W. Brown Animal Intelligence: Experimental Studies , 1912, Nature.

[4]  A. Weiss A theoretical basis of human behavior , 1925 .

[5]  Paul V. West,et al.  A Theoretical Basis of Human Behavior. , 1929 .

[6]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[7]  Gary R Lichtenstein [Letter to the Editor] , 1996, Nature.

[8]  O. L. Z. Book Review: The Organization of Behaviour: A Neuropsychological Theory , 1950 .

[9]  Jack Larsen To Group or Not to Group , 1960 .

[10]  George R. Price,et al.  Selection and Covariance , 1970, Nature.

[11]  David G. Stork,et al.  Pattern Classification , 1973 .

[12]  J. Changeux,et al.  A theory of the epigenesis of neuronal networks by selective stabilization of synapses. , 1973, Proceedings of the National Academy of Sciences of the United States of America.

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  W. Hamilton Innate social aptitudes of man: an approach from evolutionary genetics , 1975 .

[15]  R. Lewontin ‘The Selfish Gene’ , 1977, Nature.

[16]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[17]  F. Crick,et al.  Selfish DNA: the ultimate parasite , 1980, Nature.

[18]  Jean-Pierre Changeux,et al.  Learning by Selection , 1984 .

[19]  J. Changeux Neuronal man : the biology of mind , 1985 .

[20]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[21]  S Dehaene,et al.  Neural networks that learn temporal sequences by selection. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[22]  I. L. Heisler,et al.  A Method for Analyzing Selection in Hierarchically Structured Populations , 1987, The American Naturalist.

[23]  W. Calvin The brain as a Darwin Machine , 1987, Nature.

[24]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[25]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[26]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[27]  I. L. Heisler,et al.  Alternative formulations of multilevel selection , 1988 .

[28]  R. Michod DARWINIAN SELECTION IN THE BRAIN , 1989 .

[29]  Stanislas Dehaene,et al.  Neuronal models of cognitive functions , 1989, Cognition.

[30]  J. M. Smith,et al.  Optimality theory in evolutionary biology , 1990, Nature.

[31]  J. Gastwirth Non-parametric Statistical Methods , 1990 .

[32]  John H. Holland,et al.  When will a Genetic Algorithm Outperform Hill Climbing , 1993, NIPS.

[33]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[34]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[35]  G. Price The nature of selection , 1995 .

[36]  F. Maytag Evolution , 1996, Arch. Mus. Informatics.

[37]  Phil Husbands,et al.  A Comparison of Search Techniques on a Wing-Box Optimisation Problem , 1996, PPSN.

[38]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[39]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[40]  Nick Jakobi,et al.  Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis , 1997, Adapt. Behav..

[41]  S Dehaene,et al.  A hierarchical neuronal network for planning behavior. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[42]  T. van Belle Is neural Darwinism Darwinism? , 1997, Artificial life.

[43]  P. Adams Hebb and Darwin. , 1998, Journal of theoretical biology.

[44]  Phil Husbands,et al.  Better Living Through Chemistry: Evolving GasNets for Robot Control , 1998, Connect. Sci..

[45]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[46]  Byoung-Tak Zhang A Bayesian framework for evolutionary computation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[47]  Kathryn B. Laskey,et al.  Learning Bayesian networks from incomplete data using evolutionary algorithms , 1999 .

[48]  E. Szathmáry The evolution of replicators. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[49]  Karl J. Friston,et al.  Attentional modulation of effective connectivity from V2 to V5/MT in humans. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[50]  John Maynard Smith,et al.  The Concept of Information in Biology , 2000, Philosophy of Science.

[51]  L. Nadel,et al.  Multiple trace theory of human memory: Computational, neuroimaging, and neuropsychological results , 2000, Hippocampus.

[52]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[53]  Karl J. Friston The labile brain. I. Neuronal transients and nonlinear coupling. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[54]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[55]  Ingo Wegener,et al.  On the utility of populations in evolutionary algorithms , 2001 .

[56]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[57]  Lionel Barnett,et al.  Netcrawling-optimal evolutionary search with neutral networks , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[58]  G. Edelman,et al.  Degeneracy and complexity in biological systems , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Andrew Philippides,et al.  Neuronal Plasticity and Temporal Adaptivity: GasNet Robot Control Networks , 2002, Adapt. Behav..

[60]  Phil Husbands,et al.  Fitness Landscapes and Evolvability , 2002, Evolutionary Computation.

[61]  R. Aunger The Electric Meme: A New Theory of How We Think , 2002 .

[62]  J. Launer Darwin's dangerous idea. , 2002, QJM : monthly journal of the Association of Physicians.

[63]  Malcolm J. A. Strens,et al.  Evolutionary MCMC Sampling and Optimization in Discrete Spaces , 2003, ICML.

[64]  R. C. Tees Review of The organization of behavior: A neuropsychological theory. , 2003 .

[65]  Hans-Georg Beyer,et al.  A Comparison of Evolution Strategies with Other Direct Search Methods in the Presence of Noise , 2003, Comput. Optim. Appl..

[66]  H. Seung,et al.  Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission , 2003, Neuron.

[67]  P. Husbands,et al.  Local evolvability of statistically neutral GasNet robot controllers. , 2003, Bio Systems.

[68]  Eugene M. Izhikevich,et al.  Relating STDP to BCM , 2003, Neural Computation.

[69]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[70]  O. Sporns,et al.  Motifs in Brain Networks , 2004, PLoS biology.

[71]  David M. Sobel,et al.  A theory of causal learning in children: causal maps and Bayes nets. , 2004, Psychological review.

[72]  M. Eigen Selforganization of matter and the evolution of biological macromolecules , 1971, Naturwissenschaften.

[73]  Thomas Jansen On the utility of populations , 2004 .

[74]  A. Gopnik,et al.  Mechanisms of theory formation in young children , 2004, Trends in Cognitive Sciences.

[75]  Adam Prügel-Bennett,et al.  When a genetic algorithm outperforms hill-climbing , 2004, Theor. Comput. Sci..

[76]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[77]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[78]  A. Wagner Robustness and Evolvability in Living Systems , 2005 .

[79]  Ngai Ming Kwok,et al.  Evolutionary particle filter: re-sampling from the genetic algorithm perspective , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[80]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[81]  Andy J. Keane,et al.  Computational Approaches for Aerospace Design: The Pursuit of Excellence , 2005 .

[82]  What Scientists Think , 2005 .

[83]  Andrew Philippides,et al.  Flexible Couplings: Diffusing Neuromodulators and Adaptive Robotics , 2005, Artificial Life.

[84]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[85]  Rob S. Markel,et al.  Abundance of correctly folded RNA motifs in sequence space, calculated on computational grids , 2005, Nucleic acids research.

[86]  P. Hall On non-parametric statistical methods , 2005 .

[87]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[88]  M. Feder Robustness and Evolvability in Living Systems. Princeton Studies in Complexity.By Andreas Wagner. Princeton (New Jersey): Princeton University Press. $49.50. xv + 367 p; ill.; index. ISBN: 0–691–12240–7. 2005. , 2006 .

[89]  M. Hasselmo The role of acetylcholine in learning and memory , 2006, Current Opinion in Neurobiology.

[90]  Nils J. Nilsson,et al.  The Physical Symbol System Hypothesis: Status and Prospects , 2006, 50 Years of Artificial Intelligence.

[91]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[92]  E. Szathmáry The origin of replicators and reproducers , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[93]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[94]  V. Torre,et al.  On the Dynamics of the Spontaneous Activity in Neuronal Networks , 2007, PloS one.

[95]  Colin R. Reeves,et al.  Evolutionary computation: a unified approach , 2007, Genetic Programming and Evolvable Machines.

[96]  Mark Harman,et al.  A theoretical & empirical analysis of evolutionary testing and hill climbing for structural test data generation , 2007, ISSTA '07.

[97]  Carlos Cotta,et al.  A Study on the Evolution of Bayesian Network Graph Structures , 2007 .

[98]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[99]  K. Obermayer,et al.  Cortical reorganization consistent with spike timing–but not correlation-dependent plasticity , 2007, Nature Neuroscience.

[100]  L. Nadel,et al.  Autobiographical Memory Retrieval and Hippocampal Activation as a Function of Repetition and the Passage of Time , 2007, Neural plasticity.

[101]  A. Gardner The Price equation , 2008, Current Biology.

[102]  Chrisantha Fernando,et al.  The Evolution of Evolvability in Gene Transcription Networks , 2008, ALIFE.

[103]  Patrick Forber Evolution and the Levels of Selection , 2008 .

[104]  Chrisantha Fernando,et al.  Copying and Evolution of Neuronal Topology , 2008, PloS one.

[105]  Merav Parter,et al.  Facilitated Variation: How Evolution Learns from Past Environments To Generalize to New Environments , 2008, PLoS Comput. Biol..

[106]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[107]  X. Chen,et al.  Evolutionary origins and directed evolution of RNA. , 2009, The international journal of biochemistry & cell biology.

[108]  Wolfgang Maass,et al.  STDP enables spiking neurons to detect hidden causes of their inputs , 2009, NIPS.

[109]  John Yearwood,et al.  A stochastic version of Expectation Maximization algorithm for better estimation of Hidden Markov Model , 2009, Pattern Recognit. Lett..

[110]  E. Szathmáry,et al.  A New Replicator: A theoretical framework for analysing replication , 2010, BMC Biology.

[111]  F. Wörgötter,et al.  Activity-dependent structural plasticity , 2009, Brain Research Reviews.

[112]  Frank C. Hoppensteadt,et al.  Polychronous Wavefront Computations , 2009, Int. J. Bifurc. Chaos.

[113]  Marc Harper,et al.  The Replicator Equation as an Inference Dynamic , 2009, ArXiv.

[114]  C. Shalizi Dynamics of Bayesian Updating with Dependent Data and Misspecified Models , 2009, 0901.1342.

[115]  Chrisantha Fernando,et al.  Chemical, Neuronal, and Linguistic Replicators , 2009 .

[116]  J. Isaac,et al.  Hippocampal Place Cell Firing Patterns Can Induce Long-Term Synaptic Plasticity In Vitro , 2009, The Journal of Neuroscience.

[117]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[118]  D. Buonomano,et al.  Neural dynamics of in vitro cortical networks reflects experienced temporal patterns , 2010, Nature Neuroscience.

[119]  Andrew Philippides,et al.  Spatial, temporal, and modulatory factors affecting GasNet evolvability in a visually guided robotics task , 2010, Complex..

[120]  R. Knight,et al.  Nucleotides that are essential but not conserved; a sufficient L-tryptophan site in RNA. , 2010, RNA.

[121]  J. Mellor,et al.  Frontiers in Synaptic Neuroscience Synaptic Neuroscience Stdp in the Hippocampus: the Data the Activity Requirements for Spike Timing-dependent Plasticity in the Hippocampus , 2022 .

[122]  M. Flajnik,et al.  Origin and evolution of the adaptive immune system: genetic events and selective pressures , 2010, Nature Reviews Genetics.

[123]  Andrew Philippides,et al.  Spike-Timing Dependent Plasticity and the Cognitive Map , 2010, Front. Comput. Neurosci..

[124]  H. Heller,et al.  Principles of Life , 2010 .

[125]  Eörs Szathmáry,et al.  Natural Selection in the Brain , 2010 .

[126]  Adam N Sanborn,et al.  Rational approximations to rational models: alternative algorithms for category learning. , 2010, Psychological review.

[127]  Yonatan Loewenstein,et al.  Synaptic Theory of Replicator-Like Melioration , 2010, Front. Comput. Neurosci..

[128]  Eörs Szathmáry,et al.  The Neuronal Replicator Hypothesis , 2010, Neural Computation.

[129]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[130]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[131]  E. Szathmáry To Group or Not to Group? , 2011, Science.

[132]  Chrisantha Fernando,et al.  Co-evolution of lexical and syntactic classifiers during a language game , 2011, Evol. Intell..

[133]  J. A. Marshall Group selection and kin selection: formally equivalent approaches. , 2011, Trends in ecology & evolution.

[134]  Chrisantha Fernando,et al.  Symbol manipulation and rule learning in spiking neuronal networks. , 2011, Journal of theoretical biology.

[135]  S. Manrubia,et al.  Motif frequency and evolutionary search times in RNA populations. , 2011, Journal of theoretical biology.

[136]  Ruben C. Arslan Evolutionary Genetics , 2014 .