Structural Drift: The Population Dynamics of Sequential Learning

We introduce a theory of sequential causal inference in which learners in a chain estimate a structural model from their upstream “teacher” and then pass samples from the model to their downstream “student”. It extends the population dynamics of genetic drift, recasting Kimura's selectively neutral theory as a special case of a generalized drift process using structured populations with memory. We examine the diffusion and fixation properties of several drift processes and propose applications to learning, inference, and evolution. We also demonstrate how the organization of drift process space controls fidelity, facilitates innovations, and leads to information loss in sequential learning with and without memory.

[1]  K. Holsinger,et al.  Genetics in geographically structured populations: defining, estimating and interpreting FST , 2009, Nature Reviews Genetics.

[2]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[3]  F. Arnold,et al.  Protein stability promotes evolvability. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[4]  C. Barata,et al.  Micro-evolution due to pollution: possible consequences for ecosystem responses to toxic stress. , 2007, Chemosphere.

[5]  Sandeep Krishna,et al.  Graph Theory and the Evolution of Autocatalytic Networks , 2002, nlin/0210070.

[6]  J. Gillespie.  Genetic drift in an infinite population. The pseudohitchhiking model. , 2000, Genetics.

[7]  Jeffrey H. Schwartz,et al.  Do Molecular Clocks Run at All? A Critique of Molecular Systematics , 2006 .

[8]  James P. Crutchfield,et al.  Computational mechanics of cellular automata: an example , 1997 .

[9]  J. Crutchfield,et al.  Discovering planar disorder in close-packed structures from x-ray diffraction: Beyond the fault model , 2002, cond-mat/0203290.

[10]  Carl S. McTague,et al.  The organization of intrinsic computation: complexity-entropy diagrams and the diversity of natural information processing. , 2008, Chaos.

[11]  R. Lenski,et al.  Punctuated Evolution Caused by Selection of Rare Beneficial Mutations , 1996, Science.

[12]  G. Zipf.  The Psycho-Biology Of Language: AN INTRODUCTION TO DYNAMIC PHILOLOGY , 1999 .

[13]  Martin A Nowak,et al.  Language dynamics in finite populations. , 2003, Journal of theoretical biology.

[14]  Donald T. Campbell,et al.  Systematic Error on the Part of Human Links in Communication Systems , 1958, Inf. Control..

[15]  R. A. Fisher,et al.  The Genetical Theory of Natural Selection , 1931 .

[16]  Kristina Lisa Shalizi,et al.  Pattern Discovery in Time Series, Part I: Theory, Algorithm, Analysis, and Convergence , 2002 .

[17]  James P. Crutchfield,et al.  Statistical Dynamics of the Royal Road Genetic Algorithm , 1999, Theor. Comput. Sci..

[18]  C. U. M. Smith.  Send reinforcements we're going to advance , 1988 .

[19]  Nick Chater,et al.  Language Acquisition Meets Language Evolution , 2010, Cogn. Sci..

[20]  David R. Anderson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[21]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[22]  Thomas Merritt,et al.  Genetic structure and phenotypic plasticity of yellow perch (Perca flavescens) populations influenced by habitat, predation, and contamination gradients. , 2008, Integrated environmental assessment and management.

[23]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[24]  Elizabeth C. Theil,et al.  Epochal Evolution Shapes the Phylodynamics of Interpandemic Influenza A (H3N2) in Humans , 2006, Science.

[25]  T. Ohta,et al.  The Average Number of Generations until Fixation of a Mutant Gene in a Finite Population. , 1969, Genetics.

[26]  James P. Crutchfield,et al.  Computation at the Onset of Chaos , 1991 .

[27]  Ulrike Schmidt,et al.  Significant genetic differentiation between Poland and Germany follows present-day political borders, as revealed by Y-chromosome analysis , 2005, Human Genetics.

[28]  Lahomtoires d'Electronique.  AN INFORMATIONAL THEORY OF THE STATISTICAL STRUCTURE OF LANGUAGE 36 , 2010 .

[29]  C. A. Clarke,et al.  Experiments in Plant Hybridisation , 1965 .

[30]  L. Pauling,et al.  Molecular disease. , 1959, The American journal of orthopsychiatry.

[31]  H. Akaike.  A new look at the statistical model identification , 1974 .

[32]  Simon Kirby,et al.  Innateness and culture in the evolution of language , 2006, Proceedings of the National Academy of Sciences.

[33]  J. P. Crutchfield,et al.  From finite to infinite range order via annealing: the causal architecture of deformation faulting in annealed close-packed crystals , 2004 .

[34]  James P. Crutchfield,et al.  Computational Mechanics: Pattern and Prediction, Structure and Simplicity , 1999, ArXiv.

[35]  S. Wright,et al.  Evolution in Mendelian Populations. , 1931, Genetics.

[36]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[37]  Alpan Raval,et al.  Molecular clock on a neutral network. , 2007, Physical review letters.

[38]  Les Gasser,et al.  The Iterated Classification Game: A New Model of the Cultural Transmission of Language , 2009, Adapt. Behav..

[39]  S. Leibler,et al.  Individual histories and selection in heterogeneous populations , 2010, Proceedings of the National Academy of Sciences.

[40]  Melanie Mitchell,et al.  Evolving cellular automata to perform computations: mechanisms and impediments , 1994 .

[41]  S. Gould,et al.  Punctuated equilibria: the tempo and mode of evolution reconsidered , 1977, Paleobiology.

[42]  Simon Kirby,et al.  Iterated Learning: A Framework for the Emergence of Language , 2003, Artificial Life.

[43]  E. C. Pielou.  The use of information theory in the study of the diversity of biological populations , 1967 .

[44]  J. Crutchfield,et al.  Regularities unseen, randomness observed: levels of entropy convergence. , 2001, Chaos.

[45]  Thomas G. Dietterich.  Machine Learning for Sequential Data: A Review , 2002, SSPR/SPR.

[46]  Young,et al.  Inferring statistical complexity. , 1989, Physical review letters.

[47]  F. J. Odling-Smee,et al.  Niche Construction: The Neglected Process in Evolution , 2003 .

[48]  M. Kimura,et al.  Average time until fixation of a mutant allele in a finite population under continued mutation pressure: Studies by analytical, numerical, and pseudo-sampling methods. , 1980, Proceedings of the National Academy of Sciences of the United States of America.

[49]  D. Parkinson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[50]  James P. Crutchfield,et al.  Evolutionary dynamics : exploring the interplay of selection, accident, neutrality, and function , 2003 .

[51]  Gilbert Hermann,et al.  Current Status of the Molecular Clock Hypothesis , 2003 .

[52]  M. Kimura.  The Neutral Theory of Molecular Evolution: Introduction , 1983 .

[53]  Stephan Lewandowsky,et al.  Theoretical and empirical evidence for the impact of inductive biases on cultural evolution , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  M. Huynen,et al.  Neutral evolution of mutational robustness. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[55]  Ricard V Solé,et al.  Diversity, competition, extinction: the ecophysics of language change , 2010, Journal of The Royal Society Interface.

[56]  Michelle Lowry,et al.  IPO Market Cycles: Bubbles or Sequential Learning? , 2000 .

[57]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[58]  George A. Miller,et al.  Length-Frequency Statistics for Written English , 1958, Inf. Control..

[59]  T. Jukes,et al.  The neutral theory of molecular evolution. , 2000, Genetics.

[60]  James P. Crutchfield,et al.  Enumerating Finitary Processes , 2010, ArXiv.

[61]  M. Kimura.  Evolutionary Rate at the Molecular Level , 1968, Nature.