Information theoretic models of social interaction

This dissertation demonstrates, in a non-semantic information-theoretic framework, how the principles of “maximisation of relevant information” and “information parsimony” can guide the adaptation of an agent towards agent-agent interaction. Central to this thesis is the concept of digested information; I argue that an agent is intrinsically motivated to a.) process the relevant information in its environment and b.) display this information in its own actions. From the perspective of similar agents, who require similar information, this differentiates other agents from the rest of the environment, by virtue of the information they provide. This provides an informational incentive to observe other agents and integrate their information into one’s own decision making process. This process is formalized in the framework of information theory, which allows for a quantitative treatment of the resulting effects, specifically how the digested information of an agent is influenced by several factors, such as the agent’s performance and the integrated information of other agents. Two specific phenomena based on information maximisation arise in this thesis. One is flocking behaviour similar to boids that results when agents are searching for a location in a girdworld and integrated the information in other agent’s actions via Bayes’ Theorem. The other is an effect where integrating information from too many agents becomes detrimental to an agent’s performance, for which several explanations are provided.

[1]  R. Axelrod,et al.  The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration , 1998 .

[2]  Daniel Polani,et al.  Information Flows in Causal Networks , 2008, Adv. Complex Syst..

[3]  Iain D. Couzin,et al.  Self‐Organization in Biological Systems.Princeton Studies in Complexity. ByScott Camazine,, Jean‐Louis Deneubourg,, Nigel R Franks,, James Sneyd,, Guy Theraulaz, and, Eric Bonabeau; original line drawings by, William Ristineand, Mary Ellen Didion; StarLogo programming by, William Thies. Princeton (N , 2002 .

[4]  D. Hand,et al.  Idiot's Bayes—Not So Stupid After All? , 2001 .

[5]  S. Laughlin Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[6]  C. Darwin The Origin of Species by Means of Natural Selection, Or, The Preservation of Favoured Races in the Struggle for Life , 1859 .

[7]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[8]  X. Rosalind Wang,et al.  Measuring information storage and transfer in swarms , 2011, ECAL.

[9]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[10]  Chrystopher L. Nehaniv,et al.  All Else Being Equal Be Empowered , 2005, ECAL.

[11]  James H. Moor,et al.  Knowledge and the Flow of Information. , 1982 .

[12]  Eun-Youn Kim,et al.  Understanding representational sensitivity in the iterated prisoner's dilemma with fingerprints , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  A. Rapoport,et al.  Prisoner's Dilemma: A Study in Conflict and Co-operation , 1970 .

[14]  R. Lewontin ‘The Selfish Gene’ , 1977, Nature.

[15]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[16]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[17]  Ralf Der,et al.  Predictive information and explorative behavior of autonomous robots , 2008 .

[18]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[19]  Hiroki Sayama,et al.  Seeking open-ended evolution in Swarm Chemistry , 2011, 2011 IEEE Symposium on Artificial Life (ALIFE).

[20]  P. Ward,et al.  THE IMPORTANCE OF CERTAIN ASSEMBLAGES OF BIRDS AS “INFORMATION‐CENTRES” FOR FOOD‐FINDING , 2008 .

[21]  Massimo Vergassola,et al.  ‘Infotaxis’ as a strategy for searching without gradients , 2007, Nature.

[22]  Chrystopher L. Nehaniv,et al.  Empowerment: a universal agent-centric measure of control , 2005, 2005 IEEE Congress on Evolutionary Computation.

[23]  Moshe Sipper,et al.  An Introduction To Articial Life , 1995 .

[24]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[25]  Touchette,et al.  Information-theoretic limits of control , 1999, Physical review letters.

[26]  A. Banerjee,et al.  A Simple Model of Herd Behavior , 1992 .

[27]  Christoph Salge,et al.  Relevant Information as a formalised approach to evaluate game mechanics , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[28]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[29]  Philippe Capdepuy,et al.  Constructing the Basic Umwelt of Artificial Agents: An Information-Theoretic Approach , 2007, ECAL.

[30]  Albert Y. Zomaya,et al.  Emergence of Glider-like Structures in a Modular Robotic System , 2008, ALIFE.

[31]  W. C. Allee Animal aggregations, a study in general sociology. / by W. C. Allee. , 1931 .

[32]  W. Jeffery Adaptive evolution of eye degeneration in the Mexican blind cavefish. , 2005, The Journal of heredity.

[33]  Luis Mateus Rocha,et al.  Introduction to the Special Issue: Embodied and Situated Cognition , 2005, Artificial Life.

[34]  Christoph Salge,et al.  Approximation of Empowerment in the continuous Domain , 2013, Adv. Complex Syst..

[35]  Peter Stone,et al.  Empowerment for continuous agent—environment systems , 2011, Adapt. Behav..

[36]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[37]  Daniel Polani,et al.  Stigmergic gene transfer and emergence of universal coding , 2009, HFSP journal.

[38]  M. Carpenter,et al.  Three sources of information in social learning , 2002 .

[39]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[40]  Aaron Lynch Thought contagion : how belief spreads through society , 1996 .

[41]  Wolfgang Spohn,et al.  Bayesian Nets Are All There Is To Causal Dependence , 2001 .

[42]  E. Danchin,et al.  Inadvertent social information in foraging bumblebees: effects of flower distribution and implications for pollination , 2008, Animal Behaviour.

[43]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[44]  Albert Y. Zomaya,et al.  Detecting Non-trivial Computation in Complex Dynamics , 2007, ECAL.

[45]  Chrystopher L. Nehaniv,et al.  Representations of Space and Time in the Maximization of Information Flow in the Perception-Action Loop , 2007, Neural Computation.

[46]  W. C. Allee Animal Aggregations: A Study in General Sociology , 1931 .

[47]  Philippe Capdepuy,et al.  Perception–action loops of multiple agents: informational aspects and the impact of coordination , 2011, Theory in Biosciences.

[48]  Chrystopher L. Nehaniv,et al.  Sensory channel grouping and structure from uninterpreted sensor data , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[49]  J. P. Reilly Representations of Space and Time, by Donna J. Peuquet , 2002 .

[50]  Daniel Polani,et al.  Information: Currency of life? , 2009, HFSP journal.

[51]  Philippe Capdepuy,et al.  Informational principles of perception-action loops and collective behaviours , 2011 .

[52]  Chrystopher L. Nehaniv,et al.  What do You Want to do Today? - Relevant-Information Bookkeeping in Goal-Oriented Behaviour , 2010, ALIFE.

[53]  Ralf Der,et al.  Homeokinesis - A new principle to back up evolution with learning , 1999 .

[54]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[55]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[56]  Mikhail Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[57]  Christoph Salge,et al.  A Bivariate Measure of Redundant Information , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  Chrystopher L. Nehaniv,et al.  From unknown sensors and actuators to actions grounded in sensorimotor perceptions , 2006, Connect. Sci..

[59]  Chrystopher L. Nehaniv,et al.  Tracking Information Flow through the Environment: Simple Cases of Stigmerg , 2004 .

[60]  Amélie N. Dreiss,et al.  Do great tits rely on inadvertent social information from blue tits? A habitat selection experiment , 2008, Behavioral Ecology and Sociobiology.

[61]  Luciano Floridi,et al.  What is the Philosophy of Information , 2002 .

[62]  I. Couzin,et al.  Consensus decision making in human crowds , 2008, Animal Behaviour.

[63]  Seth Lloyd,et al.  Information-theoretic approach to the study of control systems , 2001, physics/0104007.

[64]  Christoph Salge,et al.  Information-Driven Organization of Visual Receptive Fields , 2009, Adv. Complex Syst..

[65]  Donna J. Peuquet,et al.  Representations of space and time , 2002 .

[66]  D. Stephens Learning and Behavioral Ecology: Incomplete Information and Environmental Predictability , 1993 .

[67]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[68]  Paul Marsden Thought Contagion: How Belief Spreads through Society by Aaron Lynch , 1999, J. Artif. Soc. Soc. Simul..

[69]  Mikhail Prokopenko,et al.  Guided self-organization. , 2009 .

[70]  Thomas Martinetz,et al.  An Information-Theoretic Approach for the Quantification of Relevance , 2001, ECAL.

[71]  Ilan Lobel,et al.  BAYESIAN LEARNING IN SOCIAL NETWORKS , 2008 .

[72]  P. Lissaman,et al.  Formation Flight of Birds , 1970, Science.

[73]  Jesper Juul,et al.  The game, the player, the world: looking for a heart of gameness , 2010, DiGRA Conference.

[74]  Philippe Capdepuy,et al.  Maximization of Potential Information Flow as a Universal Utility for Collective Behaviour , 2007, 2007 IEEE Symposium on Artificial Life.

[75]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[76]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[77]  J. Uexküll Umwelt und Innenwelt der Tiere , 1921 .

[78]  LAURANCE R. DOYLE,et al.  Quantitative tools for comparing animal communication systems: information theory applied to bottlenose dolphin whistle repertoires , 1999, Animal Behaviour.

[79]  Chrystopher L. Nehaniv,et al.  Relevant information in optimized persistence vs. progeny strategies , 2006 .

[80]  E. David,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World , 2010 .

[81]  J. Neumann Zur Theorie der Gesellschaftsspiele , 1928 .

[82]  Xin Yao,et al.  Co-Evolution in Iterated Prisoner's Dilemma with Intermediate Levels of Cooperation: Application to Missile Defense , 2002, Int. J. Comput. Intell. Appl..

[83]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[84]  T. Valone,et al.  Public Information: From Nosy Neighbors to Cultural Evolution , 2004, Science.

[85]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[86]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[87]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[88]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[89]  B. Edmonds Three Challenges for the Survival of Memetics , 2009 .

[90]  Randall D. Beer,et al.  Nonnegative Decomposition of Multivariate Information , 2010, ArXiv.

[91]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[92]  Marina Basu The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[93]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[94]  A. U.S.,et al.  Predictability , Complexity , and Learning , 2002 .

[95]  Douglas Gale,et al.  Bayesian learning in social networks , 2003, Games Econ. Behav..

[96]  M R DeWeese,et al.  How to measure the information gained from one symbol. , 1999, Network.

[97]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[98]  Albert Y. Zomaya,et al.  A framework for the local information dynamics of distributed computation in complex systems , 2008, ArXiv.

[99]  W. Ashby,et al.  An Introduction to Cybernetics , 1957 .

[100]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .