Life-like agents: internalizing local cues for reinforcement learning and evolution

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii

[1]  Nathan H. Schumaker,et al.  Using Landscape Indices to Predict Habitat Connectivity , 1996 .

[2]  William B. Frakes,et al.  Stemming Algorithms , 1992, Information Retrieval: Data Structures & Algorithms.

[3]  Oren Etzioni,et al.  Dynamic Reference Sifting: A Case Study in the Homepage Domain , 1997, Comput. Networks.

[4]  Amy M. Steier.  Statistical semantics of phrases in hierarchical contexts , 1994 .

[5]  William E. Hart,et al.  Optimization with genetic algorithm hybrids that use local searches , 1996 .

[6]  Daniela Rus,et al.  Digital Digital Transportable Information Agents Transportable Information Agents , 1996 .

[7]  Maja J. Matarić,et al.  Designing emergent behaviors: from local interactions to collective intelligence , 1993 .

[8]  Walter Fontana,et al.  Evolution of a metabolism , 1992 .

[9]  John Michael Neal McInerney,et al.  Biologically influenced algorithms and parallelism in non-linear optimization , 1992 .

[10]  H. Levesque,et al.  Generating Hard Satis ability Problems ? , 1995 .

[11]  Frédéric Gruau,et al.  The cellular development of neural networks: the interaction of learning and evolution , 1993 .

[12]  Huberman,et al.  Strong regularities in world wide web surfing , 1998, Science.

[13]  J. Roughgarden.  Density‐Dependent Natural Selection , 1971 .

[14]  Otto E. Rössler,et al.  Design for Autonomous Chemical Growth under Different Environmental Constraints , 1972 .

[15]  Michael L. Littman,et al.  Simulations combining evolution and learning , 1996 .

[16]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[17]  Holly A. Yanco,et al.  Environmental Effects on Minimal Behaviors in the Minimat World , 1996, Adapt. Behav..

[18]  David S. Johnson,et al.  Local Optimization and the Traveling Salesman Problem , 1990, ICALP.

[19]  Richard K. Belew,et al.  Exporting phrases: a statistical analysis of topical language , 1991 .

[20]  G. Parker,et al.  Competition for resources , 1991 .

[21]  Marko Balabanovic,et al.  An adaptive Web page recommendation service , 1997, AGENTS '97.

[22]  C. Krebs.  Ecology: The Experimental Analysis of Distribution and Abundance , 1973 .

[23]  Ian Horswill,et al.  Analysis of Adaptation and Environment , 1995, Artif. Intell..

[24]  J. Baldwin.  A New Factor in Evolution , 1896, The American Naturalist.

[25]  Filippo Menczer,et al.  An Endogenous Fitness Paradigm for Adaptive Information Agents , 1994 .

[26]  Donna K. Harman,et al.  Relevance Feedback and Other Query Modification Techniques , 1992, Information retrieval (Boston).

[27]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[28]  K. Laland,et al.  ON THE EVOLUTIONARY CONSEQUENCES OF SEXUAL IMPRINTING , 1994, Evolution; international journal of organic evolution.

[29]  Filippo Menczer,et al.  Latent Energy Environments: A tool for artificial life simulations , 1993 .

[30]  William Noble Grundy,et al.  Modeling the Evolution of Motivation , 1996, Evolutionary Computation.

[31]  Terry Jones,et al.  Fitness Distance Correlation as a Measure of Problem Difficulty for Genetic Algorithms , 1995, ICGA.

[32]  T. Joachims.  WebWatcher : A Tour Guide for the World Wide Web , 1997 .

[33]  Stewart W. Wilson.  The animat path to AI , 1991 .

[34]  O. Miglino,et al.  Evolutionary stable and unstable strategies in neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[35]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[36]  Filippo Menczer,et al.  ARACHNID: Adaptive Retrieval Agents Choosing Heuristic Neighborhoods for Information Discovery , 1997, ICML 1997.

[37]  Kenneth A. De Jong,et al.  On Decentralizing Selection Algorithms , 1995, ICGA.

[38]  Kenneth A. De Jong,et al.  Generation Gaps Revisited , 1992, FOGA.

[39]  I. G. BONNER CLAPPISON.  Editor , 1960, The Electric Power Engineering Handbook - Five Volume Set.

[40]  Filippo Menczer,et al.  Adaptive information agents in distributed textual environments , 1998, AGENTS '98.

[41]  Chanathip Namprempre,et al.  HyPursuit: a hierarchical network search engine that exploits content-link hypertext clustering , 1996, HYPERTEXT '96.

[42]  Karen Spärck Jones.  Experiments in relevance weighting of search terms , 1979, Inf. Process. Manag..

[43]  Ellen Spertus,et al.  ParaSite: Mining Structural Information on the Web , 1997, Comput. Networks.

[44]  William G. Macready,et al.  Tailoring Mutation to Landscape Properties , 1998, Evolutionary Programming.

[45]  B A Huberman,et al.  Evolutionary games and computer simulations. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[46]  P. Husbands,et al.  Analysis of Evolved Sensory-motor Controllers Analysis of Evolved Sensory-motor Controllers , 1992 .

[47]  Hugh M. Cartwright,et al.  Looking Around: Using Clues from the Data Space to Guide Genetic Algorithm Searches , 1991, ICGA.

[48]  J. Holland.  Echoing emergence: objectives, rough definitions, and speculations for ECHO-class models , 1999 .

[49]  O. Rössler,et al.  Adequate Locomotion Strategies for an Abstract Organism in an Abstract Environment — A Relational Approach to Brain Function , 1974 .

[50]  Randall D. Beer,et al.  A Dynamical Systems Perspective on Agent-Environment Interaction , 1995, Artif. Intell..

[51]  Filippo Menczer,et al.  Artificial Life Applied to Adaptive Information Agents , 1995 .

[52]  David D. Lewis,et al.  Challenges in machine learning for text classification , 1996, COLT '96.

[53]  Jiming Liu,et al.  Reactive agents for adaptive image analysis , 1998, AGENTS '98.

[54]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[55]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[56]  Peter M. Todd,et al.  On the Sympatric Origin of Species: Mercurial Mating in the Quicksilver Model , 1991, ICGA.

[57]  P. Anandan,et al.  Pattern-recognizing stochastic learning automata , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[58]  Reinier Post,et al.  Information Retrieval in the World-Wide Web: Making Client-Based Searching Feasible , 1994, Comput. Networks ISDN Syst..

[59]  Peter Kareiva,et al.  Special Feature: Space: The Final Frontier for Ecological Theory , 1994 .

[60]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[61]  Filippo Menczer,et al.  Local Selection , 1998, Evolutionary Programming.

[62]  Stewart W. Wilson,et al.  Environment structure and adaptive behavior from the ground up , 1993 .

[63]  Garrison W. Cottrell,et al.  Predicting the performance of linearly combined IR systems , 1998, SIGIR '98.

[64]  W. Hart.  Adaptive global optimization with local search , 1994 .

[65]  Leslie Pack Kaelbling,et al.  Learning in embedded systems , 1993 .

[66]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[67]  Larry J. Eshelman,et al.  Preventing Premature Convergence in Genetic Algorithms by Preventing Incest , 1991, ICGA.

[68]  Samir W. Mahfoud.  A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[69]  S. Wright.  Physiological Genetics, Ecology of Populations, and Natural Selection , 2015, Perspectives in biology and medicine.

[70]  Aviv Bergman,et al.  Adaptive computation in ecology and evolution: a guide for future research , 1996 .

[71]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[72]  M. Gilpin.  Group selection in predator-prey communities. , 1975, Monographs in population biology.

[73]  Martin Zwick,et al.  Effect of Environmental Structure on Evolutionary Adaptation , 1998 .

[74]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[75]  W. S. Cooper.  Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems , 1968 .

[76]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[77]  R. Levins.  Evolution in Changing Environments , 1968 .

[78]  Nicholas Gessler.  Growing Artificial Societies—Social Science from the Bottom Up. , 1997, Artificial Life.

[79]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[80]  David Lewis,et al.  Active by Accident: Relevance Feedback in Information Retrieval , 1995 .

[81]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[82]  Stewart W. Wilson,et al.  The blind breeding the blind: adaptive behavior without looking , 1994 .

[83]  Filippo Menczer,et al.  From Complex Environments to Complex Behaviors , 1996, Adapt. Behav..

[84]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[85]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning with Multilayer Neural Networks , 1991, ICGA.

[86]  Michael J. Pazzani,et al.  Syskill & Webert: Identifying Interesting Web Sites , 1996, AAAI/IAAI, Vol. 1.

[87]  Peter Dayan,et al.  Improving Generalization for Temporal Difference Learning: The Successor Representation , 1993, Neural Computation.

[88]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[89]  Paul Bryant Grosso,et al.  Computer Simulations of Genetic Adaptation: Parallel Subcomponent Interaction in a Multilocus Model , 1985 .

[90]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[91]  Katia P. Sycara,et al.  WebMate: a personal agent for browsing and searching , 1998, AGENTS '98.

[92]  Stanley J. Rosenschein,et al.  A dynamical systems perspective on agent-environment interaction , 1996 .

[93]  Henry Lieberman,et al.  Autonomous interface agents , 1997, CHI.

[94]  Martin Zwick,et al.  Dependence of Adaptability on Environmental Structure in a Simple Evolutionary Model , 1996, Adapt. Behav..

[95]  Richard K. Belew,et al.  Using Genetic Algorithms with Local Search for Thin Film Metrology , 1997, ICGA.

[96]  R. Belew.  Interposing an ontogenic model between Genetic Algorithms and Neural Networks , 1992 .

[97]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[98]  C. Lee Giles,et al.  CiteSeer: an autonomous Web agent for automatic retrieval and identification of interesting publications , 1998, AGENTS '98.

[99]  Melanie Mitchell,et al.  Genetic algorithms and artificial life , 1994 .

[100]  C.H. Papadimitriou,et al.  On selecting a satisfying truth assignment , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[101]  Mihalis Yannakakis,et al.  Searching a Fixed Graph , 1996, ICALP.

[102]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[103]  Piotr Indyk,et al.  Enhanced hypertext categorization using hyperlinks , 1998, SIGMOD '98.

[104]  C. Waddington.  Canalization of Development and the Inheritance of Acquired Characters , 1942, Nature.

[105]  Ben Shneiderman,et al.  Navigating in hyperspace: designing a structure-based toolbox , 1994, CACM.

[106]  Filippo Menczer,et al.  A model for the emergence of sex in evolving networks: Adaptive advantage or random drift? In F , 1992 .

[107]  Peter B. Danzig,et al.  Scalable Internet resource discovery: research problems and approaches , 1994, CACM.

[108]  Alberto O. Mendelzon,et al.  Applications of a Web Query Language , 1997, Comput. Networks.

[109]  David H. Ackley,et al.  Adaptation in Constant Utility Non-Stationary Environments , 1991, ICGA.

[110]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[111]  Filippo Menczer.  Changing Latent Energy Environments: A Case for the Evolution of Plasticity , 1994 .

[112]  Ray R. Larson,et al.  Bibliometrics of the World Wide Web: An Exploratory Analysis of the Intellectual Structure of Cyberspace , 1996 .

[113]  J. Haldane,et al.  Physiological Genetics , 1938, Nature.

[114]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[115]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[116]  R H Macarthur,et al.  SOME GENERALIZED THEOREMS OF NATURAL SELECTION. , 1962, Proceedings of the National Academy of Sciences of the United States of America.

[117]  William E. Hart,et al.  A Comparison of Global and Local Search Methods in Drug Docking , 1997, ICGA.

[118]  William E. Hart,et al.  The Role of Development in Genetic Algorithms , 1994, FOGA.

[119]  Yuval Davidor,et al.  A Naturally Occurring Niche and Species Phenomenon: The Model and First Results , 1991, ICGA.

[120]  Domenico Parisi,et al.  Recombination and unsupervised learning: effects of crossover in the genetic optimization of neural networks , 1992 .

[121]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[122]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[123]  David Lewis,et al.  Information Retrieval and the Statistics of Large Data Sets , 1996 .

[124]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[125]  Gerard Salton,et al.  The "generality" effect and the retrieval evaluation for large collections , 1972, J. Am. Soc. Inf. Sci..

[126]  Thorsten Joachims,et al.  WebWatcher : A Learning Apprentice for the World Wide Web , 1995 .

[127]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[128]  Melanie Mitchell,et al.  Genetic Algorithms and Artiicial Life , 1993 .

[129]  David H. Ackley,et al.  Generalization and Scaling in Reinforcement Learning , 1989, NIPS.

[130]  Giles,et al.  Searching the world wide Web , 1998, Science.

[131]  Peter Norvig,et al.  A modern, agent-oriented approach to introductory artificial intelligence , 1995, SGAR.

[132]  Giorgos Zacharia,et al.  Evolving a multi-agent information filtering solution in Amalthaea , 1997, AGENTS '97.

[133]  B. Huberman,et al.  Surfing as a real option , 1998, ICE '98.

[134]  L. Darrell Whitley,et al.  Serial and Parallel Genetic Algorithms as Function Optimizers , 1993, ICGA.

[135]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[136]  Doina Precup,et al.  Exponentiated Gradient Methods for Reinforcement Learning , 1997, ICML.

[137]  Stefano Nolfi,et al.  How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics , 1994 .

[138]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[139]  Filippo Menczer,et al.  Latent energy environments , 1996 .

[140]  Filippo Menczer,et al.  EVOLVING SENSORS IN ENVIRONMENTS OF CONTROLLED COMPLEXITY , 1994 .

[141]  Jon M. Kleinberg,et al.  Automatic Resource Compilation by Analyzing Hyperlink Structure and Associated Text , 1998, Comput. Networks.

[142]  Christopher J. Fox,et al.  Lexical Analysis and Stoplists , 1992, Information Retrieval: Data Structures & Algorithms.

[143]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[144]  Filippo Menczer,et al.  Maturation and the Evolution of Imitative Learning in Artificial Organisms , 1995, Adapt. Behav..

[145]  Marcus W. Feldman,et al.  A model of individual adaptive behavior in a fluctuating environment , 1996 .

[146]  D. Hartl,et al.  Principles of population genetics , 1981 .

[147]  C. M. Lessells,et al.  The Evolution of Life Histories , 1994 .

[148]  S. Levin,et al.  Mathematical and Computational Challenges in Population Biology and Ecosystems Science , 1997, Science.

[149]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[150]  N. Littlestone,et al.  Learning in the presence of finitely or infinitely many irrelevant attributes , 1991, COLT '91.