A phylogenetic, ontogenetic, and epigenetic view of bio-inspired hardware systems

If one considers life on Earth since its very beginning, three levels of organization can be distinguished: the phylogenetic level concerns the temporal evolution of the genetic programs within individuals and species, the ontogenetic level concerns the developmental process of a single multicellular organism, and the epigenetic level concerns the learning processes during an individual organism's lifetime. In analogy to nature, the space of bio-inspired hardware systems can be partitioned along these three axes-phylogeny, ontogeny and epigenesis (POE)-giving rise to the POE model. This paper is an exposition and examination of bio-inspired systems within the POE framework, with our goals being: (1) to present an overview of current-day research, (2) to demonstrate that the POE model can be used to classify bio-inspired systems, and (3) to identify possible directions for future research, derived from a POE outlook. We discuss each of the three axes separately, considering the systems created to date and plotting directions for continued progress along the axis in question.

[1]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[2]  E. F. Codd,et al.  Cellular automata , 1968 .

[3]  Arthur W. Burks,et al.  Essays on cellular automata , 1970 .

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  J. W. Atmar,et al.  Speculation on the evolution of intelligence and its possible realization in machine form. , 1976 .

[6]  A. Danchin.  A selective theory for the epigenetic specification of the monospecific antibody production in single cell lines. , 1976, Annales d'immunologie.

[7]  J. Changeux,et al.  Selective stabilisation of developing synapses as a mechanism for the specification of neuronal networks , 1976, Nature.

[8]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[9]  S. Wolfram.  Statistical mechanics of cellular automata , 1983 .

[10]  C. Langton.  Self-reproduction in cellular automata , 1984 .

[11]  T. Cavalier-smith.  The Evolution of genome size , 1985 .

[12]  G. Edelman.  Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[13]  Clive Richards,et al.  The Blind Watchmaker , 1987, Bristol Medico-Chirurgical Journal.

[14]  Richard Dawkins,et al.  The Evolution of Evolvability , 1987, ALIFE.

[15]  Tommaso Toffoli,et al.  Cellular Automata Machines , 1987, Complex Syst..

[16]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[17]  J. Buck.  Synchronous Rhythmic Flashing of Fireflies. II. , 1938, The Quarterly Review of Biology.

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[20]  L.D. Jackel,et al.  Analog electronic neural network circuits , 1989, IEEE Circuits and Devices Magazine.

[21]  M S Gazzaniga,et al.  Organization of the human brain. , 1989, Science.

[22]  Y. Suzuki,et al.  Digital systems for artificial neural networks , 1989, IEEE Circuits and Devices Magazine.

[23]  John Byl,et al.  Self-Reproduction in Small Cellular Au-tomata , 1989 .

[24]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[25]  J. D. Farmer,et al.  Artificial life: The coming evolution , 1990 .

[26]  A. I. Ethem Alpaydin.  Neural models of incremental supervised and unsupervised learning , 1990 .

[27]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[28]  Thomas S. Ray,et al.  An Approach to the Synthesis of Life , 1991 .

[29]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[30]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[31]  L. Cosmides,et al.  The Adapted mind : evolutionary psychology and the generation of culture , 1992 .

[32]  M. Ridley.  Triumph of the embryo? , 1992, Nature.

[33]  W. E. Blanz,et al.  GANGLION-a fast field-programmable gate array implementation of a connectionist classifier , 1992 .

[34]  Bernd Fritzke.  Growing Cell Structures – a Self-organizing Network in k Dimensions , 1992 .

[35]  J A Reggia,et al.  Simple Systems That Exhibit Self-Directed Replication , 1993, Science.

[36]  Hitoshi Iba,et al.  Evolving hardware with genetic learning: a first step towards building a Darwin machine , 1993 .

[37]  S H Strogatz,et al.  Coupled oscillators and biological synchronization. , 1993, Scientific American.

[38]  Hugo de Garis,et al.  EVOLVABLE HARDWARE Genetic Programming of a Darwin Machine , 1993 .

[39]  Ronald R. Yager,et al.  Fuzzy sets, neural networks, and soft computing , 1994 .

[40]  Moshe Sipper,et al.  Non-uniform cellular automata: Evolution in rule space and formation of complex structures , 1994 .

[41]  Brad Hutchings,et al.  FPGA-based stochastic neural networks-implementation , 1994, Proceedings of IEEE Workshop on FPGA's for Custom Computing Machines.

[42]  Jeffrey O. Kephart,et al.  A biologically inspired immune system for computers , 1994 .

[43]  S. Pinker,et al.  The Language Instinct: How the Mind Creates Language , 1994 .

[44]  Brad Hutchings,et al.  Density enhancement of a neural network using FPGAs and run-time reconfiguration , 1994, Proceedings of IEEE Workshop on FPGA's for Custom Computing Machines.

[45]  Bart L. M. Happel,et al.  Design and evolution of modular neural network architectures , 1994, Neural Networks.

[46]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[47]  Christian Piguet,et al.  Embryological development on silicon , 1994 .

[48]  Andrew Rushton.  VHDL for Logic Synthesis: An Introductory Guide for Achieving Design Requirements , 1995 .

[49]  J. M. Aróstegui.  Vlsi architectures for evolutive neural models , 1995 .

[50]  Gianluca Tempesti,et al.  A New Self-Reproducing Cellular Automaton Capable of Construction and Computation , 1995, ECAL.

[51]  Gianluca Tempesti,et al.  Embryonics: a new family of coarse-grained field-programmable gate array with self-repair and self-reproducing properties , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[52]  Russell W. Anderson.  Genetic Mechanisms Underlying the Baldwin Effect Are Evident in Natural Antibodies , 1995, Evolutionary Programming.

[53]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[54]  Luc Steels,et al.  A Self-Organizing Spatial Vocabulary , 1995, Artificial Life.

[55]  Annie S. Wu,et al.  Empirical Studies of the Genetic Algorithm with Noncoding Segments , 1995, Evolutionary Computation.

[56]  Eduardo Sanchez.  Field Programmable Gate Array (FPGA) Circuits , 1995, Towards Evolvable Hardware.

[57]  Spyros Xanthakis,et al.  Immune System and Fault-Tolerant Computing , 1995, Artificial Evolution.

[58]  Frédéric Gruau.  Artificial Cellular Development in Optimization and Compilation , 1995, Towards Evolvable Hardware.

[59]  S. Pinker.  The language instinct : how the mind creates language , 1995 .

[60]  R. Reynolds,et al.  Genetic Mechanisms Underlying the Baldwin Effect Are Evident in Natural Antibodies , 1995 .

[61]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[62]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[63]  R. Anderson,et al.  Learning and evolution: a quantitative genetics approach. , 1995, Journal of theoretical biology.

[64]  H. Iba,et al.  Evolvable Hardware and Its Applications to Pattern Recognition and Fault-Tolerant Systems , 1995, Towards Evolvable Hardware.

[65]  Inman Harvey,et al.  Unconstrained Evolution and Hard Consequences , 1995, Towards Evolvable Hardware.

[66]  Katsunori Shimohara,et al.  Development and Evolution of Hardware Behaviors , 1995, Towards Evolvable Hardware.

[67]  Hiroaki Kitano.  Morphogenesis for Evolvable Systems , 1995, Towards Evolvable Hardware.

[68]  Umberto Pesavento,et al.  An Implementation of von Neumann's Self-Reproducing Machine , 1995, Artificial Life.

[69]  Peter D. Turney.  Myths and Legends of the Baldwin Effect , 2002, ICML 2002.

[70]  Katsunobu Imai,et al.  Logical Universality and Self-Reproduction in Reversible Cellular Automata , 1996, ICES.

[71]  Marco Tomassini,et al.  Co-evolving Parallel Random Number Generators , 1996, PPSN.

[72]  John R. Koza,et al.  Automated WYWIWYG design of both the topology and component values of electrical circuits using genetic programming , 1996 .

[73]  Adrian Thompson,et al.  Silicon evolution , 1996 .

[74]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[75]  M. Sipper.  Co-evolving non-uniform cellular automata to perform computations , 1996 .

[76]  Marco Tomassini,et al.  Towards Evolvable Hardware , 1996, Lecture Notes in Computer Science.

[77]  Adrian Thompson,et al.  An Evolved Circuit, Intrinsic in Silicon, Entwined with Physics , 1996, ICES.

[78]  Hugo de Garis,et al.  Cam-Brain: ATR's Billion Neuron Artificial Brain Project - A Three Year Progress Report , 1996, International Conference on Evolutionary Computation.

[79]  John R. Koza.  Genetic programming : proceedings of the first annual conference, 1996 , 1996 .

[80]  M. Sipper,et al.  Generating Parallel Random Number Generators by Cellular Programming , 1996 .

[81]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[82]  K. Gallagher.  Darwin’s Dangerous Idea: Evolution and the Meanings of Life , 1996 .

[83]  Isamu Kajitani,et al.  Hardware Evolution at Function Level , 1996, PPSN.

[84]  C. Piguet,et al.  MICROTREE: Towards a Binary Decision Machine-based FPGA with Biological-like Properties , 1996 .

[85]  Hugo de Garis,et al.  CAM-Brain: A New Model for ATR's Cellular Automata Based Artificial Brain Project , 1996, ICES.

[86]  Marco Tomassini,et al.  Phylogeny, Ontogeny, and Epigenesis: Three Sources of Biological Inspiration for Softening Hardware , 1996, ICES.

[87]  Yoshiki Uchikawa,et al.  Immunoid: An Immunological Approach to Decentralized Behavoir Arbitration of Autonomous Mobile Robots , 1996, PPSN.

[88]  Xin Yao,et al.  Evolutionary design of artificial neural networks with different nodes , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[89]  Marco Tomassini,et al.  Online Autonomous Evolware , 1996, ICES.

[90]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[91]  E. Sanchez,et al.  Neural Network Structure Optimization through On-line Hardware Evolution , 1996 .

[92]  Moshe Sipper,et al.  Designing Evolware by Cellular Programming , 1996, ICES.

[93]  Moshe Sipper,et al.  Toward a viable, self-reproducing universal computer , 1996 .

[94]  Andrés Pérez-Uribe,et al.  FPGA Implementation of an Adaptable-Size Neural Network , 1996, ICANN.

[95]  Moshe Sipper,et al.  Evolution of Parallel Cellular Machines , 1997, Lecture Notes in Computer Science.

[96]  Moshe Sipper,et al.  Evolving Uniform and Non-Uniform Cellular Automata Networks , 1997 .

[97]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[98]  Moshe Sipper,et al.  Co-evolving architectures for cellular machines , 1997 .

[99]  Asim Roy,et al.  A neural-network learning theory and a polynomial time RBF algorithm , 1997, IEEE Trans. Neural Networks.

[100]  Moshe Sipper,et al.  Evolution of Parallel Cellular Machines: The Cellular Programming Approach , 1997 .

[101]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[102]  Gianluca Tempesti,et al.  Von Neumann revisited: A turing machine with self-repair and self-reproduction properties , 1997, Robotics Auton. Syst..

[103]  T. Sejnowski,et al.  Irresistible environment meets immovable neurons , 1997, Behavioral and Brain Sciences.

[104]  Mark H. Johnson.  The neural basis of cognitive development. , 1998 .

[105]  Gianluca Tempesti,et al.  Embryonics: a new methodology for designing field-programmable gate arrays with self-repair and self-replicating properties , 1998, IEEE Trans. Very Large Scale Integr. Syst..

[106]  Xin Yao,et al.  Promises and challenges of evolvable hardware , 1996, IEEE Trans. Syst. Man Cybern. Part C.