Phylogeny, Ontogeny, and Epigenesis: Three Sources of Biological Inspiration for Softening Hardware

Living beings are complex systems exhibiting a range of desirable qualifications that have eluded realization by traditional engineering methodologies. In recent years we are witness to a growing interest in Nature exhibited by engineers, wishing to imitate the observed processes, thereby creating powerful problem-solving methodologies. If one considers Life on earth since its very beginning, three levels of organization can be distinguished: the phylogenetic level concerns the temporal evolution of the genetic programs within individuals and species, the ontogenetic level concerns the developmental process of a single multicellular organism, and the epigenetic level concerns the learning processes during an individual organism's lifetime. In analogy to Nature, the space of bioinspired systems can be partitioned along these three axes, phylogeny, ontogeny, and epigenesis, giving rise to the POE model. This paper is an exposition and examination of bio-inspired systems within the POE framework. We first discuss each of the three axes separately, considering the systems created to date and plotting directions for continued progress along the axis in question. We end our exposition by a discussion of possible research directions, involving the construction of bio-inspired systems that are situated along two, and ultimately all three axes. This presents a vision for the future which will see the advent of novel systems, inspired by the powerful examples provided by Nature.

[1]  Gianluca Tempesti,et al.  A New Self-Reproducing Cellular Automaton Capable of Construction and Computation , 1995, ECAL.

[2]  Marco Tomassini,et al.  Towards Evolvable Hardware: The Evolutionary Engineering Approach , 1996 .

[3]  Gianluca Tempesti,et al.  Von Neumann revisited: A turing machine with self-repair and self-reproduction properties , 1997, Robotics Auton. Syst..

[4]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[5]  A. Danchin A selective theory for the epigenetic specification of the monospecific antibody production in single cell lines. , 1976, Annales d'immunologie.

[6]  J. M. Aróstegui Vlsi architectures for evolutive neural models , 1995 .

[7]  Thomas S. Ray,et al.  An Approach to the Synthesis of Life , 1991 .

[8]  G. Edelman Neural Darwinism: The Theory Of Neuronal Group Selection , 1989 .

[9]  Marco Tomassini,et al.  Evolutionary Algorithms , 1995, Towards Evolvable Hardware.

[10]  C. Langton Self-reproduction in cellular automata , 1984 .

[11]  Arthur W. Burks,et al.  Essays on cellular automata , 1970 .

[12]  Marco Tomassini,et al.  Online Autonomous Evolware , 1996, ICES.

[13]  M S Gazzaniga,et al.  Organization of the human brain. , 1989, Science.

[14]  Xin Yao,et al.  Evolutionary design of artificial neural networks with different nodes , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[15]  J. D. Farmer,et al.  Artificial life: The coming evolution , 1990 .

[16]  R. Dawkins The Blind Watchmaker , 1986 .

[17]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[18]  Hitoshi Iba,et al.  Evolvable Hardware and Its Applications to Pattern Recognition and Fault-Tolerant Systems , 1995, Towards Evolvable Hardware.

[19]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[20]  E. Sanchez,et al.  Neural Network Structure Optimization through On-line Hardware Evolution , 1996 .

[21]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[22]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[23]  L.D. Jackel,et al.  Analog electronic neural network circuits , 1989, IEEE Circuits and Devices Magazine.

[24]  Bart L. M. Happel,et al.  Design and evolution of modular neural network architectures , 1994, Neural Networks.

[25]  Asim Roy,et al.  A neural-network learning theory and a polynomial time RBF algorithm , 1997, IEEE Trans. Neural Networks.

[26]  Hugo de Garis,et al.  EVOLVABLE HARDWARE Genetic Programming of a Darwin Machine , 1993 .

[27]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[28]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[29]  Marco Tomassini,et al.  Towards Evolvable Hardware , 1996, Lecture Notes in Computer Science.

[30]  Spyros Xanthakis,et al.  Immune System and Fault-Tolerant Computing , 1995, Artificial Evolution.

[31]  Marco Tomassini,et al.  a Survey of Genetic Algorithms , 1995 .

[32]  John R. Koza,et al.  Automated WYWIWYG design of both the topology and component values of electrical circuits using genetic programming , 1996 .

[33]  Hugo de Garis,et al.  CAM-Brain: A New Model for ATR's Cellular Automata Based Artificial Brain Project , 1996, ICES.

[34]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[35]  Lewis Wolpert,et al.  The Triumph of Embryo , 1991 .

[36]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[37]  Hiroaki Kitano Morphogenesis for Evolvable Systems , 1995, Towards Evolvable Hardware.

[38]  J. Changeux,et al.  Selective stabilisation of developing synapses as a mechanism for the specification of neuronal networks , 1976, Nature.

[39]  E. F. Codd,et al.  Cellular automata , 1968 .

[40]  Katsunori Shimohara,et al.  Development and Evolution of Hardware Behaviors , 1995, Towards Evolvable Hardware.

[41]  Y. Suzuki,et al.  Digital systems for artificial neural networks , 1989, IEEE Circuits and Devices Magazine.

[42]  Gianluca Tempesti,et al.  Embryonics: a new methodology for designing field-programmable gate arrays with self-repair and self-replicating properties , 1998, IEEE Trans. Very Large Scale Integr. Syst..

[43]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[44]  Adrian Thompson,et al.  Silicon evolution , 1996 .

[45]  Katsunori Shimohara,et al.  Hardware Evolution System Introducing Dominant and Recessive Heredity , 1996, ICES.

[46]  Edwin Roger Banks Universality in Cellular Automata , 1970, SWAT.

[47]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[48]  Gianluca Tempesti,et al.  Embryonics: a new family of coarse-grained field-programmable gate array with self-repair and self-reproducing properties , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[49]  Marco Tomassini,et al.  Co-evolving Parallel Random Number Generators , 1996, PPSN.

[50]  Inman Harvey,et al.  Unconstrained Evolution and Hard Consequences , 1995, Towards Evolvable Hardware.

[51]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[52]  Marco Tomassini,et al.  Generating Parallel Random Number Generators By Cellular Programming , 1996 .

[53]  T. Sejnowski,et al.  Irresistible environment meets immovable neurons , 1997, Behavioral and Brain Sciences.

[54]  John Byl,et al.  Self-Reproduction in Small Cellular Au-tomata , 1989 .

[55]  Katsunobu Imai,et al.  Logical Universality and Self-Reproduction in Reversible Cellular Automata , 1996, ICES.

[56]  Andrés Pérez-Uribe,et al.  FPGA Implementation of an Adaptable-Size Neural Network , 1996, ICANN.

[57]  J A Reggia,et al.  Simple Systems That Exhibit Self-Directed Replication , 1993, Science.

[58]  Moshe Sipper,et al.  Toward a viable, self-reproducing universal computer , 1996 .

[59]  Hugo de Garis,et al.  Cam-Brain: ATR's Billion Neuron Artificial Brain Project - A Three Year Progress Report , 1996, International Conference on Evolutionary Computation.

[60]  Jeffrey O. Kephart,et al.  A biologically inspired immune system for computers , 1994 .

[61]  J. Schwartz,et al.  Theory of Self-Reproducing Automata , 1967 .

[62]  Christian Piguet,et al.  Embryological development on silicon , 1994 .

[63]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[64]  Ronald R. Yager,et al.  Fuzzy sets, neural networks, and soft computing , 1994 .

[65]  Eduardo Sanchez Field Programmable Gate Array (FPGA) Circuits , 1995, Towards Evolvable Hardware.