Exploiting development to enhance the scalability of hardware evolution

Evolutionary algorithms do not scale well to the large, complex circuit design problems typical of the real world. Although techniques based on traditional design decomposition have been proposed to enhance hardware evolution's scalability, they often rely on traditional domain knowledge that may not be appropriate for evolutionary search and might limit evolution's opportunity to innovate. It has been proposed that reliance on such knowledge can be avoided by introducing a model of biological development to the evolutionary algorithm, but this approach has not yet achieved its potential. Prior demonstrations of how development can enhance scalability used toy problems that are not indicative of evolving hardware. Prior attempts to apply development to hardware evolution have rarely been successful and have never explored its effect on scalability in detail. This thesis demonstrates that development can enhance scalability in hardware evolution, primarily through a statistical comparison of hardware evolution's performance with and without development using circuit design problems of various sizes. This is reinforced by proposing and demonstrating three key mechanisms that development uses to enhance scalability: the creation of modules, the reuse of modules, and the discovery of design abstractions. The thesis includes several minor contributions: hardware is evolved using a common reconfigurable architecture at a lower level of abstraction than reported elsewhere. It is shown that this can allow evolution to exploit the architecture more efficiently and perhaps search more effectively. Also the benefits of several features of developmental models are explored through the biases they impose on the evolutionary search. Features that are explored include the type of environmental context development uses and the constraints on symmetry and information transmission they impose, genetic operators that may improve the robustness of gene networks, and how development is mapped to hardware. Also performance is compared against contemporary developmental models.

[1]  Ricardo Tanscheit,et al.  Towards Evolvable Analog Fuzzy Logic Controllers , 2002, Evolvable Hardware.

[2]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem , 1999, GECCO.

[3]  Richard K. Belew,et al.  Evolving Aesthetic Sorting Networks Using Developmental Grammars , 1993, ICGA.

[4]  C. Condit,et al.  The Misunderstood Gene , 2002, Heredity.

[5]  E. Lewis,et al.  The 1991 Albert Lasker Medical Awards. Clusters of master control genes regulate the development of higher organisms. , 1992, JAMA.

[6]  M. Kimura,et al.  The neutral theory of molecular evolution. , 1983, Scientific American.

[7]  Julian F. Miller,et al.  Evolving Digital Electronic Circuits for Real-Valued Function Generation using a Genetic Algorithm , 2007 .

[8]  Adrian Thompson,et al.  Silicon evolution , 1996 .

[9]  J. Elman,et al.  GENE REGULATION AND BIOLOGICAL DEVELOPMENT IN NEURAL NETWORKS : AN EXPLORATORY MODEL , 1995 .

[10]  Eshel Ben-Jacob,et al.  Evolvable hardware: genetic search in a physical realm , 2003 .

[11]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[12]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[13]  Israel Koren.  Computer arithmetic algorithms , 1993 .

[14]  Chrystopher L. Nehaniv,et al.  Evolving Embodied Genetic Regulatory Network-Driven Control Systems , 2003, ECAL.

[15]  Vu Duong,et al.  Experimental results in evolutionary fault-recovery for field programmable analog devices , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[16]  Marley M. B. R. Vellasco,et al.  Evolvable Systems in Hardware Design: Taxonomy, Survey and Applications , 1996, ICES.

[17]  Richard A. Fortey.  Life: A Natural History of the First Four Billion Years of Life on Earth , 1997 .

[18]  Gianluca Tempesti,et al.  Embryonics: a new family of coarse-grained field-programmable gate array with self-repair and self-reproducing properties , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[19]  Bernard Widrow,et al.  The basic ideas in neural networks , 1994, CACM.

[20]  Hitoshi Iba,et al.  Evolvable Hardware and Its Applications to Pattern Recognition and Fault-Tolerant Systems , 1995, Towards Evolvable Hardware.

[21]  Lukás Sekanina,et al.  Evolving Constructors for Infinitely Growing Sorting Networks and Medians , 2004, SOFSEM.

[22]  Yuji Kasai,et al.  An AI-calibrated IF filter: a yield enhancement method with area and power dissipation reductions , 2003 .

[23]  Donald E. Knuth,et al.  The Art of Computer Programming: Volume 3: Sorting and Searching , 1998 .

[24]  Ken Hayworth.  The "Modeling Clay" Approach to Bio-inspired Electronic Hardware , 1998, ICES.

[25]  Gianluca Tempesti,et al.  A Dynamic Routing Algorithm for a Bio-inspired Reconfigurable Circuit , 2003, FPL.

[26]  Prabhas Chongstitvatana,et al.  Synthesis of Synchronous Sequential Logic Circuits from Partial Input/Output Sequences , 1998, ICES.

[27]  Christof Teuscher,et al.  The BioWall: an electronic tissue for prototyping bio-inspired systems , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[28]  Peter J. Bentley,et al.  The ABCs of evolutionary design: investigating the evolvability of embryogenies for morphogenesis , 1999 .

[29]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[30]  Stewart W. Wilson,et al.  Cell Interactions as a Control Tool of Developmental Processes for Evolutionary Robotics , 1996 .

[31]  Andrew M. Tyrrell,et al.  An embryonic array with improved efficiency and fault tolerance , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[32]  Daniel Roggen,et al.  Multi-cellular Development: Is There Scalability and Robustness to Gain? , 2004, PPSN.

[33]  Xin Yao,et al.  Evolving modular neural networks which generalise well , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[34]  Isamu Kajitani,et al.  Variable length chromosome GA for evolvable hardware , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[35]  Peter Eggenberger.  Cell Interactions as a Control Tool of Developmental Processes for Evolutionary Robotics , 1996 .

[36]  Edward Ramsden,et al.  The ispPAC family of reconfigurable analog circuits , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[37]  Paul J. Layzell,et al.  Explorations in design space: unconventional electronics design through artificial evolution , 1999, IEEE Trans. Evol. Comput..

[38]  Per Kristian Lehre,et al.  Evolved digital circuits and genome complexity , 2005, 2005 NASA/DoD Conference on Evolvable Hardware (EH'05).

[39]  Rolf Drechsler,et al.  A multi-layer detailed routing approach based on evolutionary algorithms , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[40]  Tetsuya Higuchi,et al.  ATM Cell Scheduling by Function Level Evolvable Hardware , 1996, ICES.

[41]  Hiroaki Kitano.  A simple model of neurogenesis and cell differentiation based on evolutionary large-scale chaos , 1995 .

[42]  Adrian Stoica,et al.  An Evolvable Hardware Platform Based on DSP and FPTA , 2002, GECCO Late Breaking Papers.

[43]  Axel W. Krings,et al.  The test vector problem and limitations to evolving digital circuits , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[44]  Nicholas J. Macias,et al.  Self-assembling circuits with autonomous fault handling , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[45]  Julian Francis Miller,et al.  Evolution in materio: looking beyond the silicon box , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[46]  Paul J. Layzell,et al.  A New Research Tool for Intrinsic Hardware Evolution , 1998, ICES.

[47]  Lewis Wolpert,et al.  Principles of Development , 1997 .

[48]  Hugo de Garis,et al.  The second NASA/DoD workshop on evolvable hardware , 2001, IEEE Trans. Evol. Comput..

[49]  Gunnar Tufte,et al.  Evolving an adaptive digital filter , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[50]  Hiroshi Yokoi,et al.  A Gate-Level EHW Chip: Implementing GA Operations and Reconfigurable Hardware on a Single LSI , 1998, ICES.

[51]  Peter J. Bentley,et al.  Bias and scalability in evolutionary development , 2005, GECCO '05.

[52]  Adrian Stoica,et al.  Mixtrinsic Evolution , 2000, ICES.

[53]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[54]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[55]  Andrew M. Tyrrell,et al.  Evolutionary strategies and intrinsic fault tolerance , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[56]  Andrew M. Tyrrell,et al.  Reliability analysis in self-repairing embryonic systems , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[57]  Jim Torresen.  A Dynamic Fitness Function Applied to Improve the Generalisation when Evolving a Signal Processing Hardware Architecture , 2002, EvoWorkshops.

[58]  Dario Floreano,et al.  A Morphogenetic Evolutionary System: Phylogenesis of the POEtic Circuit , 2003, ICES.

[59]  Marie desJardins,et al.  Evaluation and selection of biases in machine learning , 1995, Machine Learning.

[60]  J. Miller,et al.  An Intrinsic Robust Transient Fault-Tolerant Developmental Model for Digital Systems , 2004 .

[61]  Jason D. Lohn,et al.  Automated Analog Circuit Sythesis Using a Linear Representation , 1998, ICES.

[62]  Lukás Sekanina,et al.  Towards evolvable IP cores for FPGAs , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[63]  Peter J. Bentley,et al.  Development brings scalability to hardware evolution , 2005, 2005 NASA/DoD Conference on Evolvable Hardware (EH'05).

[64]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[65]  Andrew M. Tyrrell,et al.  A Hardware Implementation of an Embryonic Architecture Using Virtex FPGAs , 2000, ICES.

[66]  D. Federici.  Using Embryonic Stages to increase the evolvability of development , 2004 .

[67]  Tughrul Arslan,et al.  The evolutionary design and synthesis of non-linear digital VLSI systems , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[68]  Inman Harvey,et al.  Through the Labyrinth Evolution Finds a Way: A Silicon Ridge , 1996, ICES.

[69]  Sanjeev Kumar,et al.  Investigating computational models of development for the construction of shape and form , 2004 .

[70]  Riccardo Poli,et al.  Why “Building Blocks” Don’t Work on Parity Problems , 1998 .

[71]  Julian F. Miller,et al.  Evolving Digital Logic Circuits on Xilinx 6000 Family FPGAs , 1998 .

[72]  Peter J. Bentley,et al.  Biologically Inspired Evolutionary Development , 2003, ICES.

[73]  Dario Floreano,et al.  Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[74]  Jason D. Lohn,et al.  A comparison of dynamic fitness schedules for evolutionary design of amplifiers , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[75]  Moshe Sipper,et al.  Toward self-repairing and self-replicating hardware: the Embryonics approach , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[76]  Freda Kemp,et al.  The Handbook of Parametric and Nonparametric Statistical Procedures , 2003 .

[77]  Charles T. Johnson-Bey,et al.  Overview of field programmable analog arrays as enabling technology for evolvable hardware for high reliability systems , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[78]  Adrian Thompson,et al.  Evolutionary techniques for fault tolerance , 1996 .

[79]  M. I. Ferguson,et al.  Intrinsic hardware evolution for the design and reconfiguration of analog speed controllers for a DC Motor , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[80]  Tom Lenaerts,et al.  Lineage and Induction in the Development of Evolved Genotypes for Non-uniform 2D CAs , 2002, Australian Joint Conference on Artificial Intelligence.

[81]  Julian Francis Miller,et al.  Cartesian genetic programming , 2000, GECCO '10.

[82]  Dario Floreano,et al.  POEtic Tissue: An Integrated Architecture for Bio-inspired Hardware , 2003, ICES.

[83]  T.G.W. Gordon,et al.  Exploring models of development for evolutionary circuit design , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[84]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[85]  S. Kauffman.  Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[86]  Andy M. Tyrrell,et al.  Evolutionary algorithm for the promotion of evolvable hardware , 2004 .

[87]  Johannes Schemmel,et al.  A CMOS FPTA chip for intrinsic hardware evolution of analog electronic circuits , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[88]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[89]  Jim Tørresen,et al.  Implementing evolution of FIR-filters efficiently in an FPGA , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[90]  P. Hogeweg.  Shapes in the Shadow: Evolutionary Dynamics of Morphogenesis , 1999, Artificial Life.

[91]  Derek S. Linden,et al.  A system for evolving antennas in-situ , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[92]  Stuart J. Flockton,et al.  A system for intrinsic evolution of linear and non-linear filters , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[93]  Inman Harvey,et al.  Unconstrained Evolution and Hard Consequences , 1995, Towards Evolvable Hardware.

[94]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[95]  Julian Francis Miller,et al.  On the nature of two-bit multiplier landscapes , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[96]  F. Dellaert.  TOWARD A BIOLOGICALLY DEFENSIBLE MODEL OF DEVELOPMENT , 1995 .

[97]  E. Stomeo,et al.  Improving EHW performance introducing a new decomposition strategy , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[98]  Gregory Hornby,et al.  Generative Representations for Evolving Families of Designs , 2003, GECCO.

[99]  T. Arslan,et al.  A novel genetic algorithm for the automated design of performance driven digital circuits , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[100]  Dirk Thierens,et al.  Scalability Problems of Simple Genetic Algorithms , 1999, Evolutionary Computation.

[101]  John R. Koza,et al.  The importance of reuse and development in evolvable hardware , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[102]  Steven A. Guccione,et al.  GeneticFPGA: evolving stable circuits on mainstream FPGA devices , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[103]  Masaya Iwata,et al.  A Lossless Compression Method for Halftone Images Using Evolvable Hardware , 2001, ICES.

[104]  Adrian Stoica,et al.  On Polymorphic Circuits and Their Design Using Evolutionary Algorithms , 2002 .

[105]  Lukáš Sekanina,et al.  EVOLUTION OF DIGITAL CIRCUITS OPERATING AS IMAGE FILTERS IN DYNAMICALLY CHANGING ENVIRONMENT , 2002 .

[106]  John C. Gallagher,et al.  The once and future analog alternative: evolvable hardware and analog computation , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[107]  W. Langdon,et al.  Smooth uniform crossover, sub-machine code GP and demes: a recipe for solving high-order Boolean parity problems , 1999 .

[108]  John R. Koza,et al.  Genetic Programming IV: Routine Human-Competitive Machine Intelligence , 2003 .

[109]  Pinaki Mazumder,et al.  A Neural Network Design for Circuit Partitioning , 1989, 26th ACM/IEEE Design Automation Conference.

[110]  Tom Lenaerts,et al.  Developmental Effects on Tuneable Fitness Landscapes , 2003, ICES.

[111]  Katsunori Shimohara,et al.  Development and Evolution of Hardware Behaviors , 1995, Towards Evolvable Hardware.

[112]  Jim Tørresen,et al.  A Scalable Approach to Evolvable Hardware , 2002, Genetic Programming and Evolvable Machines.

[113]  Jan Eriksson,et al.  Spiking Neural Networks for Reconfigurable POEtic Tissue , 2003, ICES.

[114]  Adrian Thompson,et al.  Notes on design through artificial evolution: Opportunities and algorithms , 2002 .

[115]  Shekhar Borkar,et al.  Obeying Moore's law beyond 0.18 micron [microprocessor design] , 2000, Proceedings of 13th Annual IEEE International ASIC/SOC Conference (Cat. No.00TH8541).

[116]  Adrian Thompson,et al.  Evolving Electronic Robot Controller that Exploit Hardware Resources , 1995, ECAL.

[117]  Julian Francis Miller,et al.  Aspects of Digital Evolution: Geometry and Learning , 1998, ICES.

[118]  N. Jakobi.  21 – Harnessing morphogenesis , 2003 .

[119]  M. Murakawa,et al.  A post-silicon clock timing adjustment using genetic algorithms , 2003, 2003 Symposium on VLSI Circuits. Digest of Technical Papers (IEEE Cat. No.03CH37408).

[120]  Moshe Sipper,et al.  Evolution of Parallel Cellular Machines: The Cellular Programming Approach , 1997 .

[121]  Andy M. Tyrrell,et al.  Evolved fault tolerance in evolvable hardware , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[122]  A. B. Kahng.  Design for yield needed for further scaling , 2004 .

[123]  Marley M. B. R. Vellasco,et al.  Repair of analog circuits: extrinsic and intrinsic evolutionary techniques , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[124]  Gregory S. Hornby,et al.  The advantages of generative grammatical encodings for physical design , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[125]  R. Beer,et al.  20 – A developmental model for the evolution of complete autonomous agents , 2003 .

[126]  Adrian Thompson,et al.  On the Automatic Design of Robust Electronics Through Artificial Evolution , 1998, ICES.

[127]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[128]  Lukás Sekanina,et al.  Easily testable image operators: the class of circuits where evolution beats engineers , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[129]  Raoul Tawel,et al.  Evolutionary experiments with a fine-grained reconfigurable architecture for analog and digital CMOS circuits , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[130]  Peter J. Bentley.  Evolving Fractal Proteins , 2003, ICES.

[131]  A. P. Shanthi,et al.  Enhancing the development based evolution of digital circuits , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[132]  Julian Francis Miller,et al.  Aspects of Digital Evolution: Evolvability and Architecture , 1998, PPSN.

[133]  Y. Qi,et al.  Insufficiency of piecewise evolution , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[134]  Jim Tørresen.  Evolving both Hardware Subsystems and the Selection of Variants of such into an Assembled System , 2002, ESM.

[135]  Madeline A. Crosby,et al.  FlyBase: genes and gene models , 2004, Nucleic Acids Res..

[136]  Tom Lenaerts,et al.  The robustness of small developed SBlock circuits using different clocking schemes , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[137]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[138]  James P. Crutchfield,et al.  Revisiting the Edge of Chaos: Evolving Cellular Automata to Perform Computations , 1993, Complex Syst..

[139]  Alvin J. Surkan,et al.  Evolution of quantum computer algorithms from reversible operators , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[140]  P. Eggenberger,et al.  An evolutionary approach to pattern formation mechanisms on lepidopteran wings , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[141]  Marc Ebner,et al.  Evolvable Hardware , 2004, Künstliche Intell..

[142]  Gregory S. Hornby,et al.  Generative representations for evolutionary design automation , 2003 .

[143]  Jan Eriksson,et al.  Hardware optimization and serial implementation of a novel spiking neuron model for the POEtic tissue. , 2004, Bio Systems.

[144]  Paul J. Layzell,et al.  Analysis of unconventional evolved electronics , 1999, CACM.

[145]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[146]  Julian F. Miller.  Chapter 18 – The Genetic Algorithm as a Discovery Engine: Strange Circuits and New Principles , 2002 .

[147]  Julian Francis Miller,et al.  A Developmental Method for Growing Graphs and Circuits , 2003, ICES.

[148]  Heng Liu,et al.  A Biological Development Model for the Design of Robust Multiplier , 2005, EvoWorkshops.

[149]  Chandana Paul,et al.  Investigating Morphological Symmetry and Locomotive Efficiency using Virtual Embodied Evolution , 2000 .

[150]  Abraham Lempel,et al.  On the Complexity of Finite Sequences , 1976, IEEE Trans. Inf. Theory.

[151]  Marco Tomassini,et al.  The firefly machine: online evolware , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[152]  John R. Koza,et al.  Reuse, Parameterized Reuse, and Hierarchical Reuse of Substructures in Evolving Electrical Circuits Using Genetic Programming , 1996, ICES.

[153]  Adrian Thompson.  Evolving fault tolerant systems , 1995 .

[154]  Julian Francis Miller,et al.  Finding Needles in Haystacks Is Not Hard with Neutrality , 2002, EuroGP.

[155]  Ronald F. DeMara,et al.  A Genetic Representation for Evolutionary Fault Recovery in Virtex FPGAs , 2003, ICES.

[156]  Julian Francis Miller,et al.  Principles in the Evolutionary Design of Digital Circuits—Part II , 2000, Genetic Programming and Evolvable Machines.

[157]  P. E. Hotz.  Exploring regenerative mechanisms found in flatworms by artificial evolutionary techniques using genetic regulatory networks , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[158]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[159]  Mehrdad Salami,et al.  Evolvable hardware at function level , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[160]  Carl Sechen,et al.  VLSI Placement and Global Routing Using Simulated Annealing , 1988 .

[161]  Mehrdad Salami,et al.  On-line compression of high precision printer images by evolvable hardware , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[162]  Jim Tørresen,et al.  A Divide-and-Conquer Approach to Evolvable Hardware , 1998, ICES.

[163]  Arantxa Etxeverria.  The Origins of Order , 1993 .

[164]  Masaya Iwata,et al.  Analogue EHW Chip for Intermediate Frequency Filters , 1998, ICES.

[165]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[166]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[167]  Kyusik Chung,et al.  Evolutionary Approach to Quantum and Reversible Circuits Synthesis , 2003, Artificial Intelligence Review.

[168]  C. Waddington.  Canalization of Development and the Inheritance of Acquired Characters , 1942, Nature.

[169]  Isamu Kajitani,et al.  Hardware Evolution at Function Level , 1996, PPSN.

[170]  Paul J. Layzell,et al.  Understanding Inherent Qualities of Evolved Circuits: Evolutionary History as a Predictor of Fault Tolerance , 2000, ICES.

[171]  K. Kaneko,et al.  Cell division, differentiation and dynamic clustering , 1993, adap-org/9311001.

[172]  Larry A. Rendell,et al.  Similarity‐based learning and its extensions , 1987, Comput. Intell..

[173]  Josh Bongard,et al.  Evolving modular genetic regulatory networks , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[174]  Sverre Vigander.  Evolutionary Fault Repair of Electronics in Space Applications , 2001 .

[175]  Ernesto Damiani,et al.  Dynamic Optimisation of Non-linear Feed Forward Circuits , 2000, ICES.

[176]  Gunnar Tufte,et al.  Bridging the genotype-phenotype mapping for digital FPGAs , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[177]  Delon Levi,et al.  JBits: Java based interface for reconfigurable computing , 1999 .

[178]  Xin Yao,et al.  The GRD Chip: Genetic Reconfiguration of DSPs for Neural Network Processing , 1999, IEEE Trans. Computers.

[179]  Julian Francis Miller,et al.  Evolving a Self-Repairing, Self-Regulating, French Flag Organism , 2004, GECCO.

[180]  Meng-Hiot Lim,et al.  Evolvable Fuzzy System for ATM Cell Scheduling , 2003, ICES.

[181]  J. B. Grimbleby,et al.  Automatic analogue circuit synthesis using genetic algorithms , 2000 .

[182]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[183]  Alan D. Christiansen,et al.  Towards automated evolutionary design of combinational circuits , 2000, Comput. Electr. Eng..

[185]  Jason D. Lohn,et al.  Evolutionary design of an X-band antenna for NASA's Space Technology 5 mission , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[186]  Jim Torresen,et al.  Two-Step Incremental Evolution of a Prosthetic Hand Controller Based on Digital Logic Gates , 2001, ICES.

[187]  William B. Langdon,et al.  Scheduling Maintenance of Electrical Power Transmission Networks Using Genetic Programming , 1996 .

[188]  Xin Yao,et al.  Promises and challenges of evolvable hardware , 1996, IEEE Trans. Syst. Man Cybern. Part C.

[189]  James C. Smith,et al.  From egg to embryo (2nd edn) , 1991 .

[190]  Maja J. Matarić,et al.  A Developmental Model for the Evolution of Complete Autonomous Agents , 1996 .

[191]  R. Timothy Edwards.  Circuit morphologies and ontogenies , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[192]  Julian Francis Miller,et al.  Embedding Landscape Neutrality to Build a Bridge from the Conventional to a More Efficient Three-bit Multiplier Circuit , 2000, GECCO.

[193]  Paul J. Layzell,et al.  Evolution of Robustness in an Electronics Design , 2000, ICES.

[194]  Adrian Stoica,et al.  Evolvable hardware solutions for extreme temperature electronics , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[195]  A. Cangelosi,et al.  Cell division and migration in a 'genotype' for neural networks (Cell division and migration in neural networks) , 1993 .

[196]  Eduardo Sanchez,et al.  An Evolving and Developing Cellular Electronic Circuit , 2004 .

[197]  Richard Tateson.  Self-Organising Pattern Formation: Fruit Flies and Cell Phones , 1998, PPSN.

[198]  Andrew M. Tyrrell,et al.  Safe intrinsic evolution of Virtex devices , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[199]  Justinian P. Rosea.  Towards Automatic Discovery of Building Blocks in Genetic Programming , 1995 .

[200]  J. Baldwin.  A New Factor in Evolution , 1896, The American Naturalist.

[201]  Mehrdad Salami,et al.  Data Compression Based on Evolvable Hardware , 1996, ICES.

[202]  Per Kristian Lehre,et al.  Developmental mappings and phenotypic complexity , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[203]  John R. Koza,et al.  Genetic Programming II , 1992 .

[204]  Marco Tomassini,et al.  A phylogenetic, ontogenetic, and epigenetic view of bio-inspired hardware systems , 1997, IEEE Trans. Evol. Comput..

[205]  Pauline C. Haddow,et al.  From here to there : future robust EHW technologies for large digital designs , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[206]  J. Slack.  From Egg to Embryo , 1983 .

[207]  Julian F. Miller,et al.  Designing Electronic Circuits Using Evolutionary Algorithms. Arithmetic Circuits: A Case Study , 2007 .

[208]  Lukás Sekanina,et al.  Image Filter Design with Evolvable Hardware , 2002, EvoWorkshops.

[209]  Gianluca Tempesti,et al.  Ontogenetic Development and Fault Tolerance in the POEtic Tissue , 2003, ICES.

[210]  Julian Francis Miller,et al.  Evolving Developmental Programs for Adaptation, Morphogenesis, and Self-Repair , 2003, ECAL.

[211]  Garrison W. Greenwood,et al.  How to evolve safe control strategies , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[212]  Sanjeev Kumar.  Implicit Evolvability: An Investigation into the Evolvability of an Embryogeny , 2004 .

[213]  Derek S. Linden,et al.  Evolving wire antennas using genetic algorithms: a review , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[214]  Pauline C. Haddow,et al.  Evolving robust digital designs , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[215]  A. Lindenmayer.  Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[216]  R. Krohling,et al.  Evolving FPGA-based robot controllers using an evolutionary algorithm , 2002 .

[217]  Hugo de Garis,et al.  Million Module Neural Systems Evolution - The Next Step in ATR's Billion Neuron Artificial Brain ("CAM-Brain") Project , 1997, Artificial Evolution.

[218]  Peter Eggenberger Hotz.  Evolving Neural Network Structures Using Axonal Growth Mechanisms , 2000, IJCNN.

[219]  Marley M. B. R. Vellasco,et al.  PAMA-programmable analog multiplexer array , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[220]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[221]  Adrian Thompson,et al.  An Evolved Circuit, Intrinsic in Silicon, Entwined with Physics , 1996, ICES.

[222]  S. Kauffman,et al.  Towards a general theory of adaptive walks on rugged landscapes. , 1987, Journal of theoretical biology.

[223]  Andrew M. Tyrrell,et al.  The Intrinsic Evolution of Virtex Devices Through Internet Reconfigurable Logic , 2000, ICES.

[224]  Adrian Thompson,et al.  Evolutionary design of single electron systems , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[225]  Sushil J. Louis,et al.  Designer Genetic Algorithms: Genetic Algorithms in Structure Design , 1991, ICGA.

[226]  Delon Levi,et al.  HereBoy: a fast evolutionary algorithm , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[227]  Tatiana Kalganova,et al.  Some Aspects of an Evolvable Hardware Approach for Multiple-Valued Combinational Circuit Design , 1998, ICES.

[228]  Julian Francis Miller,et al.  Evolution and Acquisition of Modules in Cartesian Genetic Programming , 2004, EuroGP.

[229]  J. Gero,et al.  Evolving designs by generating useful complex gene structures , 1999 .

[230]  Isamu Kajitani,et al.  An Evolvable Hardware Chip and Its Application as a Multi-Function Prosthetic Hand Controller , 1999, AAAI/IAAI.

[231]  Ken Sharman,et al.  Evolving complex adaptive IIR structures , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[232]  J. Masner,et al.  Representation and robustness for evolved sorting networks , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[233]  Peter Eggenberger Hotz.  Creation of Neural Networks Based on Developmental and Evolutionary Principles , 1997, ICANN.

[234]  Lorenz Huelsbergen,et al.  Evolving oscillators in silico , 1999, IEEE Trans. Evol. Comput..

[235]  Przemyslaw Prusinkiewicz,et al.  Animation of plant development , 1993, SIGGRAPH.

[236]  Adrian Thompson,et al.  Evolution of Self-diagnosing Hardware , 2003, ICES.

[237]  H. Meinhardt,et al.  A theory of biological pattern formation , 1972, Kybernetik.

[238]  Peter J. Bentley,et al.  Fractal Proteins , 2004, Genetic Programming and Evolvable Machines.

[239]  Julian Francis Miller,et al.  The Advantages of Landscape Neutrality in Digital Circuit Evolution , 2000, ICES.

[240]  Lee Altenberg,et al.  The Schema Theorem and Price's Theorem , 1994, FOGA.

[241]  Adrian Stoica,et al.  Development of Consistent Equivalent Models by Mixed-Model Search , 2003, Modelling and Simulation.

[242]  Alex S. Fukunaga,et al.  Evolvable Hardware for Space Applications , 1998, ICES.

[243]  Varun Aggarwal,et al.  Evolving sinusoidal oscillators using genetic algorithms , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[244]  Hiroaki Kitano,et al.  A Simple Model of Neurogenesis and Cell Differentiation Based on Evolutionary Large-Scale Chaos , 1994, Artificial Life.

[245]  Hiroaki Kitano.  Building Complex Systems Using Developmental Process: An Engineering Approach , 1998, ICES.

[246]  M. Huynen,et al.  Smoothness within ruggedness: the role of neutrality in adaptation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[247]  Frédéric Gruau.  Artificial Cellular Development in Optimization and Compilation , 1995, Towards Evolvable Hardware.

[248]  Toshio Adachi,et al.  An AI-calibrated IF filter: a yield enhancement method with area and power dissipation reductions , 2002, Proceedings of the IEEE 2002 Custom Integrated Circuits Conference (Cat. No.02CH37285).

[249]  Alex Fukunaga,et al.  Evolving Nonlinear Predictive Models for Lossless Image Compression with Genetic Programming , 2002 .

[250]  Stuart J. Flockton,et al.  A Comparison of Evolutionary Algorithms for Tracking Time-Varying Recursive Systems , 2003, EURASIP J. Adv. Signal Process..

[251]  Jim Torresen,et al.  Possibilities and Limitations of Applying Evolvable Hardware to Real-World Applications , 2000, FPL.

[252]  Tughrul Arslan,et al.  Evolutionary design and adaptation of digital filters within an embedded fault tolerant hardware platform , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[253]  L. Altenberg.  The evolution of evolvability in genetic programming , 1994 .

[254]  Andrew M. Tyrrell,et al.  Using GAs to Create a Waveguide Model of the Oral Vocal Tract , 2004, EvoWorkshops.

[255]  Andrew M. Tyrrell,et al.  The architecture for a hardware immune system , 2001, Proceedings Third NASA/DoD Workshop on Evolvable Hardware. EH-2001.

[256]  Jim Torresen,et al.  Scalable evolvable hardware applied to road image recognition , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[257]  Vu Duong,et al.  Silicon validation of evolution-designed circuits , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[258]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[259]  Gunnar Tufte,et al.  Shrinking the Genotype: L-systems for EHW? , 2001, ICES.

[260]  Aloysio Pedroza,et al.  Using Genetic Programming and High Level Synthesis to Design Optimized Datapath , 2003, ICES.

[261]  Sabih H. Gerez,et al.  Algorithms for VLSI design automation , 1998 .

[262]  Julian Francis Miller,et al.  Evolution in materio: a tone discriminator in liquid crystal , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[263]  Eduardo Sanchez,et al.  A Reconfigurable Chip for Evolvable Hardware , 2004, GECCO.

[264]  M. McMenamin,et al.  The Emergence of Animals the Cambrian Breakthrough , 1990 .

[265]  Angelo Cangelosi,et al.  Heterochrony and Adaptation in Developing Neural Networks , 1999, GECCO.

[266]  Peter J. Bentley,et al.  Adaptive Fractal Gene Reguatory Networks for Robot Control , 2005 .

[267]  Lukás Sekanina,et al.  Evolutionary Design of Gate-Level Polymorphic Digital Circuits , 2005, EvoWorkshops.

[268]  Gunnar Tufte,et al.  Building Knowledge into Developmental Rules for Circuit Design , 2003, ICES.

[270]  SAGAInman HarveyCSRP.  Species Adaptation Genetic Algorithms: A Basis for a Continuing SAGA , 1992 .

[271]  John R. Koza,et al.  Automatic Creation of Human-Competitive Programs and Controllers by Means of Genetic Programming , 2000, Genetic Programming and Evolvable Machines.

[272]  Tatiana Kalganova,et al.  Bidirectional incremental evolution in extrinsic evolvable hardware , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[273]  Gunnar Tufte,et al.  Identification of functionality during development on a virtual Sblock FPGA , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[274]  Peter J. Bentley,et al.  Towards development in evolvable hardware , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[275]  Derek S. Linden,et al.  Optimizing signal strength in-situ using an evolvable antenna system , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[276]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[277]  Peter Eggenberger,et al.  Evolving Morphologies of Simulated 3d Organisms Based on Differential Gene Expression , 1997 .

[278]  Marley M. B. R. Vellasco,et al.  Analog Circuits Evolution in Extrinsic and Intrinsic Modes , 1998, ICES.

[279]  Derong Liu,et al.  Solving the N-bit parity problem using neural networks , 1999, Neural Networks.

[280]  Radomír Mech,et al.  Visual Models of Plant Development , 1997, Handbook of Formal Languages.