Principles in the Evolutionary Design of Digital Circuits—Part II

In a previous work it was argued that by studying evolved designs of gradually increasing scale, one might be able to discern new, efficient, and generalisable principles of design. These ideas are tested in the context of designing digital circuits, particularly arithmetic circuits. This process of discovery is seen as a principle extraction loop in which the evolved data is analysed both phenotypically and genotypically by processes of data mining and landscape analysis. The information extracted is then fed back into the evolutionary algorithm to enhance its search capabilities and hence increase the likelihood of identifying new principles which explain how to build systems which are too large to evolve.

[1]  Willard Van Orman Quine,et al.  The Problem of Simplifying Truth Functions , 1952 .

[2]  E. McCluskey.  Minimization of Boolean functions , 1956 .

[3]  C. Y. Lee.  Representation of switching circuits by binary-decision programs , 1959 .

[4]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  J. W. Atmar,et al.  Speculation on the evolution of intelligence and its possible realization in machine form. , 1976 .

[7]  Sheldon B. Akers,et al.  Binary Decision Diagrams , 1978, IEEE Transactions on Computers.

[8]  S. L. Hurst,et al.  A Comparison of Universal-Logic-Module Realizations and Their Application in the Synthesis of Combinatorial and Sequential Logic Networks , 1982, IEEE Transactions on Computers.

[9]  Robert K. Brayton,et al.  Logic Minimization Algorithms for VLSI Synthesis , 1984, The Kluwer International Series in Engineering and Computer Science.

[10]  Randal E. Bryant,et al.  Graph-Based Algorithms for Boolean Function Manipulation , 1986, IEEE Transactions on Computers.

[11]  David H. Green,et al.  Modern logic design , 1986 .

[12]  A. Kahng.  Conference on Genetic Algorithms , 1987 .

[13]  Robert Gordon Middleton.  Designing Electronic Circuits , 1987 .

[14]  Robert K. Brayton,et al.  MIS: A Multiple-Level Logic Optimization System , 1987, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[17]  Robert K. Brayton,et al.  Multilevel logic synthesis , 1990, Proc. IEEE.

[18]  Kenneth J. Supowit,et al.  Finding the Optimal Variable Ordering for Binary Decision Diagrams , 1990, IEEE Trans. Computers.

[19]  Hiroaki Kitano,et al.  Massively Parallel Artificial Intelligence , 1991, IJCAI.

[20]  Randal E. Bryant,et al.  On the Complexity of VLSI Implementations and Graph Representations of Boolean Functions with Application to Integer Multiplication , 1991, IEEE Trans. Computers.

[21]  Melanie Mitchell,et al.  The royal road for genetic algorithms: Fitness landscapes and GA performance , 1991 .

[22]  Bernard Manderick,et al.  The Genetic Algorithm and the Structure of the Fitness Landscape , 1991, ICGA.

[23]  Randal E. Bryant,et al.  Efficient implementation of a BDD package , 1991, DAC '90.

[24]  Mark A. Satterthwaite,et al.  The Bayesian theory of the k-double auction: Santa Fe Institute Studies in the Sciences of Complexity , 2018 .

[25]  Fabio Somenzi,et al.  Variable ordering for binary decision diagrams , 1992, [1992] Proceedings The European Conference on Design Automation.

[26]  Jacob A. Abraham,et al.  IBDDs: an efficient functional representation for digital circuits , 1992, [1992] Proceedings The European Conference on Design Automation.

[27]  Heinz Mühlenbein,et al.  The Science of Breeding and Its Application to the Breeder Genetic Algorithm (BGA) , 1993, Evolutionary Computation.

[28]  Srinivas Devadas.  Comparing two-level and ordered binary decision diagram representations of logic functions , 1993, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[29]  P. Stadler,et al.  Anisotropy in fitness landscapes. , 1993, Journal of theoretical biology.

[30]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[31]  Yusuke Matsunaga,et al.  Variable ordering of binary decision diagrams for multi-level logic minimization , 1993 .

[32]  Hitoshi Iba,et al.  Evolving hardware with genetic learning: a first step towards building a Darwin machine , 1993 .

[33]  Bernd Becker,et al.  Fast OFDD based minimization of fixed polarity Reed-Muller expressions , 1994, EURO-DAC '94.

[34]  Kurt Keutzer,et al.  Logic Synthesis , 1994 .

[35]  H. Luchian,et al.  Using a genetic algorithm for optimizing fixed polarity Reed-Muller expansions of boolean functions , 1994 .

[36]  D Thalmann,et al.  Artificial Life and VirtualReality , 1994 .

[37]  Rolf Drechsler,et al.  Efficient Representation and Manipulation of Switching Functions Based on Ordered Kronecker Functional Decision Diagrams , 1994, 31st Design Automation Conference.

[38]  Premachandran R. Menon,et al.  Multi-level Logic Optimization By Implication Analysis , 1994, IEEE/ACM International Conference on Computer-Aided Design.

[39]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex adaptive systems.

[40]  D. L. Grundy.  A computational approach to VLSI analog design , 1994, J. VLSI Signal Process..

[41]  J. M. Aróstegui.  Vlsi architectures for evolutive neural models , 1995 .

[42]  V. Shankararaman,et al.  Application of Case-Based Reasoning (CBR) to Software Reuse , 1995, UK Workshop on Case-Based Reasoning.

[43]  Astro Teller,et al.  PADO: Learning Tree Structured Algorithms for Orchestration into an Object Recognition System , 1995 .

[44]  J. B. Grimbleby,et al.  Automatic analogue network synthesis using genetic algorithms , 1995 .

[45]  John E. Hunt,et al.  Evolutionary Case Based Design , 1995, UK Workshop on Case-Based Reasoning.

[46]  Peter F. Stadler,et al.  Towards a theory of landscapes , 1995 .

[47]  Domine Leenaerts,et al.  DARWIN: CMOS opamp Synthesis by Means of a Genetic Algorithm , 1995, 32nd Design Automation Conference.

[48]  Tim Jones.  Evolutionary Algorithms, Fitness Landscapes and Search , 1995 .

[49]  Srinivas Devadas,et al.  Probabilistic manipulation of Boolean functions using free Boolean diagrams , 1995, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[50]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[51]  Rolf Drechsler,et al.  Learning Heuristics for OBDD Minimization by Evolutionary Algorithms , 1996, PPSN.

[52]  Mark T. Keane,et al.  Learning Adaptation Rules from a Case-Base , 1996, EWCBR.

[53]  John R. Koza,et al.  Automated WYWIWYG design of both the topology and component values of electrical circuits using genetic programming , 1996 .

[54]  J. Miller,et al.  Symbolic method for simplifying AND-EXOR representations of Boolean functions using a binary-decision technique and a genetic algorithm , 1996 .

[55]  Hitoshi Iba,et al.  Machine Learning Approach to Gate-Level Evolvable Hardware , 1996, ICES.

[56]  Adrian Thompson,et al.  Silicon evolution , 1996 .

[57]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[58]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[59]  John R. Koza,et al.  Use of automatically defined functions and architecture-altering operations in automated circuit synthesis with genetic programming , 1996 .

[60]  John R. Koza,et al.  Automated Design of Both the Topology and Sizing of Analog Electrical Circuits Using Genetic Programming , 1996 .

[61]  Christophe Giraud-Carrier,et al.  FLARE: Induction with Prior Knowledge , 1996 .

[62]  Wim Hordijk,et al.  A Measure of Landscapes , 1996, Evolutionary Computation.

[63]  Adrian Thompson,et al.  An Evolved Circuit, Intrinsic in Silicon, Entwined with Physics , 1996, ICES.

[64]  Marco Tomassini,et al.  Towards Evolvable Hardware: The Evolutionary Engineering Approach , 1996 .

[65]  P. Lala.  Practical digital logic design and testing , 1996 .

[66]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[67]  P. Stadler.  Landscapes and their correlation functions , 1996 .

[68]  Marco Tomassini,et al.  A phylogenetic, ontogenetic, and epigenetic view of bio-inspired hardware systems , 1997, IEEE Trans. Evol. Comput..

[69]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[70]  Tsutomu Sasao,et al.  Logic Synthesis and Optimization , 1997 .

[71]  Peter F. Stadler,et al.  Algebraic Theory of Recombination Spaces , 1997, Evolutionary Computation.

[72]  Moshe Sipper,et al.  Evolution of Parallel Cellular Machines: The Cellular Programming Approach , 1997 .

[73]  Riccardo Poli,et al.  Evolution of Graph-Like Programs with Parallel Distributed Genetic Programming , 1997, ICGA.

[74]  Tobias Blickle,et al.  Theory of evolutionary algorithms and application to system synthesis , 1997 .

[75]  Vesselin K. Vassilev.  An Information Measure of Landscapes , 1997, ICGA.

[76]  W. Hordijk.  Correlation analysis of the synchronizing-CA landscape , 1997 .

[77]  Masaya Iwata,et al.  Analogue EHW Chip for Intermediate Frequency Filters , 1998, ICES.

[78]  Adrian Thompson,et al.  Hardware evolution - automatic design of electronic circuits in reconfigurable hardware by artificial evolution , 1999, CPHC/BCS distinguished dissertations.

[79]  Peter F. Stadler,et al.  Amplitude Spectra of Fitness Landscapes , 1998, Adv. Complex Syst..

[80]  Alex S. Fukunaga,et al.  Evolvable Hardware for Space Applications , 1998, ICES.

[81]  Julian Francis Miller,et al.  Aspects of Digital Evolution: Geometry and Learning , 1998, ICES.

[82]  Adrian Thompson,et al.  On the Automatic Design of Robust Electronics Through Artificial Evolution , 1998, ICES.

[83]  Hiroshi Yokoi,et al.  A Gate-Level EHW Chip: Implementing GA Operations and Reconfigurable Hardware on a Single LSI , 1998, ICES.

[84]  Marley M. B. R. Vellasco,et al.  Analog Circuits Evolution in Extrinsic and Intrinsic Modes , 1998, ICES.

[85]  Stuart J. Flockton,et al.  Intrinsic Circuit Evolution Using Programmable Analogue Arrays , 1998, ICES.

[86]  Julian Francis Miller,et al.  Aspects of Digital Evolution: Evolvability and Architecture , 1998, PPSN.

[87]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[88]  Julian Francis Miller,et al.  On the nature of two-bit multiplier landscapes , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[89]  John R. Koza.  Genetic Programming III - Darwinian Invention and Problem Solving , 1999, Evolutionary Computation.

[90]  W. Langdon,et al.  Smooth uniform crossover, sub-machine code GP and demes: a recipe for solving high-order Boolean parity problems , 1999 .

[91]  J. Miller.  An empirical study of the efficiency of learning boolean functions using a Cartesian Genetic Programming approach , 1999 .

[92]  Riccardo Poli,et al.  Sub-machine-code GP: New Results and Extensions , 1999, EuroGP.

[93]  F. H. Bennett.  Genetic Programming : Biologically Inspired Computation that Exhibits Creativity in Solving Non-Trivial Problems , 1999 .

[94]  Enrico Coen,et al.  The Art of Genes , 1999 .

[95]  Paul J. Layzell,et al.  Explorations in design space: unconventional electronics design through artificial evolution , 1999, IEEE Trans. Evol. Comput..

[96]  Raoul Tawel,et al.  Evolutionary experiments with a fine-grained reconfigurable architecture for analog and digital CMOS circuits , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[97]  Vesselin K. Vassilev,et al.  Digital circuit evolution and fitness landscapes , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[98]  E. Coen.  The art of genes : how organisms make themselves , 1999 .

[99]  Stuart J. Flockton,et al.  A system for intrinsic evolution of linear and non-linear filters , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[100]  Marley M. B. R. Vellasco,et al.  Artificial evolution of active filters: a case study , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[101]  John R. Koza,et al.  Genetic Programming III: Darwinian Invention & Problem Solving , 1999 .

[102]  Julian Francis Miller,et al.  Information Characteristics and the Structure of Landscapes , 2000, Evolutionary Computation.

[103]  Christian M. Reidys,et al.  Neutrality in fitness landscapes , 2001, Appl. Math. Comput..

[104]  Principles in the Evolutionary Design of Digital Circuits—Part I , 2004, Genetic Programming and Evolvable Machines.

[105]  E. Weinberger,et al.  Correlated and uncorrelated fitness landscapes and how to tell the difference , 1990, Biological Cybernetics.

[106]  E. D. Weinberger,et al.  Fourier and Taylor series on fitness landscapes , 1991, Biological Cybernetics.

[107]  J. Moreno,et al.  Proceedings of the 6th international conference on Evolvable Systems: from Biology to Hardware , 2005 .