Evolved Representations and Their Use in Computational Creativity

In any computational process, the representation used plays an important role. Depending on how the representation is chosen, some designs will generally not be representable, restricting the size of the search space. However, the representation can also change the topology of the search space, making some designs more likely to be the outcome of the design process than others. Generally, representations are designed to minimize this bias caused by the representation. This thesis explores how it is possible to develop specific representations that influence a design process in a useful, predictable way, and the possible use of such a method in creative computational processes. The work is based on evolutionary algorithms. These algorithms use an initial representation, which can be referred to as the ‘basic representation’, using symbols from an initial alphabet, the ‘basic genes’. This representation is developed into an ‘evolved representation’ by adding a number of ‘evolved genes‘. These evolved genes encapsulate fixed combinations of basic genes, and protect them from disruption in the evolutionary design process. As a consequence, design processes using the evolved representation will be biased in favour of these gene combinations. If the gene combinations are associated with certain specific features in designs, then a focus is introduced into the design process, centred around designs which show these features. To create appropriate evolved genes with minimal user interaction, a machine learning approach is developed. An evolutionary algorithm creates sample individuals from a set of user provided example designs, and evolved genes are created from successful gene combinations in those sample individuals. The thesis shows that the creation of a focus using an evolved representation can fulfil the procedural definitions of creativity found in the literature, if certain ‘finite system’ restrictions are taken into account. The only additional requirement is the ability to modify the focus in the design process. Since the focus is created by the evolved representation, modifying the evolved representation provides a way to induce these changes in the focus. Creation, use and transformation of evolved representations are demonstrated using two different example applications. In the first example, floor plans of Frank Lloyd Wright’s Prairie Houses are used to create an evolved representation; designs produced using this representation show similarities to the example floor plans. The possibility for a transformation of the search space is demonstrated by a modification of the evolved genes, which changes the proportions of living and service areas in the designs created. In the second example, a tree structure is used for the basic representation, requiring a more complex notion of evolved genes. The evolved representation is created from a set of paintings by the Dutch painter Piet Mondrian and from a window design by Frank Lloyd Wright. Again, designs produced using the representations show similarities to the paintings and the window design respectively. Two different transformations of the focus are demonstrated in this example: mixing the two representations created from the paintings and the window, and adapting the evolved representations for use in a different

[1]  J. H. Kenneth Henderson's Dictionary of Biological Terms , 1963 .

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  William J. Mitchell,et al.  Counting Palladian Plans , 1978 .

[4]  The Illustrated Origin of Species , 1979 .

[5]  G. Stiny Introduction to Shape and Shape Grammars , 1980 .

[6]  G. Stiny Kindergarten Grammars: Designing with Froebel's Building Gifts , 1980 .

[7]  H. Koning,et al.  The Language of the Prairie: Frank Lloyd Wright's Prairie Houses , 1981 .

[8]  U Flemming,et al.  The Secret of the Casa Giuliani Frigerio , 1981 .

[9]  Drawings and plans of Frank Lloyd Wright , 1983 .

[10]  R. Fox The ascent of man , 1983, Nature.

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  U. Flemming,et al.  A Generative Expert System for the Design of Building Layouts , 1986 .

[13]  Przemyslaw Prusinkiewicz,et al.  Developmental Models of Multicellular Organisms: A Computer Graphics Perspective , 1987, ALIFE.

[14]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.

[15]  U Flemming,et al.  More Than the Sum of Parts: The Grammar of Queen Anne Houses , 1987 .

[16]  T W Knight Comparing Designs , 1988 .

[17]  C. Mackenzie,et al.  Inferring Relational Design Grammars , 1989 .

[18]  T. Knight Transformations of De Stijl Art: The Paintings of Georges Vantongerloo and Fritz Glarner , 1989 .

[19]  T W Knight Color Grammars: Designing with Lines and Colors , 1989 .

[20]  Scott Curland Chase Shapes and Shape Grammars: From Mathematical Model to Computer Implementation , 1989 .

[21]  Mary Lou Zhao F. and Gero John S. Maher,et al.  Creativity in Humans and Computers , 1989 .

[22]  John S. Gero,et al.  Knowledge-Based Design Systems , 1989 .

[23]  Gerhard Jäger,et al.  Annotations on the Consistency of the Closed World Assumption , 1990, J. Log. Program..

[24]  D. Navinchandra Exploration and Innovation in Design: Towards a Computational Model , 1990 .

[25]  H. Stowell The emperor's new mind R. Penrose, Oxford University Press, New York (1989) 466 pp. $24.95 , 1990, Neuroscience.

[26]  E. D. De Robertis,et al.  Homeobox genes and the vertebrate body plan. , 1990, Scientific American.

[27]  John S. Gero,et al.  Design Prototypes: A Knowledge Representation Schema for Design , 1990, AI Mag..

[28]  S. Shih,et al.  Case-based representation and adaptation in design , 1991 .

[29]  Luc Steels,et al.  Towards a theory of emergent functionality , 1991 .

[30]  John S. Gero,et al.  A Design Support System Using Analogy , 1992 .

[31]  Martin Betts,et al.  Management of information technology for construction , 1993 .

[32]  Samir W. Mahfoud Simple Analytical Models of Genetic Algorithms for Multimodal Function Optimization , 1993, ICGA.

[33]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[34]  Jeffrey Horn,et al.  Multiobjective Optimization Using the Niched Pareto Genetic Algorithm , 1993 .

[35]  Peter Wall,et al.  Introduction to C++ , 1993, TOOLS.

[36]  H Buelinckx,et al.  Wren's Language of City Church Designs: A Formal Generative Classification , 1993 .

[37]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[38]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[39]  Hillol Kargupta Information Transmission in Genetic Algorithm and Shannon's Second Theorem , 1993, ICGA.

[40]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[41]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[42]  D. Cliff From animals to animats , 1994, Nature.

[43]  John S. Gero,et al.  Towards a model of exploration in computer-aided design , 1994, Formal Design Methods for CAD.

[44]  Dario Floreano,et al.  From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior , 2000, Journal of Cognitive Neuroscience.

[45]  Yukiko Yoshida,et al.  A Diploid Genetic Algorithm for Preserving Population Diversity - pseudo-Meiosis GA , 1994, PPSN.

[46]  Justinian P. Rosca,et al.  Learning by adapting representations in genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[47]  Ian F. C. Smith,et al.  Case Based Design in Architecture , 1994 .

[48]  Terry Weissman Knight Transformations in Design: A Formal Approach to Stylistic Change and Innovation in the Visual Arts , 1994 .

[49]  John R. Koza,et al.  Architecture-Altering Operations for Evolving the Architecture of a Multi-Part Program in Genetic Programming , 1994 .

[50]  John S. Gero,et al.  Evolutionary learning of novel grammars for design improvement , 1994, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[51]  John S. Gero,et al.  Design Fixation and Intelligent Design AIDS , 1994 .

[52]  C-S Chan,et al.  Operational Definitions of Style , 1994 .

[53]  Hillol Kargupta,et al.  Signal-to-noise, Crosstalk, and Long Range Problem Difficulty in Genetic Algorithms , 1995, ICGA.

[54]  Margaret A. Boden Could a robot be creative—and would we know? , 1995 .

[55]  Kok Cheong Wong,et al.  A New Diploid Scheme and Dominance Change Mechanism for Non-Stationary Function Optimization , 1995, ICGA.

[56]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[57]  Jan Paredis,et al.  The Symbiotic Evolution of Solutions and Their Representations , 1995, International Conference on Genetic Algorithms.

[58]  James R. Levenick Metabits: Generic Endogenous Crossover Control , 1995, ICGA.

[59]  C-S Chan,et al.  A Cognitive Theory of Style , 1995 .

[60]  J Rollo Triangle and T-Square: The Windows of Frank Lloyd Wright , 1995 .

[61]  Walter Hower,et al.  Evolutionary Layout Design , 1996 .

[62]  Hillol Kargupta,et al.  The gene expression messy genetic algorithm for financial applications , 1996, IEEE/IAFE 1996 Conference on Computational Intelligence for Financial Engineering (CIFEr).

[63]  Patrick Olivier,et al.  Multi-Level Molecular Representation , 1996 .

[64]  F. Greene A New Approach to Diploid/Dominance and Its Effects on Stationary Genetic Search , 1996, Evolutionary Programming.

[65]  David H. Ackley,et al.  Ccr: A network of worlds for research , 1996 .

[66]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[67]  John S. Gero,et al.  Evolving Design Genes as well as Design Solutions , 1996 .

[68]  Ewa Grabska,et al.  Assisting Creativity by Composite Representation , 1996 .

[69]  Hillol Kargupta,et al.  The Gene Expression Messy Genetic Algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[70]  George Turkiyyah,et al.  Skeleton-Based Techniques for the Creative Synthesis of Structural Shapes , 1996 .

[71]  Mary Lou Maher,et al.  Emergent Behaviour in Co-Evolutionary Design , 1996 .

[72]  John S. Gero,et al.  Learning representations for creative design using evolution , 1996, Artif. Intell. Eng. Des. Anal. Manuf..

[73]  角 康之 "Artificial Life V"に参加して , 1996 .

[74]  H. Kargupta,et al.  Computational processes of evolution and the gene expression messy genetic algorithm , 1996 .

[75]  T. Schnier,et al.  Learning Genetic Representations as Alternative to Hand-Coded Shape Grammars , 1996 .

[76]  Stanley J. Rosenschein,et al.  From Animals to Animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior , 1996 .

[77]  Fay Sudweeks,et al.  Artificial Intelligence in Design ’96 , 1996, Springer Netherlands.

[78]  T. Schnier,et al.  Genetic Engineering and Design Problems , 1997 .

[79]  David B. Fogel,et al.  A history of evolutionary computation , 2018, Evolutionary Computation 1.

[80]  David B. Fogel,et al.  Guidelines for a suitable encoding , 2018, Evolutionary Computation 1.

[81]  M. Rosenman The Generation of Form Using an Evolutionary Approach , 1997 .

[82]  Robert G. Reynolds,et al.  Evolutionary computation: Towards a new philosophy of machine intelligence , 1997 .

[83]  Kenneth de Jong,et al.  Generation gap methods , 2018, Evolutionary Computation 1.

[84]  John S. Gero,et al.  Dominant and Recessive Genes in Evolutionary Systems Applied to Spatial Reasoning , 1997, Australian Joint Conference on Artificial Intelligence.

[85]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[86]  Andrés Gómez de Silva Garza,et al.  Case-Based Reasoning in Design , 1995, IEEE Expert.

[87]  David B. Fogel Principles of evolutionary processes , 1997 .

[88]  L. Yaeger Computational Genetics, Physiology, Metabolism, Neural Systems, Learning, Vision, and Behavior or PolyWorld: Life in a New Context , 1997 .

[89]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[90]  David E. Goldberg,et al.  The Race, the Hurdle, and the Sweet Spot , 1998 .

[91]  T. Schnier,et al.  From Mondrian to Frank Lloyd Wright: Transforming Evolving Representations , 1998 .

[92]  Daniel E. Goldberg The design of innovation: Lessons from genetic algorithms , 1998 .

[93]  John S. Gero,et al.  Evolving design genes in space layout planning problems , 1998, Artif. Intell. Eng..

[94]  W. Wright,et al.  Design Optimisation of a Simple 2-D Aerofoil Using Stochastic Search Methods , 1998 .

[95]  John S. Gero,et al.  Understanding conceptual electronic design using protocol analysis , 1998 .

[96]  Ian C. Parmee,et al.  Multi-objective Optimisation and Preliminary Airframe Design , 1998 .

[97]  I. C. Parmee,et al.  Exploring The Design Potential Of Evolutionary / Adaptive Search And Other Computational Intelligence Technologies , 1998 .

[98]  For Piet Mondrian , 1998 .

[99]  E. Hinton,et al.  Performance of Genetic Algorithms for Optimization of Frame Structures , 1998 .

[100]  John R. Koza,et al.  Evolutionary Design of Analog Electrical Circuits Using Genetic Programming , 1998 .

[101]  R. Walker,et al.  Simulation models , 1999 .

[102]  A.E. Smith,et al.  Adaptive Computing In Design And Manufacture , 1999, Proceedings of the IEEE.

[103]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.