GENETIC PROGRAMMING : THEORY AND PRACTICE

With the recent examples of the human-competitiveness of evolutionary d esign systems, of interest is scaling them up to producing more sophisticated des igns. Here we argue that for computer-automated design systems to scale to pr oducing more sophisticated results they must be able to produce designs with gre a er structure and organization. By structure and organization we mean the ch aracteristics of modularity, reuse and hierarchy (MR&H), characteristics that are found both in man-made and natural designs. We claim that these charac teristics are enabled by implementing the attributes of combination, control-flow and abstraction in the representation and define metrics for measuring MR &H as well as define two measures of overall structure and organization by co mbining the measures of MR&H. To demonstrate the merit of our complexity measu r s, we use an evolutionary algorithm to evolve solutions to different sizes of a ta ble design problem and compare the structure and organization scores of th e best tables against existing complexity measures. We find that our measures b ett r correlate with the complexity of good designs than do others, which suppor ts our claim that MR&H are important components of complexity. We also compare evolution using five representations with different combinations of MR&H e nabled and find that the best designs are achieved when all three of these a tributes are present. The results of this second set of experiments demonstrate that implementing representations with MR&H can greatly improve search performa nce.

[1]  Victor H. Yngve,et al.  A model and an hypothesis for language structure , 1960 .

[2]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[3]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[4]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[5]  Barry K. Rosen,et al.  Syntactic Complexity , 1974, Inf. Control..

[6]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[7]  Gerald J. Sussman,et al.  Structure and interpretation of computer programs , 1985, Proceedings of the IEEE.

[8]  Charles H. Bennett,et al.  On the nature and origin of complexity in discrete, homogeneous, locally-interacting systems , 1986 .

[9]  Moshe Koppel,et al.  Complexity, Depth, and Sophistication , 1987, Complex Syst..

[10]  簡聰富,et al.  物件導向軟體之架構(Object-Oriented Software Construction)探討 , 1989 .

[11]  Karl T. Ulrich,et al.  Fundamentals of Product Modularity , 1994 .

[12]  Andrew Kusiak,et al.  Modularity in design of products and systems , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[13]  Rajeev Motwani,et al.  Complexity Measures for Assembly Sequences , 1999, Int. J. Comput. Geom. Appl..

[14]  Bruce Edmonds,et al.  Syntactic Measures of Complexity , 1999 .

[15]  Paul M. B. Vitányi,et al.  Three approaches to the quantitative definition of information in an individual pure quantum state , 1999, Proceedings 15th Annual IEEE Conference on Computational Complexity.

[16]  Peter J. Bentley,et al.  Introduction to creative evolutionary systems , 2001 .

[17]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[18]  Gregory S. Hornby,et al.  Generative representations for evolutionary design automation , 2003 .

[19]  Gregory S. Hornby,et al.  Functional Scalability through Generative Representations: The Evolution of Table Designs , 2004 .

[20]  Gregory Hornby,et al.  ALPS: the age-layered population structure for reducing the problem of premature convergence , 2006, GECCO.