Beyond graphs: A new synthesis

Artificial neural networks, electronic circuits, and gene networks are some examples of systems that can be modeled as networks, that is, as collections of interconnected nodes. In this paper we introduce the concept of terminal graph (t-graph for short), which improves on the concept of graph as a unifying principle for the representation and computational synthesis and inference of technological and biological networks. We begin by showing how to use the t-graph concept to better understand the working of existing methods for the computational synthesis of networks. Then, we discuss the issue of the “missing methods”, that is, of new computational methods of network synthesis whose existence can be inferred using the perspective provided by the con- cept of t-graph. Finally, we comment on the application of the t-graph perspective to problems of network inference, to the field of complex networks, social networks, and to the understanding of biological networks and developmental processes.

[1]  P. Katz Beyond neurotransmission : neuromodulation and its importance for information processing , 1999 .

[2]  Dario Floreano,et al.  The Age of Analog Networks , 2008, AI Mag..

[3]  Claudio Mattiussi,et al.  Evolutionary synthesis of analog networks , 2005 .

[4]  Wolfgang Ebeling,et al.  Functions of Several Complex Variables and Their Singularities , 2007 .

[5]  Dario Floreano,et al.  Analog Genetic Encoding for the Evolution of Circuits and Networks , 2007, IEEE Transactions on Evolutionary Computation.

[6]  Michael Mitzenmacher,et al.  Editorial: The Future of Power Law Research , 2005, Internet Math..

[7]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.

[8]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[9]  Dieter Jungnickel,et al.  Graphs, Networks, and Algorithms , 1980 .

[10]  Albert-László Barabási,et al.  Evolution of Networks: From Biological Nets to the Internet and WWW , 2004 .

[11]  Martin Schechter,et al.  Critical point theory and its applications , 2006 .

[12]  Dario Floreano,et al.  Bio-inspired artificial intelligence , 2008 .

[13]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[14]  Alessandro Vespignani,et al.  Epidemic modeling in complex realities. , 2007, Comptes rendus biologies.

[15]  Dario Floreano,et al.  Evolving neuromodulatory topologies for reinforcement learning-like problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  María Cristina Riff,et al.  Towards an immune system that solves CSP , 2007, 2007 IEEE Congress on Evolutionary Computation.

[17]  Dario Floreano,et al.  Connecting Transistors and Proteins , 2004 .

[18]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[19]  Evelyn Fox Keller,et al.  Revisiting "scale-free" networks. , 2005, BioEssays : news and reviews in molecular, cellular and developmental biology.

[20]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[21]  Danail Bonchev,et al.  Quantitative Measures of Network Complexity , 2005 .

[22]  D. Floreano,et al.  Revealing strengths and weaknesses of methods for gene network inference , 2010, Proceedings of the National Academy of Sciences.

[23]  Sui Huang,et al.  Complex Gene Regulatory Networks - from Structure to Biological Observables: Cell Fate Determination , 2009, Encyclopedia of Complexity and Systems Science.

[24]  X. Yao Evolving Artificial Neural Networks , 1999 .

[25]  Jan van Leeuwen,et al.  Graph Algorithms , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[26]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[27]  Eva Jablonka,et al.  Epigenetic inheritance in evolution , 1998 .

[28]  Thomas Bäck,et al.  Basic aspects of evolution strategies , 1994 .

[29]  Diego Federici,et al.  Evolution and Development of a Multicellular Organism: Scalability, Resilience, and Neutral Complexification , 2006, Artificial Life.

[30]  Andrea Califano,et al.  Reverse engineering biological networks. Opportunities and challenges in computational methods for pathway inference. Proceedings of the workshop entitled Dialogue on Reverse Engineering Assessment and Methods (DREAM). September 7-8, 2006. Bronx, New York, USA. , 2007, Annals of the New York Academy of Sciences.

[31]  Dario Floreano,et al.  Genetic Representation and Evolvability of Modular Neural Controllers , 2010, IEEE Computational Intelligence Magazine.

[32]  D. Floreano,et al.  Replaying the Evolutionary Tape: Biomimetic Reverse Engineering of Gene Networks , 2009, Annals of the New York Academy of Sciences.

[33]  Guido Caldarelli,et al.  Scale-Free Networks , 2007 .

[34]  S. Strogatz Exploring complex networks , 2001, Nature.

[35]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[36]  Ricardo Salem Zebulum,et al.  Evolutionary Electronics , 2001 .

[37]  Walter Willinger,et al.  Towards a Theory of Scale-Free Graphs: Definition, Properties, and Implications , 2005, Internet Math..

[38]  Alessandro Vespignani,et al.  Dynamical Processes on Complex Networks , 2008 .

[39]  Radhika Nagpal,et al.  On Growth, Form and Computers , 2005, Genetic Programming and Evolvable Machines.

[40]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[41]  Jan Koutník,et al.  HyperNEAT controlled robots learn how to drive on roads in simulated environment , 2009, 2009 IEEE Congress on Evolutionary Computation.

[42]  Jan van Leeuwen,et al.  Handbook of Theoretical Computer Science, Vol. A: Algorithms and Complexity , 1994 .

[43]  Anthony Kulis,et al.  Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies , 2009, Scalable Comput. Pract. Exp..

[44]  Robert A. Meyers,et al.  Encyclopedia of Complexity and Systems Science , 2009 .

[45]  Bruce S. Davie,et al.  Computer Networks: A Systems Approach , 1996 .