Network extraction by routing optimization

Routing optimization is a relevant problem in many contexts. Solving directly this type of optimization problem is often computationally intractable. Recent studies suggest that one can instead turn this problem into one of solving a dynamical system of equations, which can instead be solved efficiently using numerical methods. This results in enabling the acquisition of optimal network topologies from a variety of routing problems. However, the actual extraction of the solution in terms of a final network topology relies on numerical details which can prevent an accurate investigation of their topological properties. In fact, in this context, theoretical results are fully accessible only to an expert audience and ready-to-use implementations for non-experts are rarely available or insufficiently documented. In particular, in this framework, final graph acquisition is a challenging problem in-and-of-itself. Here we introduce a method to extract network topologies from dynamical equations related to routing optimization under various parameters’ settings. Our method is made of three steps: first, it extracts an optimal trajectory by solving a dynamical system, then it pre-extracts a network, and finally, it filters out potential redundancies. Remarkably, we propose a principled model to address the filtering in the last step, and give a quantitative interpretation in terms of a transport-related cost function. This principled filtering can be applied to more general problems such as network extraction from images, thus going beyond the scenarios envisioned in the first step. Overall, this novel algorithm allows practitioners to easily extract optimal network topologies by combining basic tools from numerical methods, optimization and network theory. Thus, we provide an alternative to manual graph extraction which allows a grounded extraction from a large variety of optimal topologies. The analysis of these may open up the possibility to gain new insights into the structure and function of optimal networks. We provide an open source implementation of the code online.

[1]  G. Pazour,et al.  Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness , 2017, Scientific Reports.

[2]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008, Proceedings of the Python in Science Conference.

[3]  Nisheeth K. Vishnoi,et al.  IRLS and Slime Mold: Equivalence and Convergence , 2016, ArXiv.

[4]  F. Santambrogio Optimal channel networks, landscape function and branched transport , 2007 .

[5]  Chi Ho Yeung,et al.  From the physics of interacting polymers to optimizing routes on the London Underground , 2013, Proceedings of the National Academy of Sciences.

[6]  W. Baumgarten,et al.  Detection, extraction, and analysis of the vein network of the slime mould Physarum polycephalum , 2010 .

[7]  Alfredo Braunstein,et al.  The cavity approach for Steiner trees Packing problems , 2017, ArXiv.

[8]  Susanna M. Messinger,et al.  Task-performing dynamics in irregular, biomimetic networks , 2007, Complex..

[9]  Qinglan Xia ON LANDSCAPE FUNCTIONS ASSOCIATED WITH TRANSPORT PATHS , 2013 .

[10]  Changjie Tang,et al.  A Comparative Study of Six Software Packages for Complex Network Research , 2010, 2010 Second International Conference on Communication Software and Networks.

[11]  Qinglei Sun,et al.  Dysregulation of YAP by ARF Stimulated with Tea-derived Carbon Nanodots , 2017, Scientific Reports.

[12]  J R Banavar,et al.  Topology of the fittest transportation network. , 2000, Physical review letters.

[13]  Berk,et al.  Scale-invariant behavior and vascular network formation in normal and tumor tissue. , 1995, Physical review letters.

[14]  F. Santambrogio Optimal Transport for Applied Mathematicians: Calculus of Variations, PDEs, and Modeling , 2015 .

[15]  Filippo Santambrogio,et al.  Optimal Transport for Applied Mathematicians , 2015 .

[16]  D. Kleinfeld,et al.  Two-Photon Imaging of Cortical Surface Microvessels Reveals a Robust Redistribution in Blood Flow after Vascular Occlusion , 2006, PLoS biology.

[17]  Yuankun Xue,et al.  Reliable Multi-Fractal Characterization of Weighted Complex Networks: Algorithms and Implications , 2017, Scientific Reports.

[18]  L. Evans,et al.  Differential equations methods for the Monge-Kantorovich mass transfer problem , 1999 .

[19]  Alexandre Arenas,et al.  Optimal network topologies for local search with congestion , 2002, Physical review letters.

[20]  Fabrizio Altarelli,et al.  The Edge-Disjoint Path Problem on Random Graphs by Message-Passing , 2015, PloS one.

[21]  F. Santambrogio,et al.  A fractal shape optimization problem in branched transport , 2017, Journal de Mathématiques Pures et Appliquées.

[22]  Chia-Ju Lin,et al.  Author Correction: The role of sentrin-specific protease 2 substrate recognition in TGF-β-induced tumorigenesis , 2020, Scientific Reports.

[23]  Henrik Ronellenfitsch,et al.  Optimal noise-canceling networks , 2018, Physical review letters.

[24]  Paul Bogdan,et al.  Ollivier-Ricci Curvature-Based Method to Community Detection in Complex Networks , 2019, Scientific Reports.

[25]  Lu Wang,et al.  High precision computer-generated moiré profilometry , 2019, Scientific Reports.

[26]  Aldenor G. Santos,et al.  Occurrence of the potent mutagens 2- nitrobenzanthrone and 3-nitrobenzanthrone in fine airborne particles , 2019, Scientific Reports.

[27]  M. Fricker,et al.  Biological solutions to transport network design , 2007, Proceedings of the Royal Society B: Biological Sciences.

[28]  H E Stanley,et al.  Towards design principles for optimal transport networks. , 2010, Physical review letters.

[29]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[30]  Eleni Katifori,et al.  Damage and fluctuations induce loops in optimal transport networks. , 2009, Physical review letters.

[31]  Lynne Boddy,et al.  Fungal network responses to grazing. , 2010, Fungal genetics and biology : FG & B.

[32]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[33]  Gabriel Popescu,et al.  Network science characteristics of brain-derived neuronal cultures deciphered from quantitative phase imaging data , 2020, Scientific Reports.

[34]  Lynne Boddy,et al.  Network Organisation of Mycelial Fungi , 2007 .

[35]  Béla Bollobás,et al.  River landscapes and optimal channel networks , 2018, Proceedings of the National Academy of Sciences.

[36]  Panos M. Pardalos,et al.  Mathematical Aspects of Network Routing Optimization , 2011 .

[37]  Andrew G. Glen,et al.  APPL , 2001 .

[38]  Henrik Ronellenfitsch,et al.  Global Optimization, Local Adaptation, and the Role of Growth in Distribution Networks. , 2016, Physical review letters.

[39]  Sara Daneri,et al.  Numerical Solution of Monge–Kantorovich Equations via a Dynamic Formulation , 2017, Journal of Scientific Computing.

[40]  Dana S. Richards,et al.  Steiner tree problems , 1992, Networks.

[41]  Athanasios V. Vasilakos,et al.  Physarum Optimization: A Biology-Inspired Algorithm for the Steiner Tree Problem in Networks , 2015, IEEE Transactions on Computers.

[42]  M. Mildner,et al.  Re-epithelialization and immune cell behaviour in an ex vivo human skin model , 2020, Scientific Reports.

[43]  Boguslaw Obara,et al.  A bioimage informatics approach to automatically extract complex fungal networks , 2012, Bioinform..

[44]  R Zecchina,et al.  Statistical mechanics of steiner trees. , 2008, Physical review letters.

[45]  Michael Dirnberger,et al.  Characterizing networks formed by P. polycephalum , 2017 .

[46]  Enrico Facca,et al.  Physarum Dynamics and Optimal Transport for Basis Pursuit , 2018, 1812.11782.

[47]  A. Tero,et al.  A mathematical model for adaptive transport network in path finding by true slime mold. , 2007, Journal of theoretical biology.

[48]  M. A. Muñoz,et al.  Entangled networks, synchronization, and optimal network topology. , 2005, Physical review letters.

[49]  Enrico Facca,et al.  Towards a Stationary Monge-Kantorovich Dynamics: The Physarum Polycephalum Experience , 2016, SIAM J. Appl. Math..

[50]  Kurt Mehlhorn,et al.  Introducing the slime mold graph repository , 2017 .

[51]  Adrian Neumann,et al.  NEFI: Network Extraction From Images , 2015, Scientific Reports.

[52]  Qinglan Xia,et al.  Motivations, ideas and applications of ramified optimal transportation , 2015 .

[53]  Guido Caldarelli,et al.  Universal scaling relations in food webs , 2003, Nature.

[54]  Marcus Fruttiger,et al.  Development of the mouse retinal vasculature: angiogenesis versus vasculogenesis. , 2002, Investigative ophthalmology & visual science.

[55]  Vladimir Batagelj,et al.  Pajek - Program for Large Network Analysis , 1999 .

[56]  Saeed Sadri,et al.  A Review of Coronary Vessel Segmentation Algorithms , 2011, Journal of medical signals and sensors.

[57]  Feng Luo,et al.  Community Detection on Networks with Ricci Flow , 2019, Scientific Reports.

[58]  Wotao Yin,et al.  A Parallel Method for Earth Mover’s Distance , 2018, J. Sci. Comput..

[59]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[60]  Florent Lafarge,et al.  Recovering Line-Networks in Images by Junction-Point Processes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Chi Ho Yeung,et al.  Shortest node-disjoint paths on random graphs , 2014, ArXiv.

[62]  Konrad Schindler,et al.  Road networks as collections of minimum cost paths , 2015 .

[63]  S. Solimini,et al.  Fractal regularity results on optimal irrigation patterns , 2014 .

[64]  Francis Corson,et al.  Fluctuations and redundancy in optimal transport networks. , 2009, Physical review letters.

[65]  Raymond H. Chan,et al.  Conjugate Gradient Methods for Toeplitz Systems , 1996, SIAM Rev..