Principled network extraction from images

Images of natural systems may represent patterns of network-like structure, which could reveal important information about the topological properties of the underlying subject. However, the image itself does not automatically provide a formal definition of a network in terms of sets of nodes and edges. Instead, this information should be suitably be extracted from the raw image data. Motivated by this, we present a principled model to extract network topologies from images that is scalable and efficient. We map this goal into solving a routing optimization problem where the solution is a network that minimizes an energy function which can be interpreted in terms of an operational and infrastructural cost. Our method relies on recent results from optimal transport theory and is a principled alternative to standard image-processing techniques that are based on heuristics. We test our model on real images of the retinal vascular system, slime mold and river networks and compare with routines combining image-processing techniques. Results are tested in terms of a similarity measure related to the amount of information preserved in the extraction. We find that our model finds networks from retina vascular network images that are more similar to hand-labeled ones, while also giving high performance in extracting networks from images of rivers and slime mold for which there is no ground truth available. While there is no unique method that fits all the images the best, our approach performs consistently across datasets, its algorithmic implementation is efficient and can be fully automatized to be run on several datasets with little supervision.

[1]  J. Lorens,et al.  Automated Quantification and Integrative Analysis of 2D and 3D Mitochondrial Shape and Network Properties , 2014, PloS one.

[2]  Lynne Boddy,et al.  Fungal network responses to grazing. , 2010, Fungal genetics and biology : FG & B.

[3]  Adrian Neumann,et al.  NEFI: Network Extraction From Images , 2015, Scientific Reports.

[4]  Peter Wonka,et al.  Road Network Extraction and Intersection Detection From Aerial Images by Tracking Road Footprints , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  A. Tero,et al.  Rules for Biologically Inspired Adaptive Network Design , 2010, Science.

[6]  Andrew G. Glen,et al.  APPL , 2001 .

[7]  Toshiyuki Nakagaki,et al.  Automated analysis of Physarum network structure and dynamics , 2016, BICT.

[8]  W. Baumgarten,et al.  Detection, extraction, and analysis of the vein network of the slime mould Physarum polycephalum , 2010 .

[9]  Caterina De Bacco Supplementary material from "Principled network extraction from images" , 2021 .

[10]  Jean-Francois Mangin,et al.  Detection of linear features in SAR images: application to road network extraction , 1998, IEEE Trans. Geosci. Remote. Sens..

[11]  Marc Germain,et al.  A novel algorithm identifies stress-induced alterations in mitochondrial connectivity and inner membrane structure from confocal images , 2017, PLoS Comput. Biol..

[12]  Panos M. Pardalos,et al.  Steiner Tree Problems , 2009, Encyclopedia of Optimization.

[13]  J R Banavar,et al.  Topology of the fittest transportation network. , 2000, Physical review letters.

[14]  Dana S. Richards,et al.  Steiner tree problems , 1992, Networks.

[15]  D. Kleinfeld,et al.  Correlations of Neuronal and Microvascular Densities in Murine Cortex Revealed by Direct Counting and Colocalization of Nuclei and Vessels , 2009, The Journal of Neuroscience.

[16]  Eleni Katifori,et al.  NET: a new framework for the vectorization and examination of network data , 2017, Source Code for Biology and Medicine.

[17]  Enrico Facca,et al.  Network extraction by routing optimization , 2020, Scientific Reports.

[18]  Radoslaw Lazarz,et al.  Automatic Extraction of Leaf Venation Complex Networks , 2020, ECAI.

[19]  Hanno Scharr,et al.  phenoVein—A Tool for Leaf Vein Segmentation and Analysis1[OPEN] , 2015, Plant Physiology.

[20]  Charles A Price LEAF GUI: analyzing the geometry of veins and areoles using image segmentation algorithms. , 2012, Methods in molecular biology.

[21]  Dogan Aydin,et al.  Detection of blood vessels in ophthalmoscope images using MF/ant (matched filter/ant colony) algorithm , 2009, Comput. Methods Programs Biomed..

[22]  David J. DeWitt,et al.  RoadTracer: Automatic Extraction of Road Networks from Aerial Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Saeed Sadri,et al.  A Review of Coronary Vessel Segmentation Algorithms , 2011, Journal of medical signals and sensors.

[24]  Berk,et al.  Scale-invariant behavior and vascular network formation in normal and tumor tissue. , 1995, Physical review letters.

[25]  Enrico Facca,et al.  Optimal transport for multi-commodity routing on networks , 2020, ArXiv.

[26]  Kurt Mehlhorn,et al.  Introducing the slime mold graph repository , 2017 .

[27]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[28]  Javier A. Montoya-Zegarra,et al.  AutoTube: a novel software for the automated morphometric analysis of vascular networks in tissues , 2018, Angiogenesis.

[29]  Nan Yang,et al.  A review of road extraction from remote sensing images , 2016 .

[30]  Gabriel Popescu,et al.  Network science characteristics of brain-derived neuronal cultures deciphered from quantitative phase imaging data , 2020, Scientific Reports.

[31]  Boguslaw Obara,et al.  A bioimage informatics approach to automatically extract complex fungal networks , 2012, Bioinform..

[32]  Nick S. Jones,et al.  Automated analysis of Physarum network structure and dynamics , 2017 .

[33]  Béla Bollobás,et al.  River landscapes and optimal channel networks , 2018, Proceedings of the National Academy of Sciences.

[34]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[35]  A. Tero,et al.  A mathematical model for adaptive transport network in path finding by true slime mold. , 2007, Journal of theoretical biology.

[36]  Zoran Nikoloski,et al.  DeFiNe: an optimisation-based method for robust disentangling of filamentous networks , 2015, Scientific Reports.