Network Topology Tomography

In this work we consider the problem of reconstructing the topology of networks from indirect measurements. A novel algorithm is developed for reconstruction from coocurrence samples—sets of nodes that are known to form a path in the network, but for which the order is unknown. This algorithm outperforms existing algorithms for solving this problem, and is provably optimal in cases where nothing is known a prori about the structure of the network and the signal routing method obeys certain reasonable constraints. The algorithm is efficient in practice, and is found to scale to networks of millions of nodes. The difficultly of network reconstruction from coocurrences is analysed for graphs generated from a variety of random graph models, as well as a number of real world networks. Network structure is found to effect the reconstruction error rate, with scale-free networks resulting in the lowest error. The problem of tree structured coocurrences is also considered. This is the case where the set of nodes in a coocurrence sample form a tree rather than a path in the network. We are not aware of previously published literature on this problem. A restricted form of the problem is proposed, and an algorithm is proposed to solve it. This algorithm can be considered a baseline for other work in this area, as it is simple and computationally efficient. Reconstruction using tree structured coocurrences is found to be harder than for path coocurrences, with higher error rates occurring.

[1]  Robert Nowak,et al.  Network Tomography: Recent Developments , 2004 .

[2]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[3]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[4]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[5]  Sally L. Wood,et al.  Understanding the topology of a telephone network via internally-sensed network tomography , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .

[7]  A. Cayley A theorem on trees , 2009 .

[8]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[9]  Robert D. Nowak,et al.  Network Inference From Co-Occurrences , 2006, IEEE Transactions on Information Theory.

[10]  S. Havlin,et al.  Scale-free networks are ultrasmall. , 2002, Physical review letters.

[11]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[12]  Mathew D. Penrose,et al.  Random Geometric Graphs , 2003 .

[13]  Christos Faloutsos,et al.  Graphs over time: densification laws, shrinking diameters and possible explanations , 2005, KDD '05.

[14]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.