Faster Way to Agony - Discovering Hierarchies in Directed Graphs

Many real-world phenomena exhibit strong hierarchical structure. Consequently, in many real-world directed social networks vertices do not play equal role. Instead, vertices form a hierarchy such that the edges appear mainly from upper levels to lower levels. Discovering hierarchies from such graphs is a challenging problem that has gained attention. Formally, given a directed graph, we want to partition vertices into levels such that ideally there are only edges from upper levels to lower levels. From computational point of view, the ideal case is when the underlying directed graph is acyclic. In such case, we can partition the vertices into a hierarchy such that there are only edges from upper levels to lower edges. In practice, graphs are rarely acyclic, hence we need to penalize the edges that violate the hierarchy. One practical approach is agony, where each violating edge is penalized based on the severity of the violation. The fastest algorithm for computing agony requires O(nm2) time. In the paper we present an algorithm for computing agony that has better theoretical bound, namely O(m2). We also show that in practice the obtained bound is pessimistic and that we can use our algorithm to compute agony for large datasets. Moreover, our algorithm can be used as any-time algorithm.

[1]  Josep Díaz,et al.  Algorithms — ESA '96 , 1996, Lecture Notes in Computer Science.

[2]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[3]  Andrew McCallum,et al.  Topic and Role Discovery in Social Networks with Experiments on Enron and Academic Email , 2007, J. Artif. Intell. Res..

[4]  Danai Koutra,et al.  RolX: structural role extraction & mining in large graphs , 2012, KDD.

[5]  L. Freeman,et al.  Finding an appropriate order for a hierarchy based on probabilistic dominance , 1999, Animal Behaviour.

[6]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[7]  Lucrezia Macchia,et al.  Mining Summaries of Propagations , 2013, 2013 IEEE 13th International Conference on Data Mining.

[8]  Andrew V. Goldberg,et al.  Negative-cycle detection algorithms , 1996, Math. Program..

[9]  Joseph Naor,et al.  Approximating Minimum Feedback Sets and Multicuts in Directed Graphs , 1998, Algorithmica.

[10]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[11]  S. Safra,et al.  On the hardness of approximating minimum vertex cover , 2005 .

[12]  A. Elo The rating of chessplayers, past and present , 1978 .

[13]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[14]  Liviu Iftode,et al.  Finding hierarchy in directed online social networks , 2011, WWW.

[15]  Tanya Y. Berger-Wolf,et al.  Inferring the Maximum Likelihood Hierarchy in Social Networks , 2009, 2009 International Conference on Computational Science and Engineering.