Modified Lomax model: a heavy-tailed distribution for fitting large-scale real-world complex networks

Real-world networks are generally claimed to be scale-free. This means that the degree distributions follow the classical power-law, at least asymptotically. However, closer observation shows that the classical power-law distribution is often inadequate to meet the data characteristics due to the existence of an identifiable nonlinearity in the entire degree distribution in the log-log scale. The present paper proposes a new variant of the popular heavy-tailed Lomax distribution which we named as the modified Lomax (MLM) distribution that can efficiently capture the crucial aspect of heavy-tailed behavior of the entire degree distribution of real-world complex networks. The proposed MLM model, derived from a hierarchical family of Lomax distributions, can efficiently fit the entire degree distribution of real-world networks without removing lower degree nodes, as opposed to the classical power-law-based fitting. The MLM distribution belongs to the maximum domain of attraction of the Frechet distribution and is right tail equivalent to Pareto distribution. Various statistical properties including characteristics of the maximum likelihood estimates and asymptotic distributions have also been derived for the proposed MLM model. Finally, the effectiveness of the proposed MLM model is demonstrated through rigorous experiments over fifty real-world complex networks from diverse applied domains.

[1]  Petter Holme,et al.  Rare and everywhere: Perspectives on scale-free networks , 2019, Nature Communications.

[2]  Jure Leskovec,et al.  {SNAP Datasets}: {Stanford} Large Network Dataset Collection , 2014 .

[3]  A. H. El-Bassiouny,et al.  Exponential Lomax Distribution , 2015 .

[4]  I. B. Abdul-Moniem Recurrence relations for moments of lower generalized order statistics from Exponentiated Lomax Distribution and its characterization , 2012 .

[5]  Sataya D. Dubey,et al.  Compound gamma, beta and F distributions , 1970 .

[6]  Mohammad Ahsanullah,et al.  Record values of the Lomax distribution , 1991 .

[7]  L. Amaral,et al.  Sexual contacts and epidemic thresholds , 2003 .

[8]  Tanujit Chakraborty,et al.  Uncovering patterns in heavy-tailed networks : A journey beyond scale-free , 2020, COMAD/CODS.

[9]  Ben Y. Zhao,et al.  Brief announcement: revisiting the power-law degree distribution for social graph analysis , 2010, PODC '10.

[10]  M. Kuchaki Rafsanjani,et al.  Community detection in complex networks using structural similarity , 2018, Physica A: Statistical Mechanics and its Applications.

[11]  Gauss M. Cordeiro,et al.  The gamma-Lomax distribution , 2015 .

[12]  Narayanaswamy Balakrishnan,et al.  Order statistics from non-identical right-truncated Lomax random variables with applications , 2001 .

[13]  Nasrollah Moghadam Charkari,et al.  Statistical similarity measures for link prediction in heterogeneous complex networks , 2018, Physica A: Statistical Mechanics and its Applications.

[14]  M. Porter,et al.  Critical Truths About Power Laws , 2012, Science.

[15]  Xing-yuan Wang,et al.  Detecting community structure via the maximal sub-graphs and belonging degrees in complex networks , 2014 .

[16]  G. S. Mudholkar,et al.  A Generalization of the Weibull Distribution with Application to the Analysis of Survival Data , 1996 .

[17]  T. Kozubowski,et al.  A bivariate distribution with Lomax and geometric margins , 2018, Journal of the Korean Statistical Society.

[18]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[19]  Marjan Kuchaki Rafsanjani,et al.  Community detection in complex networks using structural similarity , 2018, Physica A: Statistical Mechanics and its Applications.

[20]  Asit Kumar Das,et al.  Finding patterns in the degree distribution of real-world complex networks: going beyond power law , 2019, Pattern Analysis and Applications.

[21]  S. Foss,et al.  An Introduction to Heavy-Tailed and Subexponential Distributions , 2011 .

[22]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[23]  Mojtaba Ganjali,et al.  On some lifetime distributions with decreasing failure rate , 2009, Comput. Stat. Data Anal..

[24]  C. A. Murthy,et al.  Fitting truncated geometric distributions in large scale real world networks , 2014, Theor. Comput. Sci..

[25]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[26]  Germán Mato,et al.  Dynamical and Topological Aspects of Consensus Formation in Complex Networks , 2017, ArXiv.

[27]  M. Bryson Heavy-Tailed Distributions: Properties and Tests , 1974 .

[28]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[29]  G. G. Hamedani,et al.  On a new generalization of Pareto distribution and its applications , 2018, Commun. Stat. Simul. Comput..

[30]  Richard L. Smith Maximum likelihood estimation in a class of nonregular cases , 1985 .

[31]  M. H. Tahir,et al.  The Gumbel-Lomax Distribution: Properties and Applications , 2016, J. Stat. Theory Appl..

[32]  A. Hassan,et al.  Optimum Step-Stress Accelerated Life Test Plan for Lomax Distribution with an Adaptive Type-II Progressive Hybrid Censoring , 2016 .

[33]  Amal S. Hassan,et al.  Optimum Step Stress Accelerated Life Testing for Lomax Distribution , 2009 .

[34]  R. Dicke Dirac's Cosmology and Mach's Principle , 1961, Nature.

[35]  Lucas C. Parra,et al.  Origins of power-law degree distribution in the heterogeneity of human activity in social networks , 2013, Scientific Reports.

[36]  Erhard Cramer,et al.  Progressively Type-II censored competing risks data from Lomax distributions , 2011, Comput. Stat. Data Anal..

[37]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Daniel E. Geer,et al.  Power. Law , 2012, IEEE Secur. Priv..

[39]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[40]  PAUL EMBRECHTS,et al.  Modelling of extremal events in insurance and finance , 1994, Math. Methods Oper. Res..

[41]  C. Klüppelberg Subexponential distributions and integrated tails. , 1988 .

[42]  L. Amaral,et al.  The web of human sexual contacts , 2001, Nature.

[43]  A. Atkinson,et al.  Distribution of personal wealth in Britain , 1978 .

[44]  Gauss M. Cordeiro,et al.  An extended Lomax distribution , 2013 .

[45]  Johan Segers,et al.  On the maximum likelihood estimator for the Generalized Extreme-Value distribution , 2016, 1601.05702.

[46]  M. E. J. Newman,et al.  Power laws, Pareto distributions and Zipf's law , 2005 .

[47]  Albert-László Barabási,et al.  The origin of bursts and heavy tails in human dynamics , 2005, Nature.

[48]  Aaron Clauset,et al.  Scale-free networks are rare , 2018, Nature Communications.

[49]  Francisco Louzada,et al.  Objective Bayesian Analysis for the Lomax Distribution , 2016 .

[50]  Albert-László Barabási,et al.  Error and attack tolerance of complex networks , 2000, Nature.

[51]  K. Lomax Business Failures: Another Example of the Analysis of Failure Data , 1954 .

[52]  Zhe-ming Lu,et al.  The dynamic correlation between degree and betweenness of complex network under attack , 2016 .

[53]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[54]  Ryan T. Godwin,et al.  On the Bias of the Maximum Likelihood Estimator for the Two-Parameter Lomax Distribution , 2013 .

[55]  Ryan A. Rossi,et al.  The Network Data Repository with Interactive Graph Analytics and Visualization , 2015, AAAI.

[56]  S. Kang,et al.  Posterior propriety of bivariate lomax distribution under objective priors , 2019, Communications in Statistics - Theory and Methods.

[57]  Christos Faloutsos,et al.  Mobile call graphs: beyond power-law and lognormal distributions , 2008, KDD.