The planted matching problem: Sharp threshold and infinite-order phase transition

We study the problem of reconstructing a perfect matching M∗ hidden in a randomly weighted n × n bipartite graph. The edge set includes every node pair in M∗ and each of the n(n− 1) node pairs not in M∗ independently with probability d/n. The weight of each edge e is independently drawn from the distribution P if e ∈M∗ and from Q if e / ∈M∗. We show that if √ dB(P ,Q) ≤ 1, where B(P ,Q) stands for the Bhattacharyya coefficient, the reconstruction error (average fraction of misclassified edges) of the maximum likelihood estimator of M∗ converges to 0 as n→∞. Conversely, if √ dB(P ,Q) ≥ 1 + ǫ for an arbitrarily small constant ǫ > 0, the reconstruction error for any estimator is shown to be bounded away from 0 under both the sparse and dense model, resolving the conjecture in [20, 24]. Furthermore, in the special case of complete exponentially weighted graph with d = n, P = exp(λ), and Q = exp(1/n), for which the sharp threshold simplifies to λ = 4, we prove that when λ ≤ 4−ǫ, the optimal reconstruction error is exp (−Θ(1/√ǫ)), confirming the conjectured infinite-order phase transition in [24].

[1]  M Chertkov,et al.  Inference in particle tracking experiments by passing messages between images , 2009, Proceedings of the National Academy of Sciences.

[2]  Jiaming Xu,et al.  Consistent Recovery Threshold of Hidden Nearest Neighbor Graphs , 2019, IEEE Transactions on Information Theory.

[3]  Gabriele Sicuro,et al.  The planted k-factor problem , 2021, Journal of Physics A: Mathematical and Theoretical.

[4]  Cristopher Moore,et al.  The Computer Science and Physics of Community Detection: Landscapes, Phase Transitions, and Hardness , 2017, Bull. EATCS.

[5]  David W. Walkup,et al.  On the Expected Value of a Random Assignment Problem , 1979, SIAM J. Comput..

[7]  R. Karp An Upper Bound on the Expected Cost of an Optimal Assignment , 1987 .

[8]  Florent Krzakala,et al.  MMSE of probabilistic low-rank matrix estimation: Universality with respect to the output channel , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  E. Marinari,et al.  On the number of circuits in random graphs , 2006, cond-mat/0603657.

[10]  Cristopher Moore,et al.  Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Bruce Hajek,et al.  Information limits for recovering a hidden community , 2015, 2016 IEEE International Symposium on Information Theory (ISIT).

[12]  M. Krivelevich,et al.  Long paths and Hamiltonicity in random graphs , 2015, 1507.00205.

[13]  Jiaming Xu,et al.  The Planted Matching Problem: Phase Transitions and Exact Results , 2019, ArXiv.

[14]  David Tse,et al.  Hidden Hamiltonian Cycle Recovery via Linear Programming , 2018, Oper. Res..

[15]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[16]  Svante Linusson,et al.  A proof of Parisi’s conjecture on the random assignment problem , 2003, math/0303214.

[17]  R. Durrett Random Graph Dynamics: References , 2006 .

[18]  Jiaming Xu,et al.  Statistical Problems with Planted Structures: Information-Theoretical and Computational Limits , 2018, Information-Theoretic Methods in Data Science.

[19]  Guilhem Semerjian,et al.  Recovery thresholds in the sparse planted matching problem , 2020, Physical review. E.

[20]  H. Robbins A Remark on Stirling’s Formula , 1955 .

[21]  B. Prabhakar,et al.  Proofs of the Parisi and Coppersmith‐Sorkin random assignment conjectures , 2005 .

[22]  D. Wilson,et al.  Supercritical minimum mean-weight cycles , 2015, 1504.00918.

[23]  M. Mézard,et al.  On the solution of the random link matching problems , 1987 .

[24]  A. Frieze,et al.  Introduction to Random Graphs , 2016 .

[25]  Johan Wästlund AN EASY PROOF OF THE ζ ( 2 ) LIMIT IN THE RANDOM ASSIGNMENT PROBLEM , 2006 .

[26]  Jian Ding,et al.  Scaling window for mean-field percolation of averages , 2011, 1110.3361.