Joint estimation of parameters in Ising model

We study joint estimation of the inverse temperature and magnetization parameters $(\beta,B)$ of an Ising model with a non-negative coupling matrix $A_n$ of size $n\times n$, given one sample from the Ising model. We give a general bound on the rate of consistency of the bi-variate pseudolikelihood estimator. Using this, we show that estimation at rate $n^{-1/2}$ is always possible if $A_n$ is the adjacency matrix of a bounded degree graph. If $A_n$ is the scaled adjacency matrix of a graph whose average degree goes to $+\infty$, the situation is a bit more delicate. In this case estimation at rate $n^{-1/2}$ is still possible if the graph is not regular (in an asymptotic sense). Finally, we show that consistent estimation of both parameters is impossible if the graph is Erd\"os-Renyi with parameter $p>0$ free of $n$, thus confirming that estimation is harder on approximately regular graphs with large degree.

[1]  Guy Bresler,et al.  Efficiently Learning Ising Models on Arbitrary Graphs , 2014, STOC.

[2]  B. Gidas Consistency of Maximum Likelihood and Pseudo-Likelihood Estimators for Gibbs Distributions , 1988 .

[3]  Basilis Gidas,et al.  Asymptotics of maximum likelihood estimators for the Curie-Weiss model , 1991 .

[4]  S. Mukherjee,et al.  Global testing against sparse alternatives under Ising models , 2016, The Annals of Statistics.

[5]  Hui Zou,et al.  Supplementary materials for “ Non-concave Penalized Composite Likelihood Estimation of Sparse Ising Models ” , 2012 .

[6]  Sourav Chatterjee,et al.  Estimation in spin glasses: A first step , 2006 .

[7]  S. Mukherjee,et al.  Inference in Ising Models , 2015, 1507.07055.

[8]  V. Milman,et al.  Asymptotic Theory Of Finite Dimensional Normed Spaces , 1986 .

[9]  Vincent Y. F. Tan,et al.  High-dimensional structure estimation in Ising models: Local separation criterion , 2011, 1107.1736.

[10]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[11]  A. Dembo,et al.  Gibbs Measures and Phase Transitions on Sparse Random Graphs , 2009, 0910.5460.

[12]  R. Ellis,et al.  The statistics of Curie-Weiss models , 1978 .

[13]  J. Besag Statistical Analysis of Non-Lattice Data , 1975 .

[14]  Ronen Eldan,et al.  Decomposition of mean-field Gibbs distributions into product measures , 2017 .

[15]  F. Comets On Consistency of a Class of Estimators for Exponential Families of Markov Random Fields on the Lattice , 1992 .

[16]  Geoffrey Grimmett The Random-Cluster Model , 2002, math/0205237.

[17]  László Lovász,et al.  Large Networks and Graph Limits , 2012, Colloquium Publications.

[18]  Sumit Mukherjee,et al.  Universality of the mean-field for the Potts model , 2015, 1508.03949.

[19]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[20]  Amir Dembo,et al.  Nonlinear large deviations , 2014, 1401.3495.

[21]  H. Künsch,et al.  Asymptotic Comparison of Estimators in the Ising Model , 1992 .