Two-Sample Testing can be as Hard as Structure Learning in Ising Models: Minimax Lower Bounds

Consider the following structural two-sample testing problem: given two sets of sample drawn from Ising models, determine whether the underlying network structure has changed. In [1], we showed that for Ising models over p variables with network structures that have degree bounded by d, under mild conditions on the model parameters, the sample complexity of this problem is very close to that of determining either of the network structures. Therefore, the naive scheme of learning and then comparing the structures of both sets of samples is near data-optimal. However, the minimax lower bounds in [1] relied on Ising models that differed in only one edge, which leads to the natural follow-up question: are large changes significantly easier to detect? We extend the previously developed framework to consider this problem, and show that, in a certain parameter regime, large changes do not provide any significant improvement in the number of necessary samples for reliable two-sample testing.

[1]  Andrea Montanari,et al.  Which graphical models are difficult to learn? , 2009, NIPS.

[2]  Kenji Fukumizu,et al.  Learning sparse structural changes in high-dimensional Markov networks , 2017, Behaviormetrika.

[3]  Venkatesh Saligrama,et al.  Lower bounds for two-sample structural change detection in ising and Gaussian models , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  BY YIN XIA,et al.  Testing differential networks with applications to the detection of gene-gene interactions , 2015 .

[5]  Martin J. Wainwright,et al.  Information-Theoretic Limits of Selecting Binary Graphical Models in High Dimensions , 2009, IEEE Transactions on Information Theory.

[6]  Matthew B. Blaschko,et al.  Testing for Differences in Gaussian Graphical Models: Applications to Brain Connectivity , 2015, NIPS.

[7]  T. Cai,et al.  Direct estimation of differential networks. , 2014, Biometrika.

[8]  Arindam Banerjee,et al.  Generalized Direct Change Estimation in Ising Model Structure , 2016, ICML.

[9]  J. Lafferty,et al.  High-dimensional Ising model selection using ℓ1-regularized logistic regression , 2010, 1010.0311.

[10]  Guy Bresler,et al.  Efficiently Learning Ising Models on Arbitrary Graphs , 2014, STOC.

[11]  Vincent Y. F. Tan,et al.  High-dimensional structure estimation in Ising models: Local separation criterion , 2011, 1107.1736.

[12]  Alexandros G. Dimakis,et al.  On the Information Theoretic Limits of Learning Ising Models , 2014, NIPS.

[13]  Masashi Sugiyama,et al.  Support Consistency of Direct Sparse-Change Learning in Markov Networks , 2015, AAAI.