Learning Unknown Graphs

Motivated by a problem of targeted advertising in social networks, we introduce and study a new model of online learning on labeled graphs where the graph is initially unknown, and the algorithm is free to choose the next vertex to predict. After observing that natural nonadaptive exploration/prediction strategies (like depth-first with majority vote) badly fail on simple binary labeled graphs, we introduce an adaptive strategy that performs well under the hypothesis that the vertices of the unknown graph (i.e., the members of the social network) can be partitioned into a few well-separated clusters within which labels are roughly constant (i.e., members in the same cluster tend to prefer the same products). Our algorithm is efficiently implementable and provably competitive against the best of these partitions.

[1]  Vincent Berry,et al.  A Structured Family of Clustering and Tree Construction Methods , 2001, Adv. Appl. Math..

[2]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[3]  Xiaotie Deng,et al.  Exploring an unknown graph , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[4]  Mark Herbster,et al.  Fast Prediction on a Tree , 2008, NIPS.

[5]  J. Suykens,et al.  An Online Algorithm for Learning a Labeling of a Graph , 2008 .

[6]  Mark Herbster,et al.  Exploiting Cluster-Structure to Predict the Labeling of a Graph , 2008, ALT.

[7]  John D. Lafferty,et al.  Semi-supervised learning using randomized mincuts , 2004, ICML.

[8]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[9]  Alexander Souza,et al.  On an Online Spanning Tree Problem in Randomly Weighted Graphs , 2007, Comb. Probab. Comput..

[10]  Guy Lever,et al.  Predicting the Labelling of a Graph via Minimum $p$-Seminorm Interpolation , 2009, COLT.

[11]  Steve Hanneke,et al.  An analysis of graph cut size for transductive learning , 2006, ICML.

[12]  Claudio Gentile,et al.  Fast and Optimal Prediction on a Labeled Tree , 2009, COLT.

[13]  John D. Lafferty,et al.  Diffusion Kernels on Graphs and Other Discrete Input Spaces , 2002, ICML.

[14]  Wan-Shiou Yang,et al.  Discovering cohesive subgroups from social networks for targeted advertising , 2008, Expert Syst. Appl..

[15]  Bernhard Schölkopf,et al.  Learning Theory and Kernel Machines , 2003, Lecture Notes in Computer Science.

[16]  Thorsten Joachims,et al.  Transductive Learning via Spectral Graph Partitioning , 2003, ICML.

[17]  Santosh S. Vempala,et al.  A discriminative framework for clustering via similarity functions , 2008, STOC.

[18]  Guy Lever,et al.  Online Prediction on Large Diameter Graphs , 2008, NIPS.

[19]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[20]  YangWan-Shiou,et al.  Discovering cohesive subgroups from social networks for targeted advertising , 2008 .

[21]  Susanne Albers,et al.  Exploring unknown environments , 1997, STOC '97.

[22]  B. Schölkopf,et al.  Prediction on a Graph with a Perceptron , 2007 .

[23]  Johan A. K. Suykens,et al.  Margin based Transductive Graph Cuts using Linear Programming , 2007, AISTATS.