We consider a collaborative variant of prediction with expert advice. In each round, one user wishes to make a prediction, and must choose which expert to follow. The users would like to share their experiences in order to learn faster--ideally they could amortize the same total regret cross the whole community of users. However, some of the users may behave maliciously, distorting their reported payoffs in order to manipulate the honest users of the system. And even if all users behave honestly, different experts may perform better for different users, such that sharing data can be counterproductive.
We present a robust collaborative algorithm for prediction with expert advice, which guarantees that every subset of users H perform nearly as well as if they had shared all of their data, and ignored all data from users outside of H. This algorithm limits the damage done by the dishonest users to O(root(T)), compared to the O(T) we would obtain by naively aggregating data.
We also extend our results to general online convex optimization. The resulting algorithm achieves low regret, but is computationally intractable. This demonstrates that there is no statistical obstruction to generalizing robust collaborative online learning, but leaves the design of efficient algorithms as an open problem.
[1]
Paul Christiano,et al.
Provably manipulation-resistant reputation systems
,
2014,
COLT.
[2]
Shai Shalev-Shwartz,et al.
Online Learning and Online Convex Optimization
,
2012,
Found. Trends Mach. Learn..
[3]
Baruch Awerbuch,et al.
Competitive collaborative learning
,
2005,
J. Comput. Syst. Sci..
[4]
Boaz Patt-Shamir,et al.
Collaborate with strangers to find own preferences
,
2005,
SPAA '05.
[5]
Yoav Freund,et al.
A decision-theoretic generalization of on-line learning and an application to boosting
,
1995,
EuroCOLT.
[6]
Shai Shalev-Shwartz,et al.
Near-Optimal Algorithms for Online Matrix Prediction
,
2012,
COLT.
[7]
Prabhakar Raghavan,et al.
Competitive recommendation systems
,
2002,
STOC '02.
[8]
Boaz Patt-Shamir,et al.
Tell me who I am: an interactive recommendation system
,
2006,
SPAA.
[9]
Blaine Nelson,et al.
Can machine learning be secure?
,
2006,
ASIACCS '06.
[10]
Wouter M. Koolen,et al.
Second-order Quantile Methods for Experts and Combinatorial Games
,
2015,
COLT.
[11]
Yoram Singer,et al.
Using and combining predictors that specialize
,
1997,
STOC '97.