Dist-Hedge: A partial information setting based distributed non-stochastic sequence prediction algorithm

This paper focuses on the problem of distributed sequence prediction in a network of sparsely interconnected forecasting agents, where agents collaborate to achieve provably reasonable predictive performance. An expert assisted online learning algorithm Dist-Hedge of the consensus+innovations form is proposed, in which the agents aggregate experts' predictions by simultaneously processing the latest network losses (innovations) and the cumulative losses obtained from neighboring agents (consensus). This paper characterizes the sublinear regret of the agents' prediction performance with respect to the best forecasting expert in terms of network connectivity.

[1]  Vladimir Vovk,et al.  Aggregating strategies , 1990, COLT '90.

[2]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[3]  Manfred K. Warmuth,et al.  The weighted majority algorithm , 1989, 30th Annual Symposium on Foundations of Computer Science.

[4]  Claudio Gentile,et al.  Adaptive and Self-Confident On-Line Learning Algorithms , 2000, J. Comput. Syst. Sci..

[5]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[6]  Nicolò Cesa-Bianchi,et al.  Analysis of two gradient-based algorithms for on-line regression , 1997, COLT '97.

[7]  Soummya Kar,et al.  Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs , 2010, IEEE Journal of Selected Topics in Signal Processing.

[8]  Nicolò Cesa-Bianchi,et al.  Potential-Based Algorithms in On-Line Prediction and Game Theory , 2003, Machine Learning.

[9]  Claudio Gentile,et al.  Delay and Cooperation in Nonstochastic Bandits , 2016, COLT.

[10]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[11]  David Haussler,et al.  How to use expert advice , 1993, STOC.

[12]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[13]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[14]  Anit Kumar Sahu,et al.  Distributed sequence prediction: A consensus+innovations approach , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[15]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[16]  Wouter M. Koolen,et al.  Adaptive Hedge , 2011, NIPS.

[17]  Mehran Mesbahi,et al.  Online Distributed Convex Optimization on Dynamic Networks , 2014, IEEE Transactions on Automatic Control.

[18]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.