Distributed strategic learning and game theoretic formulation of network embedded coding

Abstract Nowadays, there is a growing demand of middleware solutions for reliable event notification over the Internet due to several key industrial projects aiming at integrating existing legacy systems and enhancing their functionalities. Reliable event notification is mainly realized by means of retransmissions, with the consequent worsening of the performance and traffic load. Traditionally, the opposite approach of spatial redundancy is not used due to the tunability, scalability and flexibility issues of its implementation schemes. In this paper, we propose a game theoretic formulation of Forward Error Correction (one of the mean schemes to introduce spatial redundancy), in order to resolve these mentioned issues. Moreover, we introduce distributed strategic learning for the optimal formulation of the payoff functions in the game, and for the effective adaptivity in response to the possible variations in the experienced loss patterns. We prove the quality of this solution by using a series of simulations run on OMNET++.

[1]  Shueng-Han Gary Chan,et al.  Loss Recovery in Application-Layer Multicast , 2008, IEEE MultiMedia.

[2]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[3]  Christian Esposito,et al.  Distributed Strategic Learning for Building Network Embedded Coding to Achieve Reliable Event Notification , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[4]  Fabián E. Bustamante,et al.  Resilient peer-to-peer multicast without the cost , 2005, IS&T/SPIE Electronic Imaging.

[5]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[6]  Hayder Radha,et al.  Measurement study of low-bitrate internet video streaming , 2001, IMW '01.

[7]  Marcello Cinque,et al.  On data dissemination for large-scale complex critical infrastructures , 2012, Comput. Networks.

[8]  Lixin Gao,et al.  A measurement study on the impact of routing events on end-to-end internet path performance , 2006, SIGCOMM 2006.

[9]  Shu Lin,et al.  Automatic-repeat-request error-control schemes , 1984, IEEE Communications Magazine.

[10]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[11]  Panos M. Pardalos,et al.  Cost Allocation in Combinatorial Optimization Games , 2008 .

[12]  Roberto Beraldi,et al.  Reliable and Timely Event Notification for Publish/Subscribe Services Over the Internet , 2014, IEEE/ACM Transactions on Networking.

[13]  H. Hotelling.  Stability in Competition , 1929 .

[14]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[15]  Chen-Nee Chuah,et al.  Characterization of Failures in an Operational IP Backbone Network , 2008, IEEE/ACM Transactions on Networking.

[16]  Martin Skutella,et al.  Cooperative facility location games , 2000, SODA '00.

[17]  A. Downs.  An Economic Theory of Political Action in a Democracy , 1957, Journal of Political Economy.

[18]  Andreas Drexl,et al.  Facility location models for distribution system design , 2005, Eur. J. Oper. Res..

[19]  Domenico Cotroneo,et al.  On reliability in publish/subscribe services , 2013, Comput. Networks.

[20]  Anne-Marie Kermarrec,et al.  Epidemic information dissemination in distributed systems , 2004, Computer.

[21]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[22]  Saurabh Bagchi,et al.  Exactly-once delivery in a content-based publish-subscribe system , 2002, Proceedings International Conference on Dependable Systems and Networks.

[23]  Christian Esposito,et al.  A Game-Theoretic Approach to Network Embedded FEC over Large-Scale Networks , 2015, ISICA.

[24]  Hari Balakrishnan,et al.  Resilient overlay networks , 2001, SOSP.

[25]  Martin Hoefer,et al.  Non-cooperative facility location and covering games , 2006, Theor. Comput. Sci..

[26]  J. Reese,et al.  Solution methods for the p-median problem: An annotated bibliography , 2006 .

[27]  Aravind Srinivasan,et al.  Resilient multicast using overlays , 2006, TNET.

[28]  Luigi Rizzo,et al.  RMDP: an FEC-based reliable multicast protocol for wireless environments , 1998, MOCO.

[29]  David Watson,et al.  An Experimental Study of Internet Path Diversity , 2006, IEEE Transactions on Dependable and Secure Computing.

[30]  Alex C. Snoeren,et al.  Mesh-based content routing using XML , 2001, SOSP.

[31]  J. J. Garcia-Luna-Aceves,et al.  A comparison of reliable multicast protocols , 1998, Multimedia Systems.

[32]  Hamidou Tembine.  Distributed Strategic Learning for Wireless Engineers , 2017 .