Relevant Window-Based Bitmap Compression in P2P Systems: Framework and Solution

P2P systems require neighbor peers to frequently exchange buffer-map (BM) messages for efficient content sharing and distribution, which, however, can result in considerable communication overhead. A big problem in the BMs exchanged between neighbor peers is that a lot of information in them is redundant. To reduce the redundancy, some P2P systems have adopted certain block-level compression schemes (e.g., Huffman encoding) to compress each BM in isolation. However, these schemes simply treat each BM separately and as a single block of data, which largely affects their compression efficiency. In this paper, we propose a novel relevant-window-based (RW) compression framework, which takes advantage of the correlation between sequentially exchanged BMs between neighbor peers and thus can greatly remove the redundancy in them. We accordingly design a RW-based distributed compression scheme, which can work alone or co-work well with an existing block-level compression scheme for higher compression efficiency. We prove the correctness of our scheme and derive tight upper bound on average length of compressed bitmaps by our scheme via mathematical modeling. Numerical results demonstrate that our scheme alone can achieve compression efficiency of 96.6%, which can be further increased to up to 97.1% when jointly working with a block-level compression scheme.

[1]  Li Zhao,et al.  A peer-to-peer network for live media streaming using a push-pull approach , 2005, MULTIMEDIA '05.

[2]  Diego Perino,et al.  On Optimizing for Epidemic Live Streaming , 2010, 2010 IEEE International Conference on Communications.

[3]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[4]  Marco Mellia,et al.  The Internet-Wide Impact of P2P Traffic Localization on ISP Profitability , 2012, IEEE/ACM Transactions on Networking.

[5]  Richard T. B. Ma,et al.  On incentivizing upload capacity in P2P-VoD systems: Design, analysis and evaluation , 2013, Comput. Networks.

[6]  Ilkka Norros,et al.  Can P2P networks be super-scalable? , 2013, 2013 Proceedings IEEE INFOCOM.

[7]  John C. S. Lui,et al.  A Simple Model for Analyzing P2P Streaming Protocols , 2007, 2007 IEEE International Conference on Network Protocols.

[8]  Meng Wang,et al.  Incremental updates for efficient bidirectional transformations , 2011, ICFP '11.

[9]  Chuan Wu,et al.  Exploring large-scale peer-to-peer live streaming topologies , 2008, TOMCCAP.

[10]  Kianoosh Mokhtarian,et al.  Capacity Management of Seed Servers in Peer-to-Peer Streaming Systems With Scalable Video Streams , 2013, IEEE Transactions on Multimedia.

[11]  Glen G. Langdon,et al.  An Introduction to Arithmetic Coding , 1984, IBM J. Res. Dev..

[12]  Benjamin C. Pierce,et al.  Matching lenses: alignment and view update , 2010, ICFP '10.

[13]  Bo Li,et al.  Understanding the Performance Gap Between Pull-Based Mesh Streaming Protocols and Fundamental Limits , 2009, IEEE INFOCOM 2009.

[14]  Martin Stiemerling,et al.  Cooperative P2P Video Streaming for Mobile Peers , 2010, 2010 Proceedings of 19th International Conference on Computer Communications and Networks.

[15]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[16]  Solomon W. Golomb,et al.  Run-length encodings (Corresp.) , 1966, IEEE Trans. Inf. Theory.

[17]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[18]  Glen G. Langdon,et al.  Arithmetic Coding , 1979 .

[19]  W. Pan,et al.  Lossless Differential Compression of Weather Radar Data in Universal Format Using Motion Estimation and Compensation , 2010 .

[20]  Eddie Kohler,et al.  Small is not always beautiful , 2008, IPTPS.

[21]  Reza Rejaie,et al.  ISP-Friendly Live P2P Streaming , 2014, IEEE/ACM Transactions on Networking.

[22]  Yong Liu On the minimum delay peer-to-peer video streaming: how realtime can it be? , 2007, ACM Multimedia.

[23]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[24]  Lifeng Sun,et al.  Understanding the Power of Pull-Based Streaming Protocol: Can We Do Better? , 2007, IEEE Journal on Selected Areas in Communications.

[25]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[26]  S. Golomb Run-length encodings. , 1966 .

[27]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[28]  Holger Giese,et al.  From model transformation to incremental bidirectional model synchronization , 2009, Software & Systems Modeling.

[29]  Yang Guo,et al.  A survey on peer-to-peer video streaming systems , 2008, Peer-to-Peer Netw. Appl..

[30]  ZhiHui Lv,et al.  An Analysis and Comparison of CDN-P2P-hybrid Content Delivery System and Model , 2012, J. Commun..

[31]  Heba Afify,et al.  DNA Lossless Differential Compression Algorithm based on Similarity of Genomic Sequence Database , 2011, ArXiv.

[32]  Haiyang Wang,et al.  Exploring Peer-to-Peer Locality in Multiple Torrent Environment , 2012, IEEE Transactions on Parallel and Distributed Systems.