A survey and performance evaluation of decentralized aggregation schemes for autonomic management

SUMMARY Over the last few years, autonomic network and service management has emerged as a serious alternative to traditional management approaches. In these systems, distributed entities, called autonomic managers, perform monitoring and control operations in an autonomous and decentralized way. The monitoring consists of providing indicators on the state of the system. Several monitoring solutions have been proposed to enable autonomic managers to obtain a partial or complete knowledge of an indicator through aggregation processes. Such a profusion of solutions raises important questions regarding the choice of an aggregation scheme in a particular operational context and for a particular management information because each class of solution presents different benefits and weaknesses. That is why, in this paper, we present the result of our study of decentralized aggregation schemes for autonomic network and service monitoring. The contribution is twofold: (i) a survey of decentralized aggregation schemes based on a refined taxonomy; and (ii) the results of an evaluation campaign we performed to compare typical aggregation schemes. These results highlight the context, in terms of the managed network behaviour as well as information dynamics, in which each aggregation scheme outperforms the others, thus helping autonomic management system designers in choosing the best scheme for their management purpose. Copyright © 2014 John Wiley & Sons, Ltd

[1]  Rolf Stadler,et al.  Computing histograms of local variables for real-time monitoring using aggregation trees , 2009, 2009 IFIP/IEEE International Symposium on Integrated Network Management.

[2]  Antonio F. Gómez-Skarmeta,et al.  DECA: A Hierarchical Framework for DECentralized Aggregation in DHTs , 2006, DSOM.

[3]  Rolf Stadler,et al.  Robust monitoring of network-wide aggregates through gossiping , 2007, IEEE Transactions on Network and Service Management.

[4]  Franco Zambonelli,et al.  A survey of autonomic communications , 2006, TAAS.

[5]  M -.  Estimating Aggregates on a Peer-to-Peer Network , 2003 .

[6]  C R Manjunath,et al.  Data Aggregation Protocols in Wireless Sensor Networks , 2013 .

[7]  Narottam Chand,et al.  A review on data aggregation techniques in wireless sensor network , 2010 .

[8]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[9]  Ramesh Subramanian,et al.  Peer to Peer Computing: The Evolution of a Disruptive Technology , 2005 .

[10]  Hartmut Schmeck,et al.  Organic Computing-Vision and Challenge for System Design , 2004, International Conference on Parallel Computing in Electrical Engineering.

[11]  Nazim Agoulmine,et al.  Autonomic network management principles : from concepts to applications , 2011 .

[12]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[13]  Petr Jan Horn,et al.  Autonomic Computing: IBM's Perspective on the State of Information Technology , 2001 .

[14]  Gerald Kunzmann,et al.  A scalable algorithm to monitor chord-based P2P systems at runtime , 2006, IPDPS.

[15]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[16]  Rolf Stadler,et al.  A-GAP: An Adaptive Protocol for Continuous Network Monitoring with Accuracy Objectives , 2007, IEEE Transactions on Network and Service Management.

[17]  Robbert van Renesse,et al.  Gossip-based distribution estimation in peer-to-peer networks , 2008, IPTPS.

[18]  Rolf Stadler,et al.  A GENERIC PROTOCOL FOR NETWORK STATE AGGREGATION , 2005 .

[19]  John Kubiatowicz,et al.  Handling churn in a DHT , 2004 .

[20]  Guillaume Pierre,et al.  Adam2: Reliable Distribution Estimation in Decentralised Environments , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[21]  Dmitri Loguinov,et al.  On Lifetime-Based Node Failure and Stochastic Resilience of Decentralized Peer-to-Peer Networks , 2005, IEEE/ACM Transactions on Networking.

[22]  Deborah Estrin,et al.  The impact of data aggregation in wireless sensor networks , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[23]  Dominique Gaïti,et al.  Decentralized Aggregation Protocols in Peer-to-Peer Networks: A Survey , 2009, MACE.

[24]  Joanna Geibig,et al.  Self-organized aggregation in irregular wireless networks , 2010, 2010 IFIP Wireless Days.

[25]  R. Mesiar,et al.  Aggregation Functions (Encyclopedia of Mathematics and its Applications) , 2009 .

[26]  Antonio Robles,et al.  A Flexible Routing Scheme for Networks of Workstations , 2000, ISHPC.

[27]  Bernhard Bauer,et al.  AOSE and Organic Computing - How Can They Benefit from Each Other? Position Paper , 2005, ER.

[28]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[29]  Dominique Gaïti,et al.  Impact of Dynamics on Situated and Global Aggregation Schemes , 2011, AIMS.

[30]  Peter J. Haas,et al.  The New Jersey Data Reduction Report , 1997 .

[31]  A Robust Aggregation Tree on Distributed Hash Tables , 2004 .

[32]  Chamundeshwari Kalyane.  Data Aggregation and Routing In Wireless Sensor Networks: Optimal and Heuristic Algorithms , 2015 .

[33]  Robert Tappan Morris,et al.  A performance vs. cost framework for evaluating DHT design tradeoffs under churn , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[34]  Rolf Stadler,et al.  A navigation pattern for scalable Internet management , 2001, 2001 IEEE/IFIP International Symposium on Integrated Network Management Proceedings. Integrated Network Management VII. Integrated Management Strategies for the New Millennium (Cat. No.01EX470).

[35]  Patel Swapnil.  Secure Data Aggregation in Wireless Sensor Networks : A Survey , 2013 .

[36]  Juan Manuel González Nieto,et al.  Secure Data Aggregation in Wireless Sensor Network: a survey , 2008, AISC.

[37]  L. Rodrigues,et al.  Large-Scale Peer-to-Peer Autonomic Monitoring , 2008, 2008 IEEE Globecom Workshops.

[38]  Yang Xiao,et al.  Secure data aggregation in wireless sensor networks: A comprehensive overview , 2009, Comput. Networks.

[39]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[40]  Márk Jelasity,et al.  Gossip-based aggregation in large dynamic networks , 2005, TOCS.

[41]  Márk Jelasity,et al.  Robust aggregation protocols for large-scale overlay networks , 2004, International Conference on Dependable Systems and Networks, 2004.

[42]  Jörg Widmer,et al.  In-network aggregation techniques for wireless sensor networks: a survey , 2007, IEEE Wireless Communications.

[43]  Robert D. Nowak,et al.  Decentralized compression and predistribution via randomized gossiping , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[44]  Josna Jose,et al.  Integrity Protecting and Privacy Preserving Data Aggregation Protocols in Wireless Sensor Networks: A Survey , 2013 .

[45]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[46]  Azzedine Boukerche,et al.  DRINA: A Lightweight and Reliable Routing Approach for In-Network Aggregation in Wireless Sensor Networks , 2013, IEEE Transactions on Computers.

[47]  Paulo Sérgio Almeida,et al.  A Survey of Distributed Data Aggregation Algorithms , 2011, IEEE Communications Surveys & Tutorials.

[48]  Juan Manuel González Nieto,et al.  RSDA: Reputation-Based Secure Data Aggregation in Wireless Sensor Networks , 2008, 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies.

[49]  Janne Riihijärvi,et al.  A survey on resource discovery mechanisms, peer-to-peer and service discovery frameworks , 2008, Comput. Networks.

[50]  Rik Sarkar,et al.  Hierarchical spatial gossip for multi-resolution representations in sensor networks , 2007, IPSN '07.

[51]  Eduardo F. Nakamura,et al.  Information fusion for wireless sensor networks: Methods, models, and classifications , 2007, CSUR.

[52]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[53]  Praveen Yalagandula,et al.  A scalable distributed information management system , 2004, SIGCOMM 2004.

[54]  Anastasios Zafeiropoulos,et al.  Gossiping for Autonomic Estimation of Network-Based Parameters in Dynamic Environments , 2010, OTM Workshops.

[55]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[56]  Michael G. Rabbat.  On Spatial Gossip Algorithms for Average Consensus , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[57]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[58]  Robbert van Renesse,et al.  Willow: DHT, Aggregation, and Publish/Subscribe in One Protocol , 2004, IPTPS.

[59]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[60]  Philip S. Yu,et al.  A Survey of Synopsis Construction in Data Streams , 2007, Data Streams - Models and Algorithms.

[61]  Vaidy S. Sunderam,et al.  Secure multiparty aggregation with differential privacy: a comparative study , 2013, EDBT '13.

[62]  Hamid Pirahesh,et al.  Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals , 1996, Data Mining and Knowledge Discovery.

[63]  Raquel Menezes,et al.  Extrema Propagation: Fast Distributed Estimation of Sums and Network Sizes , 2012, IEEE Transactions on Parallel and Distributed Systems.

[64]  Ken Birman,et al.  The promise, and limitations, of gossip protocols , 2007, OPSR.

[65]  David Kempe,et al.  A decentralized algorithm for spectral analysis , 2008, J. Comput. Syst. Sci..

[66]  Dominique Gaïti,et al.  Towards a P2P-Based Deployment of Network Management Information , 2010, AIMS.

[67]  Gordon S. Blair,et al.  GossipKit: A Framework of Gossip Protocol Family , 2007 .

[68]  Rida Khatoun,et al.  A situatedness-based Knowledge Plane for autonomic networking , 2008, Int. J. Netw. Manag..

[69]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[70]  Rolf Stadler,et al.  Decentralized detection of global threshold crossings using aggregation trees , 2008, Comput. Networks.

[71]  Martin Dietzfelbinger.  Gossiping and Broadcasting versus Computing Functions in Networks , 1997, STACS.

[72]  Jon M. Kleinberg,et al.  Spatial gossip and resource location protocols , 2001, JACM.

[73]  A. Dimakis,et al.  Geographic gossip: efficient aggregation for sensor networks , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[74]  Daji Qiao,et al.  LBA: Lifetime balanced data aggregation in low duty cycle sensor networks , 2012, 2012 Proceedings IEEE INFOCOM.

[75]  Philippe Flajolet,et al.  Probabilistic Counting Algorithms for Data Base Applications , 1985, J. Comput. Syst. Sci..

[76]  Rolf Stadler,et al.  Protocols for Distributed Embedded Management , 2013 .

[77]  Robbert van Renesse,et al.  Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining , 2003, TOCS.

[78]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[79]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[80]  Hartmut Schmeck,et al.  Organic Computing - A Paradigm Shift for Complex Systems , 2011, Organic Computing.

[81]  John Kubiatowicz,et al.  Handling Churn in a DHT (Awarded Best Paper!) , 2004, USENIX Annual Technical Conference, General Track.

[82]  Pramod K. Varshney,et al.  Data-aggregation techniques in sensor networks: a survey , 2006, IEEE Communications Surveys & Tutorials.

[83]  Bernhard Bauer,et al.  AOSE and Organic Computing - How Can They Benefit from Each Other? , 2005, AOIS.

[84]  Dominique Gaïti,et al.  Situated vs. global aggregation schemes for autonomous management systems , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[85]  Jaydip Sen,et al.  A Robust and Secure Aggregation Protocol for Wireless Sensor Networks , 2011, 2011 Sixth IEEE International Symposium on Electronic Design, Test and Application.