Estimators also need shared values to grow together

Network management applications require large numbers of counters in order to collect traffic characteristics for each network flow. However, these counters often barely fit into on-chip SRAM memories. Past papers have proposed using counter estimators instead, thus trading off counter precision for a lower number of bits. But these estimators do not achieve optimal estimation error, and cannot always scale to arbitrary counter values. In this paper, we introduce the CEDAR algorithm for decoupling the counter estimators from their estimation values, which are quantized into estimation levels and shared among many estimators. These decoupled and shared estimation values enable us to easily adjust them without needing to go through all the counters. We demonstrate how our CEDAR scheme achieves the min-max relative error, i.e., can guarantee the best possible relative error over the entire counter scale. We also explain how to use dynamic adaptive estimation values in order to support counter up-scaling and adjust the estimation error depending on the current maximal counter. Finally we implement CEDAR on FPGA and explain how it can run at line rate. We further analyze its performance and size requirements.

[1]  Cyriel Minkenberg,et al.  Design issues in next-generation merchant switch fabrics , 2007, TNET.

[2]  Qi Zhao,et al.  Design of a novel statistics counter architecture with optimal space and time efficiency , 2006, SIGMETRICS '06/Performance '06.

[3]  Bill Lin,et al.  Maintaining exact statistics counters with a multi-level counter memory , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[4]  Hao Wang,et al.  A randomized interleaved DRAM architecture for the maintenance of exact statistics counters , 2009, PERV.

[5]  Devavrat Shah,et al.  Maintaining Statistics Counters in Router Line Cards , 2002, IEEE Micro.

[6]  Robert Tappan Morris,et al.  Dynamics of random early detection , 1997, SIGCOMM '97.

[7]  George Varghese,et al.  New directions in traffic measurement and accounting: Focusing on the elephants, ignoring the mice , 2003, TOCS.

[8]  Yi Lu,et al.  Robust Counting Via Counter Braids: An Error-Resilient Network Measurement Architecture , 2009, IEEE INFOCOM 2009.

[9]  Andrea Montanari,et al.  Counter braids: a novel counter architecture for per-flow measurement , 2008, SIGMETRICS '08.

[10]  Gershon Elber,et al.  Geometric modeling with splines - an introduction , 2001 .

[11]  Xenofontas A. Dimitropoulos,et al.  Probabilistic lossy counting: an efficient algorithm for finding heavy hitters , 2008, CCRV.

[12]  Rade Stanojevic,et al.  Small Active Counters , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[13]  Paul Barford,et al.  A signal analysis of network traffic anomalies , 2002, IMW '02.

[14]  Philippe Flajolet,et al.  Approximate counting: A detailed analysis , 1985, BIT.

[15]  Hao Wang,et al.  Design and performance analysis of a DRAM-based statistics counter array architecture , 2009, ANCS '09.

[16]  Nan Hua,et al.  BRICK: a novel exact active statistics counter architecture , 2011, TNET.

[17]  Rong Pan,et al.  AF-QCN: Approximate Fairness with Quantized Congestion Notification for Multi-tenanted Data Centers , 2010, 2010 18th IEEE Symposium on High Performance Interconnects.

[18]  Isaac Keslassy,et al.  The Variable-Increment Counting Bloom Filter , 2012, INFOCOM.

[19]  Rajeev Motwani,et al.  Approximate Frequency Counts over Data Streams , 2012, VLDB.

[20]  Li Fan,et al.  Summary cache: a scalable wide-area web cache sharing protocol , 2000, TNET.

[21]  Bill Lin,et al.  DRAM is plenty fast for wirespeed statistics counting , 2008, PERV.

[22]  Nick McKeown,et al.  Designing packet buffers for router linecards , 2008, TNET.

[23]  Cristian Estan,et al.  New directions in traffic measurement and accounting , 2001, IMW '01.