Open Source Platforms for Internet Monitoring and Measurement

Understanding the ever-changing scenario of computer networks and how they operate in the real world implies measuring and analyzing their characteristics. This in turn requires a set of advanced tools and methodologies to be shared among researches, along with the data derived from such activities. In this paper we first present some of the main issues and challenges in the field of Internet Monitoring and Measurement, then we present several open source platforms we have developed in the last 10 years for monitoring heterogeneous and large scale networks. Finally, we describe some of the data sets we made publicly available to the research community.

[1]  Michalis Faloutsos.  Public real data repositories and measurement tools , 2006, CCRV.

[2]  Antonio Pescapè,et al.  Quality of service statistics over heterogeneous networks: Analysis and applications , 2008, Eur. J. Oper. Res..

[3]  Yusuf Öztürk,et al.  DIChirp: direct injection bandwidth estimation , 2008, Int. J. Netw. Manag..

[4]  Salvatore Loreto,et al.  SCTP performance evaluation over heterogeneous networks , 2007, Concurr. Comput. Pract. Exp..

[5]  Nevil Brownlee,et al.  Internet Measurement , 2004, IEEE Internet Comput..

[6]  Antonio Pescapè,et al.  Traffic classification and its applications to modern networks , 2009, Comput. Networks.

[7]  Judith Kelner,et al.  A Survey on Internet Traffic Identification , 2009, IEEE Communications Surveys & Tutorials.

[8]  Ratul Mahajan,et al.  Measuring ISP topologies with Rocketfuel , 2004, IEEE/ACM Transactions on Networking.

[9]  Walter de Donato,et al.  Large Scale Benchmarking of Broadband Access Networks: Issues, Methodologies, and Solutions , 2011 .

[10]  Periklis Chatzimisios,et al.  IPTV QoS and QoE measurements in wired and wireless networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[11]  Rajeev Rastogi,et al.  Topology discovery in heterogeneous IP networks: the NetInventory system , 2004, IEEE/ACM Transactions on Networking.

[12]  Antonio Pescapè.  Entropy-Based Reduction of Traffic Data , 2007, IEEE Communications Letters.

[13]  Antonio Pescapè,et al.  Worm Traffic Analysis and Characterization , 2007, 2007 IEEE International Conference on Communications.

[14]  Antonio Pescapè,et al.  Experimental Analysis of Heterogeneous Wireless Networks , 2004, WWIC.

[15]  Dario Rossi,et al.  Exploiting packet‐sampling measurements for traffic characterization and classification , 2012, Int. J. Netw. Manag..

[16]  Kimberly C. Claffy,et al.  Measured impact of crooked traceroute , 2011, CCRV.

[17]  Antonio Pescapè,et al.  MagNets - experiences from deploying a joint research-operational next-generation wireless access network testbed , 2007, 2007 3rd International Conference on Testbeds and Research Infrastructure for the Development of Networks and Communities.

[18]  L. Angrisani,et al.  Measuring wireless links capacity , 2006, 2006 1st International Symposium on Wireless Pervasive Computing.

[19]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[20]  Grenville J. Armitage,et al.  A survey of techniques for internet traffic classification using machine learning , 2008, IEEE Communications Surveys & Tutorials.

[21]  Antonio Pescapè,et al.  Networked Embedded Systems: A Quantitative Performance Comparison , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[22]  Antonio Pescapè,et al.  UANM: a platform for experimenting with available bandwidth estimation tools , 2010, The IEEE symposium on Computers and Communications.

[23]  Antonio Pescapè,et al.  An efficient storage technique for network monitoring data , 2011, 2011 IEEE International Workshop on Measurements and Networking Proceedings (M&N).

[24]  John A. Silvester,et al.  Analyzing and Modeling Workload Characteristics in a Multiservice IP Network , 2011, IEEE Internet Computing.

[25]  Benoit Donnet,et al.  Internet topology discovery: a survey , 2007, IEEE Communications Surveys & Tutorials.

[26]  Antonio Pescapè,et al.  Topology Discovery at the Router Level: A New Hybrid Tool Targeting ISP Networks , 2011, IEEE Journal on Selected Areas in Communications.

[27]  Massimo Bernaschi,et al.  Analysis and experimentation over heterogeneous wireless networks , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[28]  Yin Zhang,et al.  NetQuest: A Flexible Framework for Large-Scale Network Measurement , 2009, IEEE/ACM Transactions on Networking.

[29]  Richard G. Baraniuk,et al.  pathChirp: Efficient available bandwidth estimation for network paths , 2003 .

[30]  K. Claffy,et al.  Topology discovery by active probing , 2002, Proceedings 2002 Symposium on Applications and the Internet (SAINT) Workshops.

[31]  Yanghee Choi,et al.  NeTraMark: a network traffic classification benchmark , 2011, CCRV.

[32]  Mark Crovella,et al.  Community-oriented network measurement infrastructure (CONMI) workshop report , 2006, CCRV.

[33]  Periklis Chatzimisios,et al.  ANFIS-based quality prediction models for AMR telephony in public 2G/3G mobile networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[34]  Michele C. Weigle,et al.  Tmix: a tool for generating realistic TCP application workloads in ns-2 , 2006, CCRV.

[35]  Antonio Pescapè,et al.  Systematic Performance Modeling and Characterization of Heterogeneous IP Networks , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[36]  Antonio Pescapè,et al.  A tool for the generation of realistic network workload for emerging networking scenarios , 2012, Comput. Networks.

[37]  Artur Ziviani,et al.  Rapid prototyping of active measurement tools , 2012, Comput. Networks.

[38]  Antonio Pescapè,et al.  A packet-level characterization of network traffic , 2006, 2006 11th International Workshop on Computer-Aided Modeling, Analysis and Design of Communication Links and Networks.

[39]  Antonio Pescapè,et al.  Discovering Topologies at Router Level , 2005, IPOM.

[40]  Antonio Pescapè,et al.  Experimental evaluation and characterization of the magnets wireless backbone , 2006, WINTECH.

[41]  Antonio Pescapè,et al.  Searching for invariants in network games traffic , 2006, CoNEXT '06.

[42]  Giuseppe Aceto,et al.  PortLoad: Taking the Best of Two Worlds in Traffic Classification , 2010, 2010 INFOCOM IEEE Conference on Computer Communications Workshops.

[43]  Antonio Pescapè,et al.  Discovering Topologies at Router Level: Part II , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[44]  Manish Jain,et al.  Pathload: A Measurement Tool for End-to-End Available Bandwidth , 2002 .

[45]  Dmitri Krioukov,et al.  Internet Mapping: From Art to Science , 2009, 2009 Cybersecurity Applications & Technology Conference for Homeland Security.

[46]  Walter Willinger,et al.  Laboratory-based calibration of available bandwidth estimation tools , 2007, Microprocess. Microsystems.

[47]  Domenico Ferrari,et al.  On the foundations of artificial workload design , 1983, SIGMETRICS '84.

[48]  Antonio Pescapè,et al.  End-to-end packet-channel Bayesian model applied to heterogeneous wireless networks , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[49]  Antonio Pescapè,et al.  K-Dimensional Trees for Continuous Traffic Classification , 2010, TMA.

[50]  Antonio Pescapè,et al.  Unified architecture for network measurement: The case of available bandwidth , 2012, J. Netw. Comput. Appl..

[51]  Miguel A. Labrador,et al.  Traceband: A fast, low overhead and accurate tool for available bandwidth estimation and monitoring , 2010, Comput. Networks.

[52]  Antonio Pescapè,et al.  Analysis and experimentation of an open distributed platform for synthetic traffic generation , 2004, Proceedings. 10th IEEE International Workshop on Future Trends of Distributed Computing Systems, 2004. FTDCS 2004..

[53]  Zhao Wen-tao,et al.  Efficient available bandwidth estimation for network paths , 2008 .

[54]  George Varghese,et al.  The measurement manifesto , 2004, Comput. Commun. Rev..

[55]  Sally Floyd,et al.  Difficulties in simulating the internet , 2001, TNET.

[56]  Antonio Pescapè,et al.  TIE: A Community-Oriented Traffic Classification Platform , 2009, TMA.

[57]  Kamil Saraç,et al.  Resolving Anonymous Routers in Internet Topology Measurement Studies , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[58]  Antonio Pescapè,et al.  Do you trust your software-based traffic generator? , 2010, IEEE Communications Magazine.

[59]  Antonio Pescapè,et al.  Issues and future directions in traffic classification , 2012, IEEE Network.

[60]  Alberto Dainotti,et al.  An HMM Approach to Internet Traffic Modeling , 2006 .

[61]  Nick Feamster,et al.  Broadband internet performance: a view from the gateway , 2011, SIGCOMM.

[62]  Alessio Botta,et al.  Monitoring and measuring wireless network performance in the presence of middleboxes , 2011, 2011 Eighth International Conference on Wireless On-Demand Network Systems and Services.

[63]  Mark Claypool,et al.  WBest: A bandwidth estimation tool for IEEE 802.11 wireless networks , 2008, 2008 33rd IEEE Conference on Local Computer Networks (LCN).