Characterizing smartphone traffic with MapReduce

With the demand of increasing revenue by attracting customers consuming mobile internet services, traffic monitoring and analysis become more critical on network management and service provisioning for operators and ISPs. At the same time, the rapid growing number of smartphone clients led to more complexity and explosive mobile Internet traffic. It makes traditional traffic analyzing methods face challenge of dealing with huge amount of data. In this paper, we propose and implement a distributed computing system which aims to perform high-speed data-intensive network traffic analyses by leveraging MapReduce programming model. Running on this efficient system, we summarize characteristics of smartphone mobile internet traffic by analyzing massive real data which is captured from a living UMTS network of a major service provider of China. Our analysis is crucial for cellular providers to anticipate usage patterns and future traffic growths.

[1]  Deborah Estrin,et al.  A first look at traffic on smartphones , 2010, IMC '10.

[2]  Daniel Gatica-Perez,et al.  Smartphone usage in the wild: a large-scale analysis of applications and context , 2011, ICMI '11.

[3]  Nei Kato,et al.  On Characterizing Peer-to-Peer Streaming Traffic , 2013, IEEE Journal on Selected Areas in Communications.

[4]  Youngseok Lee,et al.  A Hadoop-Based Packet Trace Processing Tool , 2011, TMA.

[5]  S. K. Baghel,et al.  An investigation into traffic analysis for diverse data applications on smartphones , 2012, 2012 National Conference on Communications (NCC).

[6]  James Won-Ki Hong,et al.  Usage pattern analysis of smartphones , 2011, 2011 13th Asia-Pacific Network Operations and Management Symposium.

[7]  Youngseok Lee,et al.  An Internet traffic analysis method with MapReduce , 2010, 2010 IEEE/IFIP Network Operations and Management Symposium Workshops.

[8]  Xin Zhou,et al.  Design of P2P Traffic Identification Based on DPI and DFI , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[9]  Jin-Soo Kim,et al.  HPMR: Prefetching and pre-shuffling in shared MapReduce computation environment , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[10]  Deborah Estrin,et al.  Diversity in smartphone usage , 2010, MobiSys '10.

[11]  Gang Cheng,et al.  On traffic characteristics comparison of ADSL and CDMA network , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[12]  Qiang Xu,et al.  Identifying diverse usage behaviors of smartphone apps , 2011, IMC '11.

[13]  Anja Feldmann,et al.  A First Look at Mobile Hand-Held Device Traffic , 2010, PAM.

[14]  Yang,et al.  Modeling and Characterizing Internet Backbone Traffic , 2010 .